Publications

CompCog: Deep causal inference grounds the perception of cognitive objects in speech

Abstract

Artificial Intelligence systems are becoming more and more important in society, and their performance has improved enormously in recent years. Yet, we still do not understand how these systems actually work, and how they emulate human performance, to the extent that they do. In this work, novel methods are developed for probing the inner working of these systems by comparing their internal computations with corresponding computations humans perform. The specific skill we probe is speech recognition—a highly complex process, as speech is a richly variable, information dense, and quickly transmitted medium of communication. One of the ways that the human brain deals with this complexity during speech recognition is by engaging not only brain areas responsible for listening but also areas crucial to the production of speech. This suggests that human cognition is aware of the systems in the world that …

Date
2023
Authors
Khalil Iskarous, Dani Byrd, Shrikanth S Narayanan
Journal
NSF Award
Volume
22
Issue
2240349
Pages
40349