Publications

A Multimodal Approach to Understanding Human Vocal Expressions and Beyond

Abstract

Human verbal and nonverbal expressions carry crucial information not only about intent but also emotions, individual identity, and the state of health and wellbeing. From a basic science perspective, understanding how such rich information is encoded in these signals can illuminate underlying production mechanisms including the variability therein, within and across individuals. From a technology perspective, finding ways for automatically processing and decoding this complex information continues to be of interest across a variety of applications.
The convergence of sensing, communication and computing technologies is allowing access to data, in diverse forms and modalities, in ways that were unimaginable even a few years ago. These include data that afford the multimodal analysis and interpretation of the generation of human expressions.
The first part of the talk will highlight advances that allow us to …

Date
2018
Authors
Shrikanth Narayanan
Book
Proceedings of the 20th ACM International Conference on Multimodal Interaction
Pages
1-1