Abstract

Human expressive interactions are characterized by an ongoing unfolding of verbal and nonverbal cues. Such cues convey the interlocutor's emotional state which is continuous and of variable intensity and clarity over time. In this paper, we examine the emotional content of body language cues describing a participant's posture, relative position and approach/withdraw behaviors during improvised affective interactions, and show that they reflect changes in the participant's activation and dominance levels. Furthermore, we describe a framework for tracking changes in emotional states during an interaction using a statistical mapping between the observed audiovisual cues and the underlying user state. Our approach shows promising results for tracking changes in activation and dominance.

Date

2011

Authors

Angeliki Metallinou, Athanassios Katsamanis, Yun Wang, Shrikanth Narayanan

Conference

2011 IEEE international conference on acoustics, speech and signal processing (ICASSP)

Pages

2288-2291

Publisher

IEEE