Publications

Analysis and predictive modeling of body language behavior in dyadic interactions from multimodal interlocutor cues

Abstract

During dyadic interactions, participants adjust their behavior and give feedback continuously in response to the behavior of their interlocutors and the interaction context. In this paper, we study how a participant in a dyadic interaction adapts his/her body language to the behavior of the interlocutor, given the interaction goals and context. We apply a variety of psychology-inspired body language features to describe body motion and posture. We first examine the coordination between the dyad's behavior for two interaction stances: friendly and conflictive. The analysis empirically reveals the dyad's behavior coordination, and helps identify informative interlocutor features with respect to the participant's target body language features. The coordination patterns between the dyad's behavior are found to depend on the interaction stances assumed. We apply a Gaussian-Mixture-Model-based (GMM) statistical mapping in …

Date
2014
Authors
Zhaojun Yang, Angeliki Metallinou, Shrikanth Narayanan
Journal
IEEE Transactions on Multimedia
Volume
16
Issue
6
Pages
1766-1778
Publisher
IEEE