Abstract

Studies of time-continuous human behavioral phenomena often rely on ratings from multiple annotators. Since the ground truth of the target construct is often latent, the standard practice is to use ad-hoc metrics (such as averaging annotator ratings). Despite being easy to compute, such metrics may not provide accurate representations of the underlying construct. In this paper, we present a novel method for modeling multiple time series annotations over a continuous variable that computes the ground truth by modeling annotator specific distortions. We condition the ground truth on a set of features extracted from the data and further assume that the annotators provide their ratings as modification of the ground truth, with each annotator having specific distortion tendencies. We train the model using an Expectation-Maximization based algorithm and evaluate it on a study involving natural interaction between a child …

Date

2016

Authors

Rahul Gupta, Kartik Audhkhasi, Zach Jacokes, Agata Rozga, Shrikanth Narayanan

Journal

IEEE transactions on affective computing

Volume

9

Issue

1

Pages

76-89

Publisher

IEEE