Publications

Multi-label multi-task deep learning for behavioral coding

Abstract

We propose a methodology for estimating human behaviors in psychotherapy sessions using multi-label and multi-task learning paradigms. We discuss the problem of behavioral coding in which data of human interactions are annotated with labels to describe relevant human behaviors of interest. We describe two related, yet distinct, corpora consisting of therapist-client interactions in psychotherapy sessions. We experimentally compare the proposed learning approaches for estimating behaviors of interest in these datasets. Specifically, we compare single and multiple label learning approaches, single and multiple task learning approaches, and evaluate the performance of these approaches when incorporating turn context. We demonstrate that the best multi-label, multi-task learning model with turn context achieves 18.9 and 19.5 percent absolute improvements with respect to a logistic regression classifier (for …

Date
November 8, 2019
Authors
James Gibson, David C Atkins, Torrey A Creed, Zac Imel, Panayiotis Georgiou, Shrikanth Narayanan
Journal
IEEE Transactions on Affective Computing
Volume
13
Issue
1
Pages
508-518
Publisher
IEEE