Publications
Multi-label multi-task deep learning for behavioral coding
Abstract
We propose a methodology for estimating human behaviors in psychotherapy sessions using multi-label and multi-task learning paradigms. We discuss the problem of behavioral coding in which data of human interactions are annotated with labels to describe relevant human behaviors of interest. We describe two related, yet distinct, corpora consisting of therapist-client interactions in psychotherapy sessions. We experimentally compare the proposed learning approaches for estimating behaviors of interest in these datasets. Specifically, we compare single and multiple label learning approaches, single and multiple task learning approaches, and evaluate the performance of these approaches when incorporating turn context. We demonstrate that the best multi-label, multi-task learning model with turn context achieves 18.9 and 19.5 percent absolute improvements with respect to a logistic regression classifier (for …
- Date
- November 8, 2019
- Authors
- James Gibson, David C Atkins, Torrey A Creed, Zac Imel, Panayiotis Georgiou, Shrikanth Narayanan
- Journal
- IEEE Transactions on Affective Computing
- Volume
- 13
- Issue
- 1
- Pages
- 508-518
- Publisher
- IEEE