Publications

A knowledge transfer and boosting approach to the prediction of affect in movies

Abstract

Affect prediction is a classical problem and has recently garnered special interest in multimedia applications. Affect prediction in movies is one such domain, potentially aiding the design as well as the impact analysis of movies. Given the large diversity in movies (such as different genres and languages), obtaining a comprehensive movie dataset for modeling affect is challenging while models trained on smaller datasets may not generalize. In this paper, we address the problem of continuous affect ratings with the availability of limited in-domain data resources. We initially setup several baseline models trained on in-domain data, followed by a proposal of a Knowledge Transfer (KT) + Gradient Boosting (GB) approach. KT learns models on a larger (mismatched) data which are then adapted to make predictions on the data of interest. GB further updates these predictions based on models learnt from the in-domain …

Date
2017
Authors
Sabyasachee Baruah, Rahul Gupta, Shrikanth Narayanan
Conference
2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
Pages
2876-2880
Publisher
IEEE