Abstract

Diversity of a classifier ensemble has been shown to benefit overall classification performance. But most conventional methods of training ensembles offer no control on the extent of diversity and are meta-learners. We present a method for creating an ensemble of diverse maximum entropy (∂MaxEnt) models, which are popular in speech and language processing. We modify the objective function for conventional training of a MaxEnt model such that its output posterior distribution is diverse with respect to a reference model. Two diversity scores are explored - KL divergence and posterior cross-correlation. Experiments on the CoNLL-2003 Named Entity Recognition task and the IEMOCAP emotion recognition database show the benefits of a ∂MaxEnt ensemble.

Date

2012

Authors

Kartik Audhkhasi, Abhinav Sethy, Bhuvana Ramabhadran, Shrikanth S Narayanan

Conference

2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

Pages

4845-4848

Publisher

IEEE