Publications

Spatio-temporal articulatory movement primitives during speech production: Extraction, interpretation, and validation

Abstract

This paper presents a computational approach to derive interpretable movement primitives from speech articulation data. It puts forth a convolutive Nonnegative Matrix Factorization algorithm with sparseness constraints (cNMFsc) to decompose a given data matrix into a set of spatiotemporal basis sequences and an activation matrix. The algorithm optimizes a cost function that trades off the mismatch between the proposed model and the input data against the number of primitives that are active at any given instant. The method is applied to both measured articulatory data obtained through electromagnetic articulography as well as synthetic data generated using an articulatory synthesizer. The paper then describes how to evaluate the algorithm performance quantitatively and further performs a qualitative assessment of the algorithm's ability to recover compositional structure from data. This is done using pseudo …

Date
2013
Authors
Vikram Ramanarayanan, Louis Goldstein, Shrikanth S Narayanan
Journal
The Journal of the Acoustical Society of America
Volume
134
Issue
2
Pages
1378-1394
Publisher
AIP Publishing