Abstract

This paper addresses modeling user behavior in interactions between two people who do not share a common spoken language and communicate with the aid of an automated bidirectional speech translation system. These interaction settings are complex. The translation machine attempts to bridge the language gap by mediating the verbal communication, noting however that the technology may not be always perfect. In a step toward understanding user behavior in this mediated communication scenario, usability data from doctor–patient dialogs involving a two way English–Persian speech translation system are analyzed. We specifically consider user behavior in light of potential uncertainty in the communication between the interlocutors. We analyze the Retry (Repeat and Rephrase) versus Accept behaviors in the mediated verbal channel and as a result identify three user types –Accommodating, Normal and …

Date

April 1, 2010

Authors

JongHo Shin, Panayiotis G Georgiou, Shrikanth Narayanan

Journal

Computer Speech & Language

Volume

24

Issue

2

Pages

232-256

Publisher

Academic Press