Contrasting Multi-Lingual Prosodic Cues to Predict Verbal Feedback for Rapport

Siwei Wang1 and Gina-Anne Levow2
1University of Chicago, 2University of Washington


Abstract

Verbal feedback is an important informationsource in establishing interactional rapport. However, predicting verbal feedback across languages is challenging due to language-specific differences, inter-speaker variation, and the relative sparseness and optionality of verbal feedback. In this paper, we employ an approach combining classifier weighting and SMOTE algorithm oversampling to improve verbal feedback prediction in Arabic, English, and Spanish dyadic conversations. This approach improves the prediction of verbal feedback, up to 6-fold, while maintaining a high overall accuracy. Analyzing highly weighted features highlights widespread use of pitch, with more varied use of intensity and duration.




Full paper: http://www.aclweb.org/anthology/P/P11/P11-2108.pdf