Find out What a User is Doing before the First Utterance: Discrimination of User’s Internal State using Non-verbal Information
In this research, we propose a method for estimating user’s internal state (thinking or embarrassed) before the utterance toward a spoken dialogue system. Modeling user’s internal state such as belief, skill or familiarity and introducing these model to the dialogue system should be useful to make flexible responses. However, because conventional estimation of internal state is based on the linguistic information of the previous utterance, it cannot estimate a user’s internal state before the user’s first utterance. We focus on a user’s multimodal features such as filler word, silence, or face direction before the user’s input utterance in order to model the user’s internal state. The dialogue data were collected on the Wizard of Oz basis as training and test materials. Finally, we conducted an experiment for discrimination with two classification schemes and the hierarchical method obtained higher discrimination accuracy than that of pair-wise method.
Yuya Chiba Seongjun Hahm Akinori Ito
Graduate School of Engineering, Tohoku University, Japan
国际会议
2011亚太信号与信息处理协会年度峰会(APSIPAASC 2011)
西安
英文
1-4
2011-10-18（万方平台首次上网日期，不代表论文的发表时间）