Info-concierge: Proactive Multi-modal Interaction through Mind Probing

To close the wide gap between the exploding information world and individual human knowledge, we have investigated a multi-modal interaction strategy called Mind Probing in which a system proactively acts on the user and then estimates his/her internal state by analyzing his/her reaction. We have also developed a system, Info-concierge, that can probe the latent interest of the user, make him/her aware of it, and proactively provide sensible information. The system uses the core techniques of Mind Probing through speech and gaze recognition. In this paper, we present the interaction .ow, the core techniques, and a .eld trial of Info-concierge.
Takatsugu Hirayama Yasuyuki Sumi Tatsuya Kawahara Takashi Matsuyama
Graduate School of Information Science, Nagoya University, Aichi 464-8603, Japan Future University Hakodate, Hokkaido 041-8655, Japan Academic Center for Computing and Media Studies, Kyoto University, Kyoto 606-8501, Japan Graduate School of Informatics, Kyoto University, Kyoto 606-8501, Japan
国际会议
2011亚太信号与信息处理协会年度峰会(APSIPAASC 2011)
西安
英文
1-10
2011-10-18(万方平台首次上网日期,不代表论文的发表时间)