Multimodal Speech and Audio User Interfaces for K-12 Outreach
Elementary school children have short attention spans. This paper describes three multimodal speech and audio user interfaces that captured and held the attention of a few dozen elementary-school and high-school children during the course of a two-day university open house. The Speech Recognition Game demonstrated an isolated word recognizer with a rapidly-won game, in which children were challenged to get ten words in a row correctly recognized. The Audio Easter Egg Hunt demonstrated our timeliner multimedia analytics platform with a faster-than-real-time search through orchestral music for audio anomalies (cuckoo clocks, motorcycles, etc). Finally, at the Intonation Station, children had to pick the pitch contour that would help a friendly troll to successfully hunt dragons in the city of Champaign. Results suggest that competition, collaboration, and other forms of social interaction may motivate children more than prizes.
Mark Hasegawa-Johnson Kai-Hsiang Lin Harsh Vardhan Sharma Zhen Li Thomas S. Huang Camille Goudeseune Jennifer Cole Hank Kaczmarski Heejin Kim Sarah King Timothy Mahrt Jui-Ting Huang Xiaodan Zhuang
University of Illinois at Urbana-Champaign
国际会议
2011亚太信号与信息处理协会年度峰会(APSIPAASC 2011)
西安
英文
1-6
2011-10-18（万方平台首次上网日期，不代表论文的发表时间）