Development of a Collaborative Multimodal System with a Shared Sound Display
Ubiquitous computing, or pervasive computing, is an increasing popular technique for developing new human-computer interfaces and computer applications. Computers watch what happens in a physical space where people are and serve them with meaningful information. Here, most of the systems depend on visual interaction, while there are some other interaction media. In this paper we present a collaborative multimodal system toward spatial presence and perceptual realism of sounds. A two-dimensional sound display called Sound Table is its central component, in which 16 speakers are mounted so that multiple users can have a sensation of “sounds are here and there. A stick-shaped device is provided as a means for interaction with the system. The system recognizes manipulation of the device in a 3D space over Sound Table, and then gives users feedback through visual channel as well as auditory one.
Sound display tabular interface collaboration gesture Wii Remote music creation
Takeshi Nakaie Takayuki Koyama Masahito Hirakawa
Interdisciplinary Graduate School of Science and Engineering Shimane University,Japan Interdisciplinary Faculty of Science and Engineering Shimane University,Japan
国际会议
The First IEEE International Conference on Ubi-Media Coputing and Workshops(第一届泛媒体处理国际会议)
兰州
英文
2008-07-15（万方平台首次上网日期，不代表论文的发表时间）