Piano AR: A Markerless Augmented Reality Based Piano Teaching System

摘要：

This paper presents a novel markerless augmented reality based piano teaching system, which tracks the real keyboard of piano naturally. Following the virtual hands augmented on the keyboard, beginners of piano can practice playing piano. Instead of the marker in traditional AR system, the geometrical parameters of the piano keyboard are detected to calculate the transformation matrix from keyboard coordinate to camera coordinate. We first extract all the contours of the image, from which possible contours of keyboard are found. Then the area of keyboard is identified by the structure of white and black keys predefined. We evaluated the system with speed and accuracy. As a result, the system operates at 15fps, and the average error worked out by our method is about 1.97 pixels. The usefulness of our approach is reflected in an example that a user learns to play piano.

关键词： augmented reality machine vision image processing

作者: Feng Huang Yu Zhou Yao Yu Ziqiang Wang Sidan Du

作者单位: Nanjing University School of Electronic Science and Engineering Hankou Road,Nanjing JiangSu Province Nanjing University School of Electronic Science and Engineering Hankou Road .Nanjing JiangSu Provinc

会议类型: 国际会议

会议名称: 2011 Third International Conference on Intelligent Human-Machine Systems and Cybernetics 第三届智能人机系统与控制论国际会议 IHMSC 2011

会议地点: 杭州

会议语种:英文

页码: 282-287

在线出版日期: 2011-08-26（万方平台首次上网日期，不代表论文的发表时间）