Tele-AR System Based on Real-time Camera Tracking
We propose a visual tele-AR system, which is a combination of tele-existence and AR techniques. By wearing a video see-through HMD and moving his head, a user in this system is able to tele-operate a remote pan-tilt platform to observe the remote scene. Unlike traditional tele-existence systems which use mechanical or magnetic sensors for teleoperation, we propose a novel tele-operation method based on real-time tracking of master and slave cameras. The master camera is a component of the video see-through HMD mounted in front of users eyes, while the slave camera is carried by a remote platform. We estimate uses head motion by tracking the master camera in real time, and translate head motions into motion commands to drive the remote pan-tilt platform. Ideally, motion of the remote platform will be exactly the same as users head. Unfortunately, motion speed of the slave platform is usually limited by their mechanical capability, which may cause pose inconsistence between master and slave cameras, especially when users head moves fast. We solve this problem by also tracking slave camera in real time, and warping video images according to difference between master and slave camera pose. Since slave camera is tracked, we can integrate virtual objects into remote scene, giving the user an augmented visual sense. To reduce system delay, our implementation is accelerated GPU parallel computation. Experimental results show the efficiency and robustness of our method.
tele-existence augmented reality camera tracking real-time
Yanke Wang Fan Zhong Chao Li Hui Xiang Qunsheng Peng Xueying Qin
School of Computer Science and Technology, Shandong University, Jinan, P.R.China State Key Lab of CAD&CG, Zhejiang University, Hangzhou, P.R.China School of Computer Science and Technology, Shandong University, Jinan, P.R.China;Shandong Provincial
国际会议
秦皇岛
英文
19-26
2012-09-14（万方平台首次上网日期，不代表论文的发表时间）