Fingertip in the Eye: An Attention-Based Method for Real-Time Hand Tracking and Fingertip Detection in Egocentric Videos

摘要：

　　The hand and fingertip tracking is the crucial part in the egocentric vision interaction,and it remains a challenging problem due to various factors like dynamic environment and hand deformation.We propose a convolutional neural network(CNN)based method for the real-time and accurate hand tracking and fingertip detection in RGB sequences captured by an egocentric mobile camera.Firstly,we build a large scale dataset,Ego-Finger,containing plenty of scenarios and human labeled ground truth.Secondly,we propose a two stage CNN pipeline,i.e.,the human vision inspired Attention-based Hand Tracker(AHT)and the hand physical constrained Multi-Points Fingertip Detector(MFD).Comparing with state-of-the-art methods,the proposed method achieves very promising results in the real-time fashion.

关键词： Attention-based hand tracking Multiple points fingertip detection Large scale ego-finger dataset

作者: Xiaorui Liu Yichao Huang Xin Zhang Lianwen Jin

作者单位: School of Electronic and Information Engineering,South China University of Technology,Guangzhou,China

会议类型: 国际会议

会议名称: 第七届全国模式识别学术会议(The 7th Chinese Conference on Pattern Recognition,CCPR2016)

会议地点: 成都

会议语种:英文

页码: 145-154

在线出版日期: 2016-11-03（万方平台首次上网日期，不代表论文的发表时间）