Correlation analysis of facial features and sign gestures

摘要：

In this paper we focus on the potential correlation of the manual and the non-manual component of sign language. This information is useful for sign language analysis, recognition and synthesis. We are mainly concerned with the application for sign synthesis. First we extracted features that represent the manual and non-manual component. We present a simple but robust method for the hand tracking to obtain a 2D trajectory representing a portion of the manual component. The head is tracked via Active Appearance Model. We introduce initial experiments to reveal the relationship between these features. The procedure is verified on the corpus of isolated signs from Czech Sign Language. The results imply that the components of sign language are correlated. The most correlated signals are the vertical movement of head and hands.

作者: Zdenek Krnoul Marek Hruz Pavel Campr

作者单位: Department of Cybernetics, Faculty of Applied Sciences University of West Bohemia, Plzen, Czech Republic

会议类型: 国际会议

会议名称: 2010 IEEE 10th International Conference on Signal Processing(第十届信号处理国际会议 ICSP 2010)

会议地点: 北京

会议语种:英文

页码: 732-735

在线出版日期: 2010-08-24（万方平台首次上网日期，不代表论文的发表时间）