Visual Speech Synthesis based on Chinese Dynamic Visemes

摘要：

In order to realize realistic visual speech synthesis, a visual speech synthesis method based on Chinese dynamic visemes is proposed.With mouth feature parameters of Chinese static visemes,consonants and vowels are classified using clustering algorithm.According to Chinese pronunciation characters,we can get 40 basic dynamic visemes by combining consonant types and vowel types.With these dynamic visemes and corresponding phonemes,two-layer Hidden Markov Model (HMM)is built up and trained.Experimental results show that, for speeches which are chosen randomly,the synthetic visual speech is smooth and realistic.

关键词： Visual speech synthesis.Dynamic viseme. Hidden Markov model

作者: Hui Zhao Chaojing Tang

作者单位: College of Electronic Science and Engineering National University of Defence Technology Changsha,Hunan Province 410073,China

会议类型: 国际会议

会议名称: 2008 IEEE International Conference on Onformation and Automation(IEEE 信息与自动化国际会议)

会议地点: 张家界

会议语种:英文

页码: 139-143

在线出版日期: 2008-06-20（万方平台首次上网日期，不代表论文的发表时间）