A New Language Model Adaptation Framework Using Modification of Structures of Background Corpus and Language Model

摘要：

This paper presents a new framework of language model adaptation based on modification of structures of background corpus and language model. The widely used adaptation approach such as Linear Interpolation Method (LI) and Minimum Discrimination Information (MDI) method are used as the approaches to modify structure of trained background language model in new framework, while Maximum A Posteriori approach (MAP) is used as the method of modifying structure of background corpus. Experiments show that both techniques in the framework yield a significant reduction in perplexity over LI, MAP and MDI method in general adaptation framework about 5.2%, 12.2% and 36.8% respectively.

关键词： Language model adaptation MAP MDI linear interpolation modification

作者: Zhenyu Lv Wenju Liu Zhanlei Yang

作者单位: Institute of Automation Chinese Academy of Sciences Beijing, China

会议类型: 国际会议

会议名称: International Conference on Natural Language Processing and Knowledge Engineering(IEEE自然语言处理与知识工程国际会议 IEEE NLP-KE 2009)

会议地点: 大连

会议语种:英文

页码: 1-4

在线出版日期: 2009-09-24（万方平台首次上网日期，不代表论文的发表时间）