Research on Improved Algorithm for Chinese Word Segmentation Based on Markov Chain

摘要：

Chinese words segmentation is an important technique for Chinese web data mining. After the research made on some Chinese word segmentation nowadays, an improved algorithm is proposed in this paper. The algorithm updates dictionary by using Two-way Markov Chain, and does word segmentation by applying an improved Forward Maximum Matching Method based on word frequency statistic. The simulation shows this algorithm can finish word segmentation for a given text quickly and accurately.

作者: Pang Baomao Shi Haoshan

作者单位: College of Electronic Information,Northwest Polytechnical University,Xian 710072,China The Air Forc College of Electronic Information,Northwest Polytechnical University,Xian 710072,China

会议类型: 国际会议

会议名称: The Fifth International Conference on Information Assurance and Security(第五届信息保障与安全国际会议)

会议地点: 西安

会议语种:英文

页码: 236-238

在线出版日期: 2009-08-18（万方平台首次上网日期，不代表论文的发表时间）