A Survey of Chinese Text Similarity Computation
There is not a natural delimiter between words in Chinese texts.Moreover,Chinese is a semotactie language with complicated structures focusing on semantics.Its differences from Western languages bring more difficulties in Chinese word segmentation and more challenges in Chinese natural language understanding.How to compute the Chinese text similarity with high precision,recall and low cost is a very important but challenging task.Many researchers have studied it for long time.In this paper,we examine existing Chinese text similarity measures,including measures based on statistics and semantics.Our work provides insights into the advantages and disadvantages of each method,including tradeoffs between effectiveness and efficiency.New directions of the future work are discussed.
Chinese text similarity Chinese information processing Similarity algorithm
Xiuhong Wang Shiguang Ju Shengli Wu
Jiangsu University,Zhenjiang,China University of Ulster,Northern Ireland,UK
国际会议
4th Asia Information Retrieval Symposium(AIRS 2008)(第四届亚洲信息检索研讨会)
哈尔滨
英文
592-597
2008-01-16（万方平台首次上网日期，不代表论文的发表时间）