Research on Segmentation in Deleting Repeat Questions

摘要：

It is an effective method that deletes repeat questions to provide quality of question bank. The main way is semantic similarity computing to solve repeat questions deleting but which depends on correct segmentation of text. A highly efficient and accurate method to segment words is proposed which combines word segmentation based on dictionary with reverse maximum matching and based on statistics with suffix arrays. And the idea references design of memory. The accuracy of word segmentation may achieve 97％ and have 10％ of increase in constructing question bank for principles of computer organization.

关键词： Word Segmentation based on Dictionary Word Segmentation based on statistic Suffix array Similarity

作者: Xueli Ren Yubiao Dai

作者单位: College of Computer Science and Engineering Qujing Normal University Qujing, China

会议类型: 国际会议

会议名称: Third International Symposium on Information Science and Engineering(第三届信息科学与工程国际会议 ISISE 2010)

会议地点: 上海

会议语种:英文

页码: 228-231

在线出版日期: 2010-12-24（万方平台首次上网日期，不代表论文的发表时间）