Chinese New Word Detection from Query Logs

摘要：

Existing works in literature mostly resort to the web pages or other author-centric resources to detect new words, which require highly complex text processing. This paper exploits the visitor-centric resources, specifically, query logs from the commercial search engine, to detect new words. Since query logs are generated by the search engine users, and are segmented naturally, the complex text processing work can be avoided. By dynamic time warping, a new word detection algorithm based on the trajectory similarity is proposed to distinguish new words from the query logs. Experiments based on real world data sets show the effectiveness and efficiency of the proposed algorithm.

关键词： new word detection dynamic time warping query logs search engine

作者: Yan Zhang Maosong Sun Yang Zhang

作者单位: State Key Laboratory on Intelligent Technology and Systems Technology Deptment of Computer Science a State Key Laboratory on Intelligent Technology and Systems Technology Deptment of Computer Science a Sohu Inc. R&D center, Beijing 100084, China

会议类型: 国际会议

会议名称: 6th International Conference on Advanced Data Mining and Applications(第六届先进数据挖掘及应用国际会议 ADMA 2010)

会议地点: 重庆

会议语种:英文

页码: 233-243

在线出版日期: 2010-11-19（万方平台首次上网日期，不代表论文的发表时间）