Efficient Focused Crawling Strategy Using Combination of Link Structure and Content Similarity

摘要：

At present, focused crawler usually crawl pages using the link structure or page contents. But both of them have some flaws. So we designed an efficient crawling strategy, which combine the link structure with content similarity.We extracted topic feature vector automatically and judge the topic similarity of a page using combination of link structure and page content. We also forecast the URL similarity using link structure in topic pages. Experiments showed that this strategy effectively increase the precision of fetching topic pages.

作者: Qu Cheng Wang Beizhan Wei Pianpian

作者单位: Software School,Xiamen University,Xiamen 361005,Fujian,China

会议类型: 国际会议

会议名称: 2008 IEEE International Symposium on IT in Medicine and Education(2008信息技术在医学和教育中的应用国际研讨会)(ITME 2008)

会议地点: 厦门

会议语种:英文

页码: 1045-1048

在线出版日期: 2008-12-12（万方平台首次上网日期，不代表论文的发表时间）