News Page Discovery Policy for Instant Crawlers
Many news pages which are of high freshness requirements are published on the interact every day.They should be downloaded immediately by instant crawlers.Otherwise,they will become outdated soon.In the past,instant crawlers only downloaded pages from a manually generated news website list.Bandwidth is wasted in downloading non-news pages because news websites do not publish news pages exclusively.In this paper,a novel approach is proposed to discover news pages.This approach includes seed selection and news URL prediction based on user behavior analysis.Empirical studies in a user access log for two months show that our approach outperforms the traditional approach in both precision and recall.
web log user behavior analysis news page discovery
Yong Wang Yiqun Liu Min Zhang Shaoping Ma
State Key Lab of Intelligent Tech.& Sys.,Tsinghua University
国际会议
4th Asia Information Retrieval Symposium(AIRS 2008)(第四届亚洲信息检索研讨会)
哈尔滨
英文
520-525
2008-01-16（万方平台首次上网日期，不代表论文的发表时间）