Incremental Web Page Template Detection
Most template detection methods process web pages in batches that a newly crawled page can not be processed until enough pages have been collected. This results in large storage consumption and a huge delay of data refreshing. In this paper, we present an incremental framework to detect templates in which a page is processed as soon as it has been crawled. In this framework, we don’t need to cache any web page. Experiments show that our framework consumes less than 7％ storage than traditional methods. And also the speed of data refreshing is accelerated because of the incremental manner.
Automatic Template Removal Web Page Segmentation
Yu Wang Bingxing Fang Xueqi Cheng Li Guo Hongbo Xu
Institute of Computing Technology, Chinese Academy of Sciences BeiJing, China
国际会议
第十七届国际万维网大会(the 17th International World Wide Web Conference)(WWW08)
北京
英文
2008-04-21（万方平台首次上网日期，不代表论文的发表时间）