Based-on Vector Space Model Research and Implementation of Web Filtering

摘要：

This paper proposes a new information filtering method and implements it, which applies two-level filtering strategy and combines filtering technology based on URL and content filtering.It only executes content filtering when the requested URL isnt in white URL lists and black URL lists,and updates URL lists according to content filtering steps result.In this way,it has both real-time characteristic of URL filtering and comprehensive characteristic of content filtering.The web page filtering system captures HTTP packets by using Winsock 2 SPI,extracts web pages content by applying the new proposed method and represents text by vector space modal. It proposes a two-stage filtering arithmetic based on vector space modal and realizes its system.Experimental results show that the system has good filtering accuracy and performance.

关键词： URL filtering content filtering vector space modal

作者: LU Qingmei Zhang hongliang

作者单位: Department of Electronic Science and Technology, North University of China, Taiyuan, Shanxi, China, 030051

会议类型: 国际会议

会议名称: 第八届国际测试技术研讨会(8th International Symposium on Test and Measurement)

会议地点: 重庆

会议语种:英文

页码: 3590-3593

在线出版日期: 2009-08-01（万方平台首次上网日期，不代表论文的发表时间）