Research and Application on Optimization of Multi-thread Download Technology for Enhanced Search Engine

摘要：

　　Multi-threaded file download as the key technology of content acquisition system for sesrch engine,determines the efficiency and timeliness of content acquisition.In this paper,we do the research on optimization technologies which include multithreaded download based on P2SP,task scheduling based on MapReduce and download based on the protocol adaptation,designed to improve enhanced search engine efficiency.At last the result shows that the optimization method is successful for content acquisition.

关键词： search engine multi-threaded download P2SP MapReduce protocol adaptation

作者: Yajuan Sun Hong Lin Baohui Wang

作者单位: Network and Information Center North China Electric Power University Beijing, China School of Software Beijing University of Aeronautics and Astronautics Beijing, China

会议类型: 国际会议

会议名称: 2012 2nd International Conference on Computer and Information Applications(ICCIA2012)(2012第二届计算机和信息应用国际会议)

会议地点: 太原

会议语种:英文

页码: 1473-1476

在线出版日期: 2012-12-08（万方平台首次上网日期，不代表论文的发表时间）