Research on Internet Hot Topic Detection Based on MapReduce Architecture

摘要：

Internet public opinion increasingly influences daily lives of peoples and social stability. With the development of the Internet, the amount of information on the Internet is huge and updated quickly, which makes public opinion mining face enormous challenges in dealing with huge amounts of information and complex data. This paper proposes an internet Hot Topic Detection scheme based on cloud computing platform. The MapReduce programming model is introduced into the network public opinion analysis for processing massive, complex data. This scheme uses named entity words as text features, and the title and body are combined as two-dimensional VSM (vector space model) to represent text, to improve the accuracy of the Internet public opinion and the system response speed.

关键词： Internet public opinion Cloud computing Hot topic Topic detection.

作者: Zheng fen Xu Yabin Li Yanping

作者单位: School of Computer Beijing Information Science and Technology University Beijing, China

会议类型: 国际会议

会议名称: 2012 4th International Conference on Intelligent Human-Machine Systems and Cybernetics 第4届智能人机系统与控制论国际会议 IHMSC 2012

会议地点: 南昌

会议语种:英文

页码: 81-84

在线出版日期: 2012-08-26（万方平台首次上网日期，不代表论文的发表时间）