Research on Database Massive Data Processing and Mining Method based on Hadoop Cloud Platform
Massive image processing technology requires very high for the processor and memory,which need to adopt high performance processor and large capacity memory,because the traditional single or single core processing and ordinary memory already can not satisfy the need of image processing.In this paper,cloud computing function is introduced to mass data processing system,and then through the Hadoop distributed computing function,combined with the automatic distribution method of master slave node,the high speed data processing can be realized.Finally,compared with the Hadoop distributed processing algorithms and two kinds of traditional data processing algorithms,the data processing speed of Hadoop distributed algorithms is faster and its information capacity is also higher,it is a massive data processing algorithm,which provides a new method for the study of large data,high capacity and high transmission rate data treatment scheme.
Hadoop Cloud computing Massive data Large capacity Distributed computing Master slave node (key words)
Dan Wu Zhuorong LI Rongfang Bie Mingquan Zhou
College of Information Science and Technology,Beijing Normal University BNU Chinese Academy of Scien College of Information Science and Technology,Beijing Normal University BNU Beijing,China
国际会议
北京
英文
107-110
2014-10-17(万方平台首次上网日期,不代表论文的发表时间)