Research on the reliability of network traffic data collection based on Hadoop
In this paper, the problem of how to improve the integrity and reliability of the data acquisition system based on Hadoop is introduced, and the distributed network fault detection technology is introduced; And based on this technology, a distributed node monitoring framework (DNMF) is designed, which is suitable for the data acquisition system ,the node fault detection and processing algorithm and node load balancing algorithm are proposed in this framework; At the same time, the load of DNMF is used to balance the load, and the load of some nodes is prevented.
Hadoop Big data network traffic data collection reliability transmission
ZONG Feng
Shandong Yingcai University, Shandong, 250104, China
国际会议
重庆
英文
454-457
2015-12-18(万方平台首次上网日期,不代表论文的发表时间)