The Realization of Green Storage in Hadoop

摘要：

　　Hadoop has been successful at harnessing expansive data-centers resources for large-scale data analysis.However,their effect on data-centers energy efficiency has not scrutinized completely.The energy consumption of Hadoop Distributed File System in data-centers accounts for a great part of total cost of ownership and disk is the main storage media for clusters.Analysis of the interactions between clusters with disks when running a Hadoop application showed a disk idle time when shuffle to memory,which can be used to guide a simple green storage algorithm for Hadoop cluster.The algorithm simulation results with Terasort for 10G data in a cluster with 11 nodes can save 2.47WH.

关键词： Disk Energy Green storage Hadoop

作者: Qiao Zhu Li Miao

作者单位: Department of Computer Science and Engineering,Hunan University Changsha,China

会议类型: 国际会议

会议名称: 2014 International Conference on Cloud Computing and Internet of Things (CCIOT)(2014年第一届云计算和物联网国际会议)

会议地点: 长春

会议语种:英文

页码: 91-95

在线出版日期: 2014-12-13（万方平台首次上网日期，不代表论文的发表时间）