Small File Access Optimization Based on GlusterFS
This paper describes a strategy to optimize small files reading and writing performance on traditional distributed file system.Traditional distributed file system like GlusterFS stores data within local file system(XFS,EXT3,EXT4,etc.),which shows a significant bottleneck on file metadata lookup.We try to re-design metadata structure by merging small file into large file,thus to reduce size of metadata,so we can store the whole files metadata inside main memory.We design and implement the whole strategy on GlusterFS,test results show a great performance optimization on small file operation.
small file distributed file system metadata optimization glusterfs
Xie Tao Liang Alei
School of Software Engineering Shanghai Jiao Tong University Shanghai,China
国际会议
2014 International Conference on Cloud Computing and Internet of Things (CCIOT)(2014年第一届云计算和物联网国际会议)
长春
英文
101-104
2014-12-13(万方平台首次上网日期,不代表论文的发表时间)