NCFS: On the Practicality and Extensibility of a Network-Coding-Based Distributed File System
An emerging application of network coding is to improve the robustness of distributed storage. Recent theoretical work has shown that a class of regenerating codes, which are based on the concept of network coding, can improve the data repair performance over traditional storage schemes such as erasure coding. However, there remain open issues regarding the feasibility of deploying regenerating codes in practical storage systems. We present NCFS, a distributed file system that realizes regenerating codes under real network settings. NCFS transparently stripes data across multiple storage nodes, without requiring the storage nodes to coordinate among themselves. It adopts a layered design that allows extensibility, such that different storage schemes can be readily included into NCFS. We deploy and evaluate our NCFS prototype in different real network settings. In particular, we use NCFS to conduct an empirical study of different storage schemes, including the traditional erasure codes RAID-5 and RAID-6, and a special family of regenerating codes that are based on E-MBR 16. Our work provides a practical and extensible platform for realizing theories of regenerating codes in distributed file systems.
Yuchong Hu Chiu-Man Yu Yan Kit Li Patrick P.C.Lee John C.S.Lui
The Institute of Network Coding, The Chinese University of Hong Kong, Hong Kong Dept of Computer Science and Engineering, The Chinese University of Hong Kong, Hong Kong
国际会议
2011 International Symposium on Network Coding(2011网络编码国际会议 NETCOD 2011)
北京
英文
1-6
2011-07-25（万方平台首次上网日期，不代表论文的发表时间）