Simple regenerating codes: Network coding for cloud storage

Type: Preprint

Publication Date: 2012-03-01

Citations: 208

DOI: https://doi.org/10.1109/infcom.2012.6195703

Download PDF

Abstract

Network codes designed specifically for distributed storage systems have the potential to provide dramatically higher storage efficiency for the same availability. One main challenge in the design of such codes is the exact repair problem: if a node storing encoded information fails, in order to maintain the same level of reliability we need to create encoded information at a new node. One of the main open problems in this emerging area has been the design of simple coding schemes that allow exact and low cost repair of failed nodes and have high data rates. In particular, all prior known explicit constructions have data rates bounded by 1/2. In this paper we introduce the first family of distributed storage codes that have simple look-up repair and can achieve rates up to 2/3. Our constructions are very simple to implement and perform exact repair by simple XORing of packets. We experimentally evaluate the proposed codes in a realistic cloud storage simulator and show significant benefits in both performance and reliability compared to replication and standard Reed-Solomon codes.

Locations

  • arXiv (Cornell University) - View - PDF

Similar Works

Action Title Year Authors
+ Simple Regenerating Codes: Network Coding for Cloud Storage 2011 Dimitris Papailiopoulos
Jianqiang Luo
Alexandros G. Dimakis
Cheng Huang
Jin Li
+ A Survey on Network Codes for Distributed Storage 2010 Alexandros G. Dimakis
Kannan Ramchandran
Yunnan Wu
Changho Suh
+ PDF Chat A Survey on Network Codes for Distributed Storage 2011 Alexandros G. Dimakis
Kannan Ramchandran
Yunnan Wu
Changho Suh
+ A Survey on Network Codes for Distributed Storage 2010 Alexandros G. Dimakis
Kannan Ramchandran
Yunnan Wu
Changho Suh
+ PDF Chat Regenerating Codes: A System Perspective 2012 Steve Jiekak
Anne-Marie Kermarrec
Nicolas Le Scouarnec
Gilles Straub
Alexandre van Kempen
+ PDF Chat Regenerating codes 2013 Steve Jiekak
Anne-Marie Kermarrec
Nicolas Le Scouarnec
Gilles Straub
Alexandre van Kempen
+ PDF Chat Byzantine fault tolerance of regenerating codes 2011 Frédérique Oggier
Anwitaman Datta
+ Byzantine Fault Tolerance of Regenerating Codes 2011 Frédérique Oggier
Anwitaman Datta
+ Byzantine Fault Tolerance of Regenerating Codes 2011 Frédérique Oggier
Anwitaman Datta
+ Regenerating Codes for Errors and Erasures in Distributed Storage 2012 K. V. Rashmi
Nihar B. Shah
Kannan Ramchandran
P. Vijay Kumar
+ Analysis and Construction of Functional Regenerating Codes with Uncoded Repair for Distributed Storage Systems 2012 Yuchong Hu
Patrick P. C. Lee
Kenneth W. Shum
+ PDF Chat Analysis and construction of functional regenerating codes with uncoded repair for distributed storage systems 2013 Yuchong Hu
Patrick P. C. Lee
Kenneth W. Shum
+ Repairing Reed-Solomon Codes 2017 Venkatesan Guruswami
Mary Wootters
+ Self-repairing Homomorphic Codes for Distributed Storage Systems 2010 Frédérique Oggier
Anwitaman Datta
+ Self-repairing Homomorphic Codes for Distributed Storage Systems 2010 Frédérique Oggier
Anwitaman Datta
+ PDF Chat Regenerating codes for errors and erasures in distributed storage 2012 K. V. Rashmi
Nihar B. Shah
Kannan Ramchandran
P. Vijay Kumar
+ Repairing Reed-Solomon Codes 2015 Venkatesan Guruswami
Mary Wootters
+ Repairing Reed-Solomon Codes 2015 Venkatesan Guruswami
Mary Wootters
+ Clustered Network Coding for Maintenance in Practical Storage Systems 2012 Anne-Marie Kermarrec
Erwan Le Merrer
Gilles Straub
Alexandre van Kempen
+ An Overview of Codes Tailor-made for Better Repairability in Networked Distributed Storage Systems 2011 Anwitaman Datta
Frédérique Oggier