Exploring high performance distributed file storage using LDPC codes

被引：10

作者：

Gaidioz, Benjamin ^{[1
]}

Koblitz, Birger

Santos, Nuno

机构：

[1] Ecole Polytech Fed Lausanne, CH-1015 Lausanne, Switzerland

[2] CERN, European Org Nucl Res, CH-1211 Geneva, Switzerland

来源：

PARALLEL COMPUTING | 2007年 / 33卷 / 4-5期

关键词：

distributed file storage; low-density parity-check (LDPC) codes; high-availability; high-performance;

D O I：

10.1016/j.parco.2007.02.003

中图分类号：

TP301 [理论、方法];

学科分类号：

081202 ;

摘要：

We explore the feasibility of implementing a reliable, high performance, distributed storage system on a commodity computing cluster. Files are distributed across storage nodes using erasure coding with small low-density parity-check (LDPC) codes, which provide high-reliability with small storage and performance overhead. We present performance measurements done on a prototype system comprising 50 nodes, which are self organised using a peer-to-peer overlay. (C) 2007 Elsevier B.V. All rights reserved.

引用

页码：264 / 274

页数：11

共 20 条

[1] Serverless network file systems [J].

Anderson, TE ;

Dahlin, MD ;

Neefe, JM ;

Patterson, DA ;

Roselli, DS ;

Wang, RY .

ACM TRANSACTIONS ON COMPUTER SYSTEMS, 1996, 14 (01) :41-79

[2]

[Anonymous], SOSP 01

[3]

[Anonymous], SIGOPS OPER SYST REV

[4]

Byers J. W., 1998, Computer Communication Review, V28, P56, DOI 10.1145/285243.285258

[5]

COLLINS RL, 2005, DSN 05 INT C DEP SYS

[6]

FROLUND S, 2003, P 9 WORKSH HOT TOP O, P169

[7]

Gallager RG, 1963, LOW DENSITY PARITY C

[8]

Ghemawat S., 2003, SOSP, P29

[9] Petal: Distributed virtual disks [J].

Lee, EK ;

Thekkath, CA .

ACM SIGPLAN NOTICES, 1996, 31 (09) :84-92

[10]

LIN S, 2004, ICAC 04 P 1 INT C AU, P122

← 1 2 →