A cost-effective, high-bandwidth storage architecture

被引:57
|
作者
Gibson, GA [1 ]
Nagle, DF
Amiri, K
Butler, J
Chang, FW
Gobioff, H
Hardin, C
Riedel, E
Rochberg, D
Zelenka, J
机构
[1] Carnegie Mellon Univ, Sch Comp Sci, Pittsburgh, PA 15213 USA
[2] Carnegie Mellon Univ, Dept Elect & Comp Engn, Pittsburgh, PA 15213 USA
关键词
D43 file systems management; D47 distributed systems; B4 input/output and data communications;
D O I
10.1145/291006.291029
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
This paper describes the Network-Attached Secure Disk (NASD) storage architecture, prototype implementations of NASD drives, array management our architecture, and three filesystems built on our prototype. NASD provides scalable storage bandwidth without the cost of sewers used primarily for transferring delta from peripheral networks (e.g. SCSI) to client networks (e.g. ethernet). increasing dataset sizes, new attachment technologies, the convergence of peripheral and interprocessor switched networks, and the increased availability of on-drive transistors motivate and enable this new architecture. NASD is based on four main principles: direct transfer to clients, secure interfaces via cryptographic support, asynchronous non-critical-path oversight, and variably-sized data objects. Measurements of our prototype system shout that these services can be cost-effectively integrated into a next generation disk drive ASIC. End-to-end measurements of our prototype drive and filesystems suggest that NASD can support conventional distributed filesystems without performance degradation. More importantly, we show scalable bandwidth for NASD-specialized filesystems. Using a parallel data mining application, NASD drives deliver a linear scaling of 6.2 MB/s per client-drive pair tested with up to eight pairs in our lab.
引用
收藏
页码:92 / 103
页数:12
相关论文
共 50 条
  • [1] A cost-effective VLSI architecture for anisotropic texture filtering in limited memory bandwidth
    Shin, HC
    Lee, JA
    Kim, LS
    IEEE TRANSACTIONS ON VERY LARGE SCALE INTEGRATION (VLSI) SYSTEMS, 2006, 14 (03) : 254 - 267
  • [2] Cost-effective clustered architecture
    Canal, Ramon
    Parcerisa, Joan-Manuel
    Gonzalez, Antonio
    Parallel Architectures and Compilation Techniques - Conference Proceedings, PACT, 1999, : 160 - 168
  • [3] A high-bandwidth and low-cost data processing approach with heterogeneous storage architectures
    Wei, Bing
    Xiao, Limin
    Wei, Wei
    Song, Yao
    Yan, Baicheng
    Huo, Zhisheng
    PERSONAL AND UBIQUITOUS COMPUTING, 2020, 27 (2) : 159 - 176
  • [4] Cost-effective architecture of carbon capture and storage (CCS) grid in India
    Garg, Amit
    Shukla, P. R.
    Parihar, Shrutika
    Singh, Udayan
    Kankal, Bhushan
    INTERNATIONAL JOURNAL OF GREENHOUSE GAS CONTROL, 2017, 66 : 129 - 146
  • [5] A high-bandwidth and low-cost data processing approach with heterogeneous storage architectures
    Bing Wei
    Limin Xiao
    Wei Wei
    Yao Song
    Baicheng Yan
    Zhisheng Huo
    Personal and Ubiquitous Computing, 2023, 27 : 159 - 176
  • [6] A Scalable High-Bandwidth Architecture for Lossless Compression on FPGAs
    Fowers, Jeremy
    Kim, Joo-Young
    Burger, Doug
    Hauck, Scott
    2015 IEEE 23RD ANNUAL INTERNATIONAL SYMPOSIUM ON FIELD-PROGRAMMABLE CUSTOM COMPUTING MACHINES (FCCM), 2015, : 52 - 59
  • [7] A cost-effective morphological filter architecture
    Ong, S
    Sunwoo, MH
    CAMP'97 - FOURTH IEEE INTERNATIONAL WORKSHOP ON COMPUTER ARCHITECTURE FOR MACHINE PERCEPTION, PROCEEDINGS, 1997, : 285 - 289
  • [8] A cost-effective and reliable cloud storage
    Wei, Yongmei
    Foo, Yong Wee
    2014 IEEE 7TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING (CLOUD), 2014, : 938 - 939
  • [9] VHS offers cost-effective storage
    Computer Technology Review, 1993, 13 (10):
  • [10] Building Cost-Effective Storage Clouds
    Zhang, Ning
    Kant, Chander
    2014 IEEE INTERNATIONAL CONFERENCE ON CLOUD ENGINEERING (IC2E), 2014, : 77 - 86