THE INFLUENCE OF SCALE ON DISTRIBUTED FILE SYSTEM-DESIGN

被引:18
作者
SATYANARAYANAN, M
机构
[1] School of Computer Science, Carnegie Mellon University, Pittsburgh
关键词
SCALABILITY; DISTRIBUTED FILE SYSTEMS; ANDREW; CODA; SECURITY; PERFORMANCE; AVAILABILITY; HETEROGENEITY; REPLICATION; CACHING; LARGE-SCALE DISTRIBUTED SYSTEMS; DESIGN PRINCIPLES FOR SCALABILITY;
D O I
10.1109/32.120311
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Scale should be recognized as a primary factor influencing the architecture and implementation of distributed systems. This paper uses Andrew and Coda, distributed file systems built at Carnegie Mellon University, to validate this proposition. Performance, operability, and security are dominant considerations in the design of these systems. Availability is a further consideration in the design of Coda. Client caching, bulk data transfer, token-based mutual authentication, and hierarchical organization of the protection domain have emerged as mechanisms that enhance scalability. The separation of concerns made possible by functional specialization has also proved valuable in scaling. Heterogeneity is an important by-product of growth, but the mechanisms available to cope with it are rudimentary. Physical separation of clients and servers turns out to be a critical requirement for scalability.
引用
收藏
页码:1 / 8
页数:8
相关论文
共 50 条
  • [21] Dynamic Replication Management Scheme for Distributed File System
    Thu, May Phyo
    Nwe, Khine Moe
    Aye, Kyar Nyo
    BIG DATA ANALYSIS AND DEEP LEARNING APPLICATIONS, 2019, 744 : 139 - 148
  • [22] Performance improvement of distributed file system using tunneling
    Pesicka, Ladislav
    Matejka, Lubos
    Safarik, Jiri
    Racek, Stanislav
    PROCEEDINGS OF THE FIFTH EUROPEAN CONFERENCE ON THE ENGINEERING OF COMPUTER-BASED SYSTEMS (ECBS 2017), 2017,
  • [23] Design and Implementation of GeoFS: a Wide-area File System
    Liu, Guoliang
    Ma, Liuying
    Yan, Pengfei
    Zhang, Shuai
    Liu, Liu
    2014 9TH IEEE INTERNATIONAL CONFERENCE ON NETWORKING, ARCHITECTURE, AND STORAGE (NAS), 2014, : 108 - 112
  • [24] Dynamic Preclusion of Encroachment in Hadoop Distributed File System
    Saranya, S.
    Sarumathi, M.
    Swathi, B.
    Paul, P. Victer
    Kumar, S. Sampath
    Vengattaraman, T.
    BIG DATA, CLOUD AND COMPUTING CHALLENGES, 2015, 50 : 531 - 536
  • [25] Evidence Management System Using Blockchain and Distributed File System (IPFS)
    Jamulkar, Shritesh
    Chandrakar, Preeti
    Ali, Rifaqat
    Agrawal, Aman
    Tiwari, Kartik
    MACHINE LEARNING AND BIG DATA ANALYTICS (PROCEEDINGS OF INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND BIG DATA ANALYTICS (ICMLBDA) 2021), 2022, 256 : 337 - 359
  • [26] On the Power of In-Network Caching in the Hadoop Distributed File System
    Newberry, Eric
    Zhang, Beichuan
    PROCEEDINGS OF THE 2019 CONFERENCE ON INFORMATION-CENTRIC NETWORKING (ICN '19), 2019, : 89 - 99
  • [27] Distributed File Load ReBalancing Methodology For Map Reduce System
    Saraswathi, U.
    Anbu, S.
    Anbazhagan, K.
    2014 INTERNATIONAL CONFERENCE ON INFORMATION COMMUNICATION AND EMBEDDED SYSTEMS (ICICES), 2014,
  • [28] A Seamless and Reliable Distributed Network File System Utilizing Webspace
    Chao, Hsiang-Ching
    Liu, Tzong-Jye
    Chen, Kuong-Ho
    Dow, Chyi-Ren
    WSE 2008: TENTH IEEE INTERNATIONAL SYMPOSIUM ON WEB SITE EVOLUTION, PROCEEDINGS, 2008, : 65 - 68
  • [29] RDMA-based Cooperative Caching for a Distributed File System
    Sasaki, Shin
    Matsumiya, Ryo
    Takahashi, Kazushi
    Oyama, Yoshihiro
    Tatebe, Osamu
    2015 IEEE 21ST INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS (ICPADS), 2015, : 344 - 353
  • [30] Research of Cloud Storage Based on Hadoop Distributed File System
    Han, Yongqi
    Zhang, Yun
    Yu, Shui
    APPLIED SCIENCE, MATERIALS SCIENCE AND INFORMATION TECHNOLOGIES IN INDUSTRY, 2014, 513-517 : 2472 - 2475