THE INFLUENCE OF SCALE ON DISTRIBUTED FILE SYSTEM-DESIGN

被引:18
作者
SATYANARAYANAN, M
机构
[1] School of Computer Science, Carnegie Mellon University, Pittsburgh
关键词
SCALABILITY; DISTRIBUTED FILE SYSTEMS; ANDREW; CODA; SECURITY; PERFORMANCE; AVAILABILITY; HETEROGENEITY; REPLICATION; CACHING; LARGE-SCALE DISTRIBUTED SYSTEMS; DESIGN PRINCIPLES FOR SCALABILITY;
D O I
10.1109/32.120311
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Scale should be recognized as a primary factor influencing the architecture and implementation of distributed systems. This paper uses Andrew and Coda, distributed file systems built at Carnegie Mellon University, to validate this proposition. Performance, operability, and security are dominant considerations in the design of these systems. Availability is a further consideration in the design of Coda. Client caching, bulk data transfer, token-based mutual authentication, and hierarchical organization of the protection domain have emerged as mechanisms that enhance scalability. The separation of concerns made possible by functional specialization has also proved valuable in scaling. Heterogeneity is an important by-product of growth, but the mechanisms available to cope with it are rudimentary. Physical separation of clients and servers turns out to be a critical requirement for scalability.
引用
收藏
页码:1 / 8
页数:8
相关论文
共 50 条
[21]   Authentication and Availability in a Flexible and Adaptable Distributed File System [J].
Neto, Mario Camara ;
Lobato, Renata Spolon ;
Manacero, Aleardo, Jr. ;
Spolon, Roberta ;
Cavenaghi, Marcos Antonio .
2017 12TH IBERIAN CONFERENCE ON INFORMATION SYSTEMS AND TECHNOLOGIES (CISTI), 2017,
[22]   Performance improvement of distributed file system using tunneling [J].
Pesicka, Ladislav ;
Matejka, Lubos ;
Safarik, Jiri ;
Racek, Stanislav .
PROCEEDINGS OF THE FIFTH EUROPEAN CONFERENCE ON THE ENGINEERING OF COMPUTER-BASED SYSTEMS (ECBS 2017), 2017,
[23]   Design and Implementation of GeoFS: a Wide-area File System [J].
Liu, Guoliang ;
Ma, Liuying ;
Yan, Pengfei ;
Zhang, Shuai ;
Liu, Liu .
2014 9TH IEEE INTERNATIONAL CONFERENCE ON NETWORKING, ARCHITECTURE, AND STORAGE (NAS), 2014, :108-112
[24]   Dynamic Preclusion of Encroachment in Hadoop Distributed File System [J].
Saranya, S. ;
Sarumathi, M. ;
Swathi, B. ;
Paul, P. Victer ;
Kumar, S. Sampath ;
Vengattaraman, T. .
BIG DATA, CLOUD AND COMPUTING CHALLENGES, 2015, 50 :531-536
[25]   Evidence Management System Using Blockchain and Distributed File System (IPFS) [J].
Jamulkar, Shritesh ;
Chandrakar, Preeti ;
Ali, Rifaqat ;
Agrawal, Aman ;
Tiwari, Kartik .
MACHINE LEARNING AND BIG DATA ANALYTICS (PROCEEDINGS OF INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND BIG DATA ANALYTICS (ICMLBDA) 2021), 2022, 256 :337-359
[26]   On the Power of In-Network Caching in the Hadoop Distributed File System [J].
Newberry, Eric ;
Zhang, Beichuan .
PROCEEDINGS OF THE 2019 CONFERENCE ON INFORMATION-CENTRIC NETWORKING (ICN '19), 2019, :89-99
[27]   Distributed File Load ReBalancing Methodology For Map Reduce System [J].
Saraswathi, U. ;
Anbu, S. ;
Anbazhagan, K. .
2014 INTERNATIONAL CONFERENCE ON INFORMATION COMMUNICATION AND EMBEDDED SYSTEMS (ICICES), 2014,
[28]   A Seamless and Reliable Distributed Network File System Utilizing Webspace [J].
Chao, Hsiang-Ching ;
Liu, Tzong-Jye ;
Chen, Kuong-Ho ;
Dow, Chyi-Ren .
WSE 2008: TENTH IEEE INTERNATIONAL SYMPOSIUM ON WEB SITE EVOLUTION, PROCEEDINGS, 2008, :65-68
[29]   RDMA-based Cooperative Caching for a Distributed File System [J].
Sasaki, Shin ;
Matsumiya, Ryo ;
Takahashi, Kazushi ;
Oyama, Yoshihiro ;
Tatebe, Osamu .
2015 IEEE 21ST INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS (ICPADS), 2015, :344-353
[30]   Research of Cloud Storage Based on Hadoop Distributed File System [J].
Han, Yongqi ;
Zhang, Yun ;
Yu, Shui .
APPLIED SCIENCE, MATERIALS SCIENCE AND INFORMATION TECHNOLOGIES IN INDUSTRY, 2014, 513-517 :2472-2475