Impact of Metadata Server on a Large Scale File System

被引：0

作者：

Patgiri, Ripon ^{[1
]}

Nayak, Sabuzima ^{[1
]}

Borgohain, Samir Kumar ^{[1
]}

机构：

[1] Natl Inst Technol Silchar, Dept Comp Sci & Engn, Silchar 788010, Assam, India

来源：

2018 IEEE COLOMBIAN CONFERENCE ON COMMUNICATIONS AND COMPUTING (COLCOM) | 2018年

关键词：

Metadata; Metadata Server; Clustered Metadata Server; Distributed Metadata Server; File System; Issues and Challenges; Big Data; Cluster Computing; Distributed System; Trade-off of Metadata Server; MDS;

D O I：

暂无

中图分类号：

TM [电工技术]; TN [电子技术、通信技术];

学科分类号：

0808 ; 0809 ;

摘要：

Big Data, the most popular paradigm, consists of a huge set of data. Big Data storage is built using block-store, file system, object-store and/or hybrid of these systems, cohered with metadata. In this paper, we present role of the metadata server (MDS) in a file system for Big Data. The metadata is large in size for Big Data storage system, and therefore, a standalone metadata server (MDS) cannot hold entire metadata of the storage system. Thus, the metadata servers are augmented to form a clustered metadata server. Moreover, the clustered metadata server (MDS) defines the retrieval process of data from the clustered storage media. Besides, the clustered MDS defines the scalability of Big Data storage. In addition, the clustered MDS offers high efficiency and fast accessing of data in a large scale data storage. The size of Big Data is typically Petabytes to Exabytes. Therefore, there is a strong requirement of efficient and effective clustered MDS to define the access mechanism of Big Data storage. In this paper, we sketch the effect of MDS on very large scale file system.

引用

页数：6

共 50 条

[31] The Research and Implementation of Metadata Cache Backup Technology Based on CEPH File System
Zhan, Ling
Fang, Xieyun
Li, Duping
PROCEEDINGS OF 2016 IEEE INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND BIG DATA ANALYSIS (ICCCBDA 2016), 2016, : 72 - 77
[32] Accelerating File System Metadata Access with Byte-Addressable Nonvolatile Memory
Wei, Qingsong
Chen, Jianxi
Chen, Cheng
ACM TRANSACTIONS ON STORAGE, 2015, 11 (03)
[33] Research on the Metadata Storage Mode and Efficiency of Distributed File System Based on HGML
Miao Fang
Cheng Fu-chao
Yang Wen-hui
Tan Li
ADVANCES IN SCIENCE AND ENGINEERING, PTS 1 AND 2, 2011, 40-41 : 221 - 227
[34] File Creation Optimization for Metadata-Intensive Application in File Systems
Xiao, Limin
Zhong, Qiaoling
Huo, Zhisheng
Li, Ang
Ruan, Li
Liu, Kelong
Zang, Yuanyuan
Lu, Zheqi
ALGORITHMS AND ARCHITECTURES FOR PARALLEL PROCESSING, ICA3PP 2015, 2015, 9532 : 353 - 363
[35] Metadata Exploitation in Large-scale Data Migration Projects
Narayanan, Ram
Oberhofer, Martin
Pandit, Sushain
AMCIS 2012 PROCEEDINGS, 2012,
[36] Creating return on investment for large-scale metadata creation
Urberg M.
Information Services and Use, 2021, 41 (1-2) : 53 - 60
[37] Effective and Scalable Data Access Control in Onedata Large Scale Distributed Virtual File System
Wrzeszcz, Michal
Opiola, Lukasz
Zemek, Konrad
Kryza, Bartosz
Dutka, Lukasz
Slota, Renata
Kitowski, Jacek
INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE (ICCS 2017), 2017, 108 : 445 - 454
[38] Development of a Classification Server to Support Metadata Harmonization in a Long Term Preservation System
Kopacsi, Sandor
Preza, Jose Luis
Hudak, Rastislav
METADATA AND SEMANTICS RESEARCH, MTSR 2016, 2016, 672 : 262 - 277
[39] Facilitating the Efficiency of Secure File Data and Metadata Deletion on SMR-based Ext4 File System
Chen, Ping-Xiang
Chen, Shuo-Han
Chang, Yuan-Hao
Liang, Yu-Pei
Shih, Wei-Kuan
2021 26TH ASIA AND SOUTH PACIFIC DESIGN AUTOMATION CONFERENCE (ASP-DAC), 2021, : 728 - 733
[40] Design and Performance Evaluation of Read/Write Metadata Service Strategy for Large-Scale Storage System
Zhou, Gang
Cao, Qiang
Wu, Chentao
EIGHTH INTERNATIONAL SYMPOSIUM ON OPTICAL STORAGE AND 2008 INTERNATIONAL WORKSHOP ON INFORMATION DATA STORAGE, 2009, 7125

← 1 2 3 4 5 →