A Novel Metadata Management Architecture Based on Service Separation in Cluster File System

被引：0
|
作者：
Zhang, Junwei [1 ]
Zhang, Jingliang [1 ]
Zhang, Jiangang [1 ]
Han, Xiaoming [1 ]
Xu, Lu [1 ]
机构：
[1] Chinese Acad Sci, Inst Comp Technol, Beijing 100190, Peoples R China
来源：
2009 INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED COMPUTING, APPLICATIONS AND TECHNOLOGIES (PDCAT 2009) | 2009年
关键词：
metadata management; service separation; cluster file system;
D O I：
暂无
中图分类号：
TP3 [计算技术、计算机技术];
学科分类号：
0812 ;
摘要：
Efficient metadata management is critical in large scale cluster file systems. Based on service separation idea, a novel metadata management architecture is presented in this paper to improve metadata access performance and scalability. Storage management is completely separated from namespace and data services. A storage management server cluster singly deals with storage management. To further reduce metadata server loads, parts of file attributes are also separated from metadata server to storage management server cluster. A prototype system has been designed and implemented, and tests have also been done. Measured performance results are very promising. The performance improvement is nearly linear as storage management server number increasing.
引用
收藏
页码：110 / 115
页数：6
相关论文
共 18 条
  • [1] Metadata management of the SANtopia file system
    Lee, YK
    Kim, SW
    Kim, GB
    Shin, BJ
    PROCEEDINGS OF THE EIGHTH INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS, 2001, : 492 - 499
  • [2] Metadata Namespace Management of Distributed File System
    Luo, Baoshan
    Zhang, Xinyan
    Tan, Zhipeng
    14TH INTERNATIONAL SYMPOSIUM ON DISTRIBUTED COMPUTING AND APPLICATIONS FOR BUSINESS, ENGINEERING AND SCIENCE (DCABES 2015), 2015, : 21 - 25
  • [3] Effective metadata management in exascale file system
    Cha, Myung-Hoon
    Lee, Sang-Min
    Kim, Hong-Yeon
    Kim, Young-Kyun
    JOURNAL OF SUPERCOMPUTING, 2019, 75 (11) : 7665 - 7689
  • [4] Effective metadata management in exascale file system
    Myung-Hoon Cha
    Sang-Min Lee
    Hong-Yeon Kim
    Young-Kyun Kim
    The Journal of Supercomputing, 2019, 75 : 7665 - 7689
  • [5] Memory based metadata server for cluster file systems
    Xing, Jing
    Xiong, Jin
    Ma, Jie
    Sun, Ninghui
    GCC 2008: SEVENTH INTERNATIONAL CONFERENCE ON GRID AND COOPERATIVE COMPUTING, PROCEEDINGS, 2008, : 287 - +
  • [6] QMDS: a file system metadata management service supporting a graph data model-based query language
    Ames, Sasha
    Gokhale, Maya
    Maltzahn, Carlos
    INTERNATIONAL JOURNAL OF PARALLEL EMERGENT AND DISTRIBUTED SYSTEMS, 2013, 28 (02) : 159 - 183
  • [7] Adaptive Load Balancing Strategy for File-System Metadata Service
    She C.-Y.
    Wen W.-S.
    Xiao Y.
    Liu Y.-B.
    Jia Y.
    Wen, Wu-Shao (wenwsh@mail.sysu.edu.cn), 1952, Chinese Academy of Sciences (28): : 1952 - 1967
  • [8] Metadata Management and Harvesting System in Smart Open Data As a Service
    Nguyen, Minh Chau
    Won, Heesun
    Son, Siwoon
    Woo, Yerin
    Jeong, Hyeonjae
    2022 24TH INTERNATIONAL CONFERENCE ON ADVANCED COMMUNICATION TECHNOLOGY (ICACT): ARITIFLCIAL INTELLIGENCE TECHNOLOGIES TOWARD CYBERSECURITY, 2022, : 272 - +
  • [9] CFS: Scaling Metadata Service for Distributed File System via Pruned Scope of Critical Sections
    Wang, Yiduo
    Wu, Yufei
    Li, Cheng
    Zheng, Pengfei
    Cao, Biao
    Sun, Yan
    Zhou, Fei
    Xu, Yinlong
    Wang, Yao
    Xie, Guangjun
    PROCEEDINGS OF THE EIGHTEENTH EUROPEAN CONFERENCE ON COMPUTER SYSTEMS, EUROSYS 2023, 2023, : 331 - 346
  • [10] An End-to-End Learning-Based Metadata Management Approach for Distributed File Systems
    Gao, Yuanning
    Gao, Xiaofeng
    Zhang, Ruisi
    Chen, Guihai
    IEEE TRANSACTIONS ON COMPUTERS, 2022, 71 (05) : 1021 - 1034
12