Storage Service Reliability and Availability Predictions of Hadoop Distributed File System

被引：0
|
作者：
Chattaraj, Durbadal [1 ]
Bhagat, Sumit [2 ]
Sarma, Monalisa [1 ]
机构：
[1] Indian Inst Technol Kharagpur, Subir Chowdhury Sch Qual & Reliabil, Kharagpur, W Bengal, India
[2] Tata Motors, Pune, Maharashtra, India
来源：
RELIABILITY, SAFETY AND HAZARD ASSESSMENT FOR RISK-BASED TECHNOLOGIES | 2020年
关键词：
Big data; Cloud storage; Dependability; Stochastic process; Stochastic petri nets; Quality of service;
D O I：
10.1007/978-981-13-9008-1_52
中图分类号：
TH [机械、仪表工业];
学科分类号：
0802 ;
摘要：
Hadoop is a de facto standard for Big Data storage and provides a complete arrangement of components for Big Data elaboration. Hadoop Distributed File System (HDFS), the fundamental module of Hadoop, has been evolved to deliver fault-tolerant data storage services in cloud. This work proposes a precise mathematical model of HDFS and estimates its data storage service availability and reliability. In this connection, a stochastic Petri net (SPN)-based dependability modelling strategy is adopted. In addition, a structural decomposition technique has been advocated to address the state space complexity of the saidmodel. The proposed model is useful to measure crucial quality of service parameters, namely storage service reliability and availability for emerging distributed data storage systems in the context of cloud.
引用
收藏
页码：617 / 626
页数：10
相关论文
共 50 条
  • [1] Research on reliability of hadoop distributed file system
    Hu, Daming
    Chen, Deyun
    Lou, Shuhui
    Pei, Shujun
    International Journal of Multimedia and Ubiquitous Engineering, 2015, 10 (11): : 315 - 326
  • [2] Research of Cloud Storage Based on Hadoop Distributed File System
    Han, Yongqi
    Zhang, Yun
    Yu, Shui
    APPLIED SCIENCE, MATERIALS SCIENCE AND INFORMATION TECHNOLOGIES IN INDUSTRY, 2014, 513-517 : 2472 - 2475
  • [3] The Hadoop Distributed File System
    Shvachko, Konstantin
    Kuang, Hairong
    Radia, Sanjay
    Chansler, Robert
    2010 IEEE 26TH SYMPOSIUM ON MASS STORAGE SYSTEMS AND TECHNOLOGIES (MSST), 2010,
  • [4] Enhancing UNICORE Storage Management Using Hadoop Distributed File System
    Bari, Wasim
    Memon, Ahmed Shiraz
    Schuller, Bernd
    EURO-PAR 2009 PARALLEL PROCESSING WORKSHOPS, 2010, 6043 : 345 - +
  • [5] Hadoop Distributed File System for the Grid
    Attebury, Garhan
    Baranovski, Andrew
    Bloom, Ken
    Bockelman, Brian
    Kcira, Dorian
    Letts, James
    Levshina, Tanya
    Lundestedt, Carl
    Martin, Terrence
    Maier, Will
    Pi, Haifeng
    Rana, Abhishek
    Sfiligoi, Igor
    Sim, Alexander
    Thomas, Michael
    Wuerthwein, Frank
    2009 IEEE NUCLEAR SCIENCE SYMPOSIUM CONFERENCE RECORD, VOLS 1-5, 2009, : 1056 - +
  • [6] Research on Distributed File System with Hadoop
    Xu, JunWu
    Liang, JunLing
    NETWORK COMPUTING AND INFORMATION SECURITY, 2012, 345 : 148 - +
  • [7] The Evolution of the Hadoop Distributed File System
    Maneas, Stathis
    Schroeder, Bianca
    2018 32ND INTERNATIONAL CONFERENCE ON ADVANCED INFORMATION NETWORKING AND APPLICATIONS WORKSHOPS (WAINA), 2018, : 67 - 74
  • [8] Enabling Prioritized Cloud I/O Service in Hadoop Distributed File System
    Yeh, Tsozen
    Sun, Yifeng
    2014 IEEE INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS, 2014 IEEE 6TH INTL SYMP ON CYBERSPACE SAFETY AND SECURITY, 2014 IEEE 11TH INTL CONF ON EMBEDDED SOFTWARE AND SYST (HPCC,CSS,ICESS), 2014, : 256 - 259
  • [9] Enabling Top-N File Retrieval In Cloud Storage Using Hadoop Distributed File System
    Jeya, Jospin J.
    Kannan, E.
    2016 Second International Conference on Science Technology Engineering and Management (ICONSTEM), 2016, : 168 - 171
  • [10] The Reliability Design and Availability Analysis of a Distributed Storage System
    YANG Xiaohui
    Wuhan University Journal of Natural Sciences, 2006, (06) : 1919 - 1922
12345