Efficient data storage: adaptively changing chunk size in cloud computing storage systems

被引:0
|
作者
Baya, Chalabi [1 ]
Yahya, Slimani [2 ]
机构
[1] Ecole Natl Super Informat ESI, Lab Commun Syst Informat, 68M Oued Smar, Algiers 16270, Algeria
[2] Univ Manouba, ISAMM, Manouba, Tunisia
关键词
cloud computing; data striping; data management system; data storage; BlobSeer; chunk size; Hadoop; big data; scalability; concurrent access;
D O I
10.1504/IJGUC.2023.133455
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Cloud computing enables users to utilise a shared pool of resources on demand. BLOB storage is a type of cloud storage for unstructured data. Most data management systems use chunk sizes equal to a given BLOB. Despite the simplicity of this strategy, as the nodes in the system are heterogeneous, the BLOB sizes are different and access to the data is not consistent due to these issues. We propose an adaptive strategy in order to define an adequate chunk size by taking into account metrics concerning the actual resources (bandwidth, storage usage), the size of the BLOB/file and the access rate of the chunks. Our experimental results show that our proposed approach provides an execution time that is about 24% better than that of a method based only on one chunk size and about 96% better than that of a method based on a random choice of the chunk size.
引用
收藏
页码:516 / 525
页数:11
相关论文
共 50 条
  • [41] Storage Cost efficient approach for Cloud storage and Intermediate Data Sets in Clouds
    Khare, Mayank Deep
    Tripathi, Aditi
    Singh, Pradeep Kumar
    2015 INTERNATIONAL CONFERENCE ON GREEN COMPUTING AND INTERNET OF THINGS (ICGCIOT), 2015, : 1475 - 1480
  • [42] An efficient secure Internet of things data storage auditing protocol with adjustable parameter in cloud computing
    Liu, Meng
    Wang, Xuan
    Yang, Chi
    Jiang, Zoe Lin
    Li, Ye
    INTERNATIONAL JOURNAL OF DISTRIBUTED SENSOR NETWORKS, 2017, 13 (01):
  • [43] An Efficient and Secured Data Storage Scheme in Cloud Computing Using ECC-based PKI
    Yin, XiaoChun
    Liu, ZengGuang
    Lee, Hoon Jae
    2014 16TH INTERNATIONAL CONFERENCE ON ADVANCED COMMUNICATION TECHNOLOGY (ICACT), 2014, : 523 - 527
  • [44] Research of Provenance Storage in Cloud Computing Environment
    Luo, Zhangxuan
    Xu, Guoyan
    2014 IEEE 13TH INTERNATIONAL CONFERENCE ON TRUST, SECURITY AND PRIVACY IN COMPUTING AND COMMUNICATIONS (TRUSTCOM), 2014, : 660 - 664
  • [45] Construction of Social Network Big Data Storage Model Under Cloud Computing
    Jin, Zihui
    Chen, Ting
    ADVANCED HYBRID INFORMATION PROCESSING, ADHIP 2022, PT I, 2023, 468 : 205 - 216
  • [46] Intelligent cryptography approach for secure distributed big data storage in cloud computing
    Li, Yibin
    Gai, Keke
    Qiu, Longfei
    Qiu, Meikang
    Zhao, Hui
    INFORMATION SCIENCES, 2017, 387 : 103 - 115
  • [47] An Authorized Public Auditing Scheme for Dynamic Big Data Storage in Cloud Computing
    Yu, Han
    Lu, Xiuqing
    Pan, Zhenkuan
    IEEE ACCESS, 2020, 8 (08): : 151465 - 151473
  • [48] Design of Big Data Compatible Storage System Based on Cloud Computing Environment
    Zhou, Min
    Li, Jiaqi
    Ye, Jun
    PROCEEDINGS OF THE 39TH CHINESE CONTROL CONFERENCE, 2020, : 3158 - 3161
  • [49] Data deduplication techniques for efficient cloud storage management: a systematic review
    Kaur, Ravneet
    Chana, Inderveer
    Bhattacharya, Jhilik
    JOURNAL OF SUPERCOMPUTING, 2018, 74 (05): : 2035 - 2085
  • [50] An Efficient Storage Service Method for Multidimensional Meteorological Data in Cloud Environment
    Yang, Ming
    He, Wenchun
    Zhang, Zhiqiang
    Xu, Yongjun
    Chen, Yufeng
    Xu, Xiaolong
    2019 INTERNATIONAL CONFERENCE ON INTERNET OF THINGS (ITHINGS) AND IEEE GREEN COMPUTING AND COMMUNICATIONS (GREENCOM) AND IEEE CYBER, PHYSICAL AND SOCIAL COMPUTING (CPSCOM) AND IEEE SMART DATA (SMARTDATA), 2019, : 495 - 500