Research on I/O resource scheduling algorithms for utility optimization towards cloud storage

被引:0
|
作者
Wang, Jianzong [1 ,2 ,3 ,4 ]
Chen, Yanjun [1 ,5 ]
Xie, Changsheng [1 ,2 ,3 ]
机构
[1] School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan 430074, China
[2] Wuhan National Laboratory for Optoelectronics, Wuhan 430074, China
[3] Key Laboratory of Data Storage System (Huazhong University of Science and Technology), Ministry of Education, Wuhan 430074, China
[4] NetEase Inc., Guangzhou 510665, China
[5] Georgia Institute of Technology, Atlanta, GA 30332, United States
来源
Jisuanji Yanjiu yu Fazhan/Computer Research and Development | 2013年 / 50卷 / 08期
关键词
Scheduling algorithms - Response time (computer systems) - Cloud storage;
D O I
暂无
中图分类号
学科分类号
摘要
Cloud-based services are emerging as an economical and convenient alternative for clients who don't want to acquire, maintain and operate their own IT equipment. Instead, customers purchase virtual machines (VMs) with certain service level objectives (SLOs) to obtain computational resources. Existing algorithms for memory and CPU allocation are inadequate for I/O allocation, especially in clustered storage infrastructures where storage is distributed across multiple storage nodes. This paper focuses on: 1) dynamic SLO decomposition so that VMs receive proper I/O service in each distributed storage node, and 2) efficient and robust local I/O scheduling strategy. To address these issues, we present an adaptive I/O resource scheduling algorithm (called PC) for utility optimization that at runtime adjusts local SLOs. The local SLOs are generated for each VM at each storage node based on access patterns. We also adopt dual clocks to allow automatic switching between two scheduling strategies. When system capacity is sufficient, we interweave requests in an earliest deadline first (EDF) manner. Otherwise resources are allocated proportionately to their normalized revenues. The results of our experiments suggest that the algorithm is adaptive to various access patterns without significant manual pre-settings while maximizing profits.
引用
收藏
页码:1657 / 1666
相关论文
共 50 条
  • [31] Online Optimization in Cloud Resource Provisioning: Predictions, Regrets, and Algorithms
    Comden, Joshua
    Yao, Sijie
    Chen, Niangjun
    Xing, Haipeng
    Liu, Zhenhua
    PROCEEDINGS OF THE ACM ON MEASUREMENT AND ANALYSIS OF COMPUTING SYSTEMS, 2019, 3 (01)
  • [32] Heuristic algorithms for I/O scheduling for efficient retrieval of large objects from tertiary storage
    Moon, C
    Kang, H
    PROCEEDINGS OF THE 12TH AUSTRALASIAN DATABASE CONFERENCE, ADC 2001, 2001, 23 (02): : 145 - 152
  • [33] Comparison of I/O Scheduling Algorithms for High Parallelism MEMS-Based Storage Devices
    Lee, Eunji
    Koh, Kern
    Choi, Hyunkyoung
    Bahn, Hyokyung
    SEPADS'09: PROCEEDINGS OF THE 8TH WSEAS INTERNATIONAL CONFERENCE ON RECENT ADVANCES IN SOFTWARE ENGINEERING, PARALLEL AND DISTRIBUTED SYSTEMS, 2009, : 150 - +
  • [34] Online Optimization in Cloud Resource Provisioning: Predictions, Regrets, and Algorithms
    Comden J.
    Yao S.
    Chen N.
    Xing H.
    Liu Z.
    Performance Evaluation Review, 2019, 47 (01): : 47 - 48
  • [35] Online Pricing and Resource Scheduling for Profit Maximization of Cloud Storage Providers
    Lee, Kyungtae
    Kim, Yeongjin
    IEEE TRANSACTIONS ON CLOUD COMPUTING, 2024, 12 (04) : 1186 - 1199
  • [36] The Research of Server Performance Optimization on Cloud Storage
    Song Jianjie
    PROCEEDING OF 2012 INTERNATIONAL SYMPOSIUM - EDUCATIONAL RESEARCH AND EDUCATIONAL TECHNOLOGY, 2012, : 127 - 130
  • [37] The Research on Resource Scheduling Based on Fuzzy Clustering in Cloud Computing
    Wang Xiaojun
    Wang Yun
    Hao Zhe
    Du Juan
    PROCEEDINGS OF 8TH INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTATION TECHNOLOGY AND AUTOMATION (ICICTA 2015), 2015, : 1025 - 1028
  • [38] Research on Unified Resource Management and Scheduling System in Cloud Environment
    Jiang, Hua
    Xiao, Yanli
    WIRELESS PERSONAL COMMUNICATIONS, 2018, 102 (02) : 963 - 973
  • [39] Research and Analysis of Resource Scheduling Algorithm in Cloud Computing Environment
    Bin, Li
    AGRO FOOD INDUSTRY HI-TECH, 2017, 28 (03): : 3192 - 3196
  • [40] Research on the Resource Joint Scheduling in Optical Networks for Cloud Computing
    Li Ming
    Zhang Yinfa
    Ren Shuai
    Wang Peng
    Wang Kun
    2014 7TH INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTATION TECHNOLOGY AND AUTOMATION (ICICTA), 2014, : 596 - 599