A novel disk I/O scheduling framework of virtualized storage system

被引:1
|
作者
Dingding Li
Mianxiong Dong
Yong Tang
Kaoru Ota
机构
[1] South China Normal University,School of Computer Science
[2] Muroran Institute of Technology,Department of Information and Electronic Engineering
来源
Cluster Computing | 2019年 / 22卷
关键词
Big data; Virtual machine; Disk I/O scheduling;
D O I
暂无
中图分类号
学科分类号
摘要
Modern data centers usually use virtual machine technology to host various big data applications in a single physical machine, not only enhancing the server utilization, but also providing them with the hardware-level isolation. However, in a typical virtualized environment an extra software layer called virtual machine monitor (VMM) is often interposed between the hardware resource and guest operating system (virtual machine, VM), shielding the specific user-process semantic inside a running VM. As a result, it obstructs the disk I/O scheduler of VMM to acquire the accurate information of a user-process (often a big data application), and thus proposes a challenge on the I/O request scheduling as well as the disk resource management at the granularity of VM user-process. Eventually, the disk I/O performance of a virtualized system is sub-optimal. This paper introduces an improved disk I/O scheduling framework for the virtualized system. It aims at bridging the semantic gap between physical disk I/O scheduler and VM user-process, providing a fair sharing of disk I/O resource among concurrent VMs. At the same time, it improves the overall disk I/O performance through a novel method for creating the image file of VM. Besides, an extra scheduling algorithm is proposed to further refine the storage performance. Finally, we implement these improvements on Xen hypervisor and conduct extensive experiments to verify our framework. The experimental result shows that our work improve the performance of read-intensive, write-intensive and mixed workloads up to 9, 10.7 and 20% respectively.
引用
收藏
页码:2395 / 2405
页数:10
相关论文
共 50 条
  • [21] Flubber: Two-level disk scheduling in virtualized environment
    Jin, Hai
    Ling, Xiao
    Ibrahim, Shadi
    Cao, Wenzhi
    Wu, Song
    Antoniu, Gabriel
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2013, 29 (08): : 2222 - 2238
  • [22] DISK I/O SCHEDULING AND COMMUNICATION I/O SCHEMES FOR MULTIMEDIA SERVER HYPERMS
    MISAWA, K
    TSUJISAWA, T
    SUGIMOTO, K
    KITAMURA, H
    SHIMOJI, M
    HONDA, A
    NAKASHIMA, S
    NEC RESEARCH & DEVELOPMENT, 1995, 36 (03): : 417 - 428
  • [23] Alleviation of Disk I/O Contention in Virtualized Settings for Data-Intensive Computing
    Malensek, Matthew
    Pallickara, Sangmi Lee
    Pallickara, Shrideep
    2015 IEEE/ACM 2ND INTERNATIONAL SYMPOSIUM ON BIG DATA COMPUTING (BDC), 2015, : 1 - 10
  • [24] qSDS: A QoS-Aware I/O Scheduling Framework towards Software Defined Storage
    Wang, Jianzong
    Cheng, Lianglun
    ELEVENTH 2015 ACM/IEEE SYMPOSIUM ON ARCHITECTURES FOR NETWORKING AND COMMUNICATIONS SYSTEMS, 2015, : 195 - 196
  • [25] Automated Modeling of I/O Performance and Interference Effects in Virtualized Storage Systems
    Noorshams, Qais
    Busch, Axel
    Rentschler, Andreas
    Bruhn, Dominik
    Kounev, Samuel
    Tuma, Petr
    Reussner, Ralf
    2014 IEEE 34TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS WORKSHOPS (ICDCSW), 2014, : 88 - 93
  • [26] Disk I/O mixed scheduling strategy for VoD servers
    Jin, H
    Xu, J
    Tu, BB
    Li, SL
    PROCEEDINGS OF THE 2003 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOL II: COMMUNICATIONS-MULTIMEDIA SYSTEMS & APPLICATIONS, 2003, : 504 - 507
  • [27] Burstiness-aware I/O Scheduler for MapReduce Framework on Virtualized Environments
    Kim, Sewoog
    Kang, Dongwoo
    Choi, Jongmoo
    Kim, Junmo
    2014 INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING (BIGCOMP), 2014, : 305 - 308
  • [28] DRIVE: Using Implicit Caching Hints to achieve Disk I/O Reduction in Virtualized Environments
    Sudevalayam, Sujesha
    Kulkarni, Purushottam
    Balani, Rahul
    Verma, Akshat
    2014 21ST INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING (HIPC), 2014,
  • [29] Multi-parallel pipelining I/O scheduling and practice in network storage system
    Zeng, Lingfang
    Feng, Dan
    Wang, Fang
    Tian, Lei
    Shi, Zhan
    DYNAMICS OF CONTINUOUS DISCRETE AND IMPULSIVE SYSTEMS-SERIES B-APPLICATIONS & ALGORITHMS, 2006, 13E : 1921 - 1926
  • [30] Triple-L: Improving CPS Disk I/O Performance in a Virtualized NAS Environment
    Li, Dingding
    Dong, Mianxiong
    Tang, Yong
    Yang, Laurence T.
    Ota, Kaoru
    Zhao, Gansen
    IEEE SYSTEMS JOURNAL, 2017, 11 (01): : 152 - 162