A novel disk I/O scheduling framework of virtualized storage system

被引:1
|
作者
Dingding Li
Mianxiong Dong
Yong Tang
Kaoru Ota
机构
[1] South China Normal University,School of Computer Science
[2] Muroran Institute of Technology,Department of Information and Electronic Engineering
来源
Cluster Computing | 2019年 / 22卷
关键词
Big data; Virtual machine; Disk I/O scheduling;
D O I
暂无
中图分类号
学科分类号
摘要
Modern data centers usually use virtual machine technology to host various big data applications in a single physical machine, not only enhancing the server utilization, but also providing them with the hardware-level isolation. However, in a typical virtualized environment an extra software layer called virtual machine monitor (VMM) is often interposed between the hardware resource and guest operating system (virtual machine, VM), shielding the specific user-process semantic inside a running VM. As a result, it obstructs the disk I/O scheduler of VMM to acquire the accurate information of a user-process (often a big data application), and thus proposes a challenge on the I/O request scheduling as well as the disk resource management at the granularity of VM user-process. Eventually, the disk I/O performance of a virtualized system is sub-optimal. This paper introduces an improved disk I/O scheduling framework for the virtualized system. It aims at bridging the semantic gap between physical disk I/O scheduler and VM user-process, providing a fair sharing of disk I/O resource among concurrent VMs. At the same time, it improves the overall disk I/O performance through a novel method for creating the image file of VM. Besides, an extra scheduling algorithm is proposed to further refine the storage performance. Finally, we implement these improvements on Xen hypervisor and conduct extensive experiments to verify our framework. The experimental result shows that our work improve the performance of read-intensive, write-intensive and mixed workloads up to 9, 10.7 and 20% respectively.
引用
收藏
页码:2395 / 2405
页数:10
相关论文
共 50 条
  • [41] DFS: A File System for Virtualized Flash Storage
    Josephson, William K.
    Bongo, Lars A.
    Li, Kai
    Flynn, David
    ACM TRANSACTIONS ON STORAGE, 2010, 6 (03)
  • [42] A Novel Architecture of Scheduling System for Big Data Framework
    Dong, Xiaocen
    Lin, Rongheng
    Zou, Hua
    2018 IEEE 18TH INTERNATIONAL CONFERENCE ON COMMUNICATION TECHNOLOGY (ICCT), 2018, : 1329 - 1334
  • [43] A high resolution disk I/O trace system
    Huang, Tao
    Xu, Teng
    Lu, Xianliang
    Operating Systems Review (ACM), 2001, 35 (04): : 82 - 87
  • [44] A Pruning-Based Disk Scheduling Algorithm for Heterogeneous I/O Workloads
    Kim, Taeseok
    Bahn, Hyokyung
    Won, Youjip
    SCIENTIFIC WORLD JOURNAL, 2014,
  • [45] CPS: A Cooperative Para-virtualized Scheduling Framework for Manycore Machines
    Liu, Yuxuan
    Xu, Tianqiang
    Mi, Zeyu
    Hua, Zhichao
    Zang, Binyu
    Chen, Haibo
    PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON ARCHITECTURAL SUPPORT FOR PROGRAMMING LANGUAGES AND OPERATING SYSTEMS, ASPLOS 2023, VOL 4, 2023, : 43 - 56
  • [46] Preserving I/O Prioritization in Virtualized OSes
    Suo, Kun
    Zhao, Yong
    Rao, Jia
    Cheng, Luwei
    Zhou, Xiaobo
    Lau, Francis C. M.
    PROCEEDINGS OF THE 2017 SYMPOSIUM ON CLOUD COMPUTING (SOCC '17), 2017, : 269 - 281
  • [47] NUMA Aware I/O in Virtualized Systems
    Banerjee, Amitabha
    Mehta, Rishi
    Shen, Zach
    PROCEEDINGS 2015 IEEE 23RD ANNUAL SYMPOSIUM ON HIGH-PERFORMANCE INTERCONNECTS - HOTI 2015, 2015, : 10 - 17
  • [48] Block I/O Scheduling on Storage Servers of Distributed File Systems
    Liao, Jianwei
    Yin, Dong
    Peng, Xiaoning
    JOURNAL OF GRID COMPUTING, 2018, 16 (02) : 299 - 316
  • [49] Block I/O Scheduling on Storage Servers of Distributed File Systems
    Jianwei Liao
    Dong Yin
    Xiaoning Peng
    Journal of Grid Computing, 2018, 16 : 299 - 316
  • [50] New architectures and I/O scheduling methods for scalable storage products
    Raskovic, D
    Milutinovic, V
    1997 INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS, PROCEEDINGS, 1997, : 14 - 19