Virtualized HPC: a contradiction in terms?

被引:7
|
作者
Birkenheuer, Georg [1 ]
Brinkmann, Andre [1 ]
Kaiser, Juergen [1 ]
Keller, Axel [1 ]
Keller, Matthias [1 ]
Kleineweber, Christoph [1 ]
Konersmann, Christoph [1 ]
Niehoerster, Oliver [1 ]
Schaefer, Thorsten [1 ]
Simon, Jens [1 ]
Wilhelm, Maximilian [1 ]
机构
[1] Paderborn Ctr Parallel Comp, D-33102 Paderborn, Germany
关键词
virtualization; HPC; cloud; scheduling;
D O I
10.1002/spe.1055
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
System virtualization has become the enabling technology to manage the increasing number of different applications inside data centers. The abstraction from the underlying hardware and the provision of multiple virtual machines (VM) on a single physical server have led to a consolidation and more efficient usage of physical servers. The abstraction from the hardware also eases the provision of applications on different data centers, as applied in several cloud computing environments. In this case, the application need not adapt to the environment of the cloud computing provider, but can travel around with its own VM image, including its own operating system and libraries. System virtualization and cloud computing could also be very attractive in the context of high-performance computing (HPC). Today, HPC centers have to cope with both, the management of the infrastructure and also the applications. Virtualization technology would enable these centers to focus on the infrastructure, while the users, collaborating inside their virtual organizations (VOs), would be able to provide the software. Nevertheless, there seems to be a contradiction between HPC and cloud computing, as there are very few successful approaches to virtualize HPC centers. This work discusses the underlying reasons, including the management and performance, and presents solutions to overcome the contradiction, including a set of new libraries. The viability of the presented approach is shown based on evaluating a selected parallel, scientific application in a virtualized HPC environment. Copyright (c) 2011 John Wiley & Sons, Ltd.
引用
收藏
页码:485 / 500
页数:16
相关论文
共 50 条
  • [41] Quantifying Performance Determinism in Virtualized Mixed-Criticality Systems
    Hughes, Andrew
    Awad, Amro
    2019 IEEE 22ND INTERNATIONAL SYMPOSIUM ON REAL-TIME DISTRIBUTED COMPUTING (ISORC 2019), 2019, : 181 - 184
  • [42] I/O-intensive Scheduling in Multiprocessor Virtualized System
    Mao, Haoxiang
    Huang, Bindi
    2014 INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND INTERNET OF THINGS (CCIOT), 2014, : 49 - 52
  • [43] Possibility of HPC application on Cloud infrastructure by container cluster
    Cho, Kyunam
    Lee, Hyunseok
    Bang, Kideuk
    Kim, Sungsoo
    2019 22ND IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND ENGINEERING (IEEE CSE 2019) AND 17TH IEEE INTERNATIONAL CONFERENCE ON EMBEDDED AND UBIQUITOUS COMPUTING (IEEE EUC 2019), 2019, : 263 - 268
  • [44] HPC-Aware VM Placement in Infrastructure Clouds
    Gupta, Abhishek
    Kale, Laxmikant V.
    Milojicic, Dejan
    Faraboschi, Paolo
    Balle, Susanne M.
    PROCEEDINGS OF THE 2013 IEEE INTERNATIONAL CONFERENCE ON CLOUD ENGINEERING (IC2E 2013), 2013, : 11 - 20
  • [45] An Architecture for Virtualized Home Gateways
    Cruz, Tiago
    Simoes, Paulo
    Reis, Nuno
    Monteiro, Edmundo
    Bastos, Fernando
    Laranjeira, Alexandre
    2013 IFIP/IEEE INTERNATIONAL SYMPOSIUM ON INTEGRATED NETWORK MANAGEMENT (IM 2013), 2013, : 520 - 526
  • [46] Optimizing a Virtualized Data Center
    Erickson, David
    Heller, Brandon
    Yang, Shuang
    Chu, Jonathan
    Ellithorpe, Jonathan
    McKeown, Nick
    Parulkar, Guru
    Rosenblum, Mendel
    Whyte, Scott
    Stuart, Stephen
    ACM SIGCOMM COMPUTER COMMUNICATION REVIEW, 2011, 41 (04) : 478 - 479
  • [47] Architectures for Cloud-based HPC in Data Centers
    Dao Manh Phan Hung
    Naidu, Sunil Manyam Seshadri
    Agyeman, Michael Opoku
    2017 IEEE 2ND INTERNATIONAL CONFERENCE ON BIG DATA ANALYSIS (ICBDA), 2017, : 143 - 148
  • [48] Deciding When and How to Move HPC Jobs to the Cloud
    Netto, Marco A. S.
    Cunha, Renato L. F.
    Sultanum, Nicole
    COMPUTER, 2015, 48 (11) : 86 - 89
  • [49] Kub: Enabling Elastic HPC Workloads on Containerized Environments
    Medeiros, Daniel
    Wahlgren, Jacob
    Schieffer, Gabin
    Peng, Ivy
    2023 IEEE 35TH INTERNATIONAL SYMPOSIUM ON COMPUTER ARCHITECTURE AND HIGH PERFORMANCE COMPUTING, SBAC-PAD, 2023, : 219 - 229
  • [50] Scheduling Distributed I/O Resources in HPC Systems
    Bandet, Alexis
    Boito, Francieli
    Pallez, Guillaume
    EURO-PAR 2024: PARALLEL PROCESSING, PT I, EURO-PAR 2024, 2024, 14801 : 137 - 151