Virtualized HPC: a contradiction in terms?

被引:7
|
作者
Birkenheuer, Georg [1 ]
Brinkmann, Andre [1 ]
Kaiser, Juergen [1 ]
Keller, Axel [1 ]
Keller, Matthias [1 ]
Kleineweber, Christoph [1 ]
Konersmann, Christoph [1 ]
Niehoerster, Oliver [1 ]
Schaefer, Thorsten [1 ]
Simon, Jens [1 ]
Wilhelm, Maximilian [1 ]
机构
[1] Paderborn Ctr Parallel Comp, D-33102 Paderborn, Germany
关键词
virtualization; HPC; cloud; scheduling;
D O I
10.1002/spe.1055
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
System virtualization has become the enabling technology to manage the increasing number of different applications inside data centers. The abstraction from the underlying hardware and the provision of multiple virtual machines (VM) on a single physical server have led to a consolidation and more efficient usage of physical servers. The abstraction from the hardware also eases the provision of applications on different data centers, as applied in several cloud computing environments. In this case, the application need not adapt to the environment of the cloud computing provider, but can travel around with its own VM image, including its own operating system and libraries. System virtualization and cloud computing could also be very attractive in the context of high-performance computing (HPC). Today, HPC centers have to cope with both, the management of the infrastructure and also the applications. Virtualization technology would enable these centers to focus on the infrastructure, while the users, collaborating inside their virtual organizations (VOs), would be able to provide the software. Nevertheless, there seems to be a contradiction between HPC and cloud computing, as there are very few successful approaches to virtualize HPC centers. This work discusses the underlying reasons, including the management and performance, and presents solutions to overcome the contradiction, including a set of new libraries. The viability of the presented approach is shown based on evaluating a selected parallel, scientific application in a virtualized HPC environment. Copyright (c) 2011 John Wiley & Sons, Ltd.
引用
收藏
页码:485 / 500
页数:16
相关论文
共 50 条
  • [21] Towards Energy Budget Control in HPC
    Dutot, Pierre-Francois
    Georgiou, Yiannis
    Glesser, David
    Lefevre, Laurent
    Poquet, Millian
    Rais, Issam
    2017 17TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND GRID COMPUTING (CCGRID), 2017, : 381 - 390
  • [22] HPC in Weather Forecast: Moving to the Cloud
    Monteiro, Andre
    Teixeira, Claudio
    Pinto, Joaquim S.
    INTERNATIONAL JOURNAL OF CLOUD APPLICATIONS AND COMPUTING, 2015, 5 (01) : 14 - 31
  • [23] Tangram: Colocating HPC Applications with Oversubscription
    Xiong, Qingqing
    Ates, Emre
    Herbordt, Martin C.
    Coskun, Ayse K.
    2018 IEEE HIGH PERFORMANCE EXTREME COMPUTING CONFERENCE (HPEC), 2018,
  • [24] Aggressive Resource Provisioning for Ensuring QoS in Virtualized Environments
    Liu, Jinzhao
    Zhang, Yaoxue
    Zhou, Yuezhi
    Zhang, Di
    Liu, Hao
    IEEE TRANSACTIONS ON CLOUD COMPUTING, 2015, 3 (02) : 119 - 131
  • [25] Evolution of Attacks, Threat Models, and Solutions for Virtualized Systems
    Sgandurra, Daniele
    Lupu, Emil
    ACM COMPUTING SURVEYS, 2015, 48 (03)
  • [26] Enabling and Optimizing Pilot Jobs using Xen based Virtual Machines for the HPC Grid Applications
    Khalid, Omer
    Anthony, Richard
    Nilsson, Paul
    Keahey, Kate
    Schulz, Markus
    Parrott, Kevin
    Petridis, Miltos
    THIRD INTERNATIONAL WORKSHOP ON VIRTUALIZATION TECHNOLOGIES IN DISTRIBUTED COMPUTING (VTDC-09), 2009, : 1 - 8
  • [27] Harnessing Cloud Technologies for a Virtualized Distributed Computing Infrastructure
    di Costanzo, Alexandre
    de Assuncao, Marcos Dias
    Buyya, Rajkumar
    IEEE INTERNET COMPUTING, 2009, 13 (05) : 24 - 33
  • [28] Best Practices for HPC Workloads on Public Cloud Platforms A guide for computational scientists to use public cloud for HPC workloads
    Walkup, Robert
    Seelam, Seetharami R.
    Wen, Sophia
    PROCEEDINGS OF THE 2022 ACM/SPEC INTERNATIONAL CONFERENCE ON PERFORMANCE ENGINEERING (ICPE '22), 2022, : 29 - 35
  • [29] Recovery for Virtualized Environments
    Cerveira, Frederico
    Barbosa, Raul
    Madeira, Henrique
    Araujo, Filipe
    2015 ELEVENTH EUROPEAN DEPENDABLE COMPUTING CONFERENCE (EDCC), 2015, : 25 - 36
  • [30] Reservation-Based Overbooking for HPC Clusters
    Birkenheuer, Georg
    Brinkmann, Andre
    2011 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING (CLUSTER), 2011, : 537 - 541