Virtualized HPC: a contradiction in terms?

被引:7
|
作者
Birkenheuer, Georg [1 ]
Brinkmann, Andre [1 ]
Kaiser, Juergen [1 ]
Keller, Axel [1 ]
Keller, Matthias [1 ]
Kleineweber, Christoph [1 ]
Konersmann, Christoph [1 ]
Niehoerster, Oliver [1 ]
Schaefer, Thorsten [1 ]
Simon, Jens [1 ]
Wilhelm, Maximilian [1 ]
机构
[1] Paderborn Ctr Parallel Comp, D-33102 Paderborn, Germany
关键词
virtualization; HPC; cloud; scheduling;
D O I
10.1002/spe.1055
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
System virtualization has become the enabling technology to manage the increasing number of different applications inside data centers. The abstraction from the underlying hardware and the provision of multiple virtual machines (VM) on a single physical server have led to a consolidation and more efficient usage of physical servers. The abstraction from the hardware also eases the provision of applications on different data centers, as applied in several cloud computing environments. In this case, the application need not adapt to the environment of the cloud computing provider, but can travel around with its own VM image, including its own operating system and libraries. System virtualization and cloud computing could also be very attractive in the context of high-performance computing (HPC). Today, HPC centers have to cope with both, the management of the infrastructure and also the applications. Virtualization technology would enable these centers to focus on the infrastructure, while the users, collaborating inside their virtual organizations (VOs), would be able to provide the software. Nevertheless, there seems to be a contradiction between HPC and cloud computing, as there are very few successful approaches to virtualize HPC centers. This work discusses the underlying reasons, including the management and performance, and presents solutions to overcome the contradiction, including a set of new libraries. The viability of the presented approach is shown based on evaluating a selected parallel, scientific application in a virtualized HPC environment. Copyright (c) 2011 John Wiley & Sons, Ltd.
引用
收藏
页码:485 / 500
页数:16
相关论文
共 50 条
  • [1] Enhance Virtualized HPC System Based on I/O Behavior Perception and Asymmetric Scheduling
    Hu, Yanyan
    Long, Xiang
    Zhang, Jiong
    2012 IEEE 14TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS & 2012 IEEE 9TH INTERNATIONAL CONFERENCE ON EMBEDDED SOFTWARE AND SYSTEMS (HPCC-ICESS), 2012, : 169 - 178
  • [2] Zeroing memory deallocator to reduce checkpoint sizes in virtualized HPC environments
    Ramy Gad
    Simon Pickartz
    Tim Süß
    Lars Nagel
    Stefan Lankes
    Antonello Monti
    André Brinkmann
    The Journal of Supercomputing, 2018, 74 : 6236 - 6257
  • [3] Zeroing memory deallocator to reduce checkpoint sizes in virtualized HPC environments
    Gad, Ramy
    Pickartz, Simon
    Suss, Tim
    Nagel, Lars
    Lankes, Stefan
    Monti, Antonello
    Brinkmann, Andre
    JOURNAL OF SUPERCOMPUTING, 2018, 74 (11) : 6236 - 6257
  • [4] A fault-tolerant strategy for virtualized HPC clusters
    Walters, John Paul
    Chaudhary, Vipin
    JOURNAL OF SUPERCOMPUTING, 2009, 50 (03) : 209 - 239
  • [5] Analysis and Simulation of HPC Applications in Virtualized Data Centers
    Takouna, Ibrahim
    Dawoud, Wesam
    Meinel, Christoph
    2012 IEEE INTERNATIONAL CONFERENCE ON GREEN COMPUTING AND COMMUNICATIONS, CONFERENCE ON INTERNET OF THINGS, AND CONFERENCE ON CYBER, PHYSICAL AND SOCIAL COMPUTING (GREENCOM 2012), 2012, : 498 - 507
  • [6] A fault-tolerant strategy for virtualized HPC clusters
    John Paul Walters
    Vipin Chaudhary
    The Journal of Supercomputing, 2009, 50 : 209 - 239
  • [7] Exploiting Analytics Shipping with Virtualized MapReduce on HPC Backend Storage Servers
    Xu, Cong
    Goldstone, Robin
    Liu, Zhuo
    Chen, Hui
    Neitzel, Bryon
    Yu, Weikuan
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2016, 27 (01) : 185 - 196
  • [8] Performance Analysis of Virtualized Environments using HPC Challenge Benchmark Suite and Analytic Hierarchy Process
    Bakhshayeshi, Reza
    Akbari, Mohammad Kazem
    Javan, Morteza Sargolzaei
    2014 IRANIAN CONFERENCE ON INTELLIGENT SYSTEMS (ICIS), 2014,
  • [9] Energy-Efficient Thermal-Aware Autonomic Management of Virtualized HPC Cloud Infrastructure
    Ivan Rodero
    Hariharasudhan Viswanathan
    Eun Kyung Lee
    Marc Gamell
    Dario Pompili
    Manish Parashar
    Journal of Grid Computing, 2012, 10 : 447 - 473
  • [10] Energy-Efficient Thermal-Aware Autonomic Management of Virtualized HPC Cloud Infrastructure
    Rodero, Ivan
    Viswanathan, Hariharasudhan
    Lee, Eun Kyung
    Gamell, Marc
    Pompili, Dario
    Parashar, Manish
    JOURNAL OF GRID COMPUTING, 2012, 10 (03) : 447 - 473