Programming languages for data-Intensive HPC applications: A systematic mapping study

被引:19
作者
Amaral, Vasco [1 ]
Norberto, Beatriz [1 ]
Goulao, Miguel [1 ]
Aldinucci, Marco [2 ]
Benkner, Siegfried [3 ]
Bracciali, Andrea [4 ]
Carreira, Paulo [5 ]
Celms, Edgars [6 ]
Correia, Luis [7 ]
Grelck, Clemens [8 ]
Karatza, Helen [9 ]
Kessler, Christoph [10 ]
Kilpatrick, Peter [11 ]
Martiniano, Hugo [7 ]
Mavridis, Ilias [9 ]
Pllana, Sabri [12 ]
Respicio, Ana [13 ]
Simao, Jose [14 ]
Veiga, Luis [5 ]
Visa, Ari [15 ]
机构
[1] Univ Nova Lisboa, Fac Ciencias & Tecnol, DI, NOVA LINCS, Lisbon, Portugal
[2] Univ Torino, Turin, Italy
[3] Univ Vienna, Vienna, Austria
[4] Univ Stirling, Stirling, Scotland
[5] Univ Lisbon, Inst Super Tecn, DEI, INESC ID, Lisbon, Portugal
[6] Univ Latvia, Inst Math & Comp Sci, Riga, Latvia
[7] Univ Lisbon, Fac Ciencias, BioISI, Lisbon, Portugal
[8] Univ Amsterdam, Amsterdam, Netherlands
[9] Aristotle Univ Thessaloniki, Thessaloniki, Greece
[10] Linkoping Univ, Linkoping, Sweden
[11] Queens Univ Belfast, Belfast, Antrim, North Ireland
[12] Linnaeus Univ, Vaxjo, Sweden
[13] Univ Lisbon, Fac Ciencias, LASIGE, Lisbon, Portugal
[14] Inst Politecn Lisboa, Inst Super Engn Lisboa, Lisbon, Portugal
[15] Tampere Univ, Tampere, Finland
关键词
High performance computing (HPC); Big data; Data-intensive applications; Programming languages; Domain-Specific language (DSL); General-Purpose language (GPL); Systematic mapping study (SMS); DOMAIN-SPECIFIC LANGUAGES; PARALLEL; ANALYTICS; MULTI; EFFICIENT; MODEL;
D O I
10.1016/j.parco.2019.102584
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
A major challenge in modelling and simulation is the need to combine expertise in both software technologies and a given scientific domain. When High-Performance Computing (HPC) is required to solve a scientific problem, software development becomes a problematic issue. Considering the complexity of the software for HPC, it is useful to identify programming languages that can be used to alleviate this issue. Because the existing literature on the topic of HPC is very dispersed, we performed a Systematic Mapping Study (SMS) in the context of the European COST Action cHiPSet. This literature study maps characteristics of various programming languages for data-intensive HPC applications, including category, typical user profiles, effectiveness, and type of articles. We organised the SMS in two phases. In the first phase, relevant articles are identified employing an automated keyword-based search in eight digital libraries. This lead to an initial sample of 420 papers, which was then narrowed down in a second phase by human inspection of article abstracts, titles and keywords to 152 relevant articles published in the period 2006-2018. The analysis of these articles enabled us to identify 26 programming languages referred to in 33 of relevant articles. We compared the outcome of the mapping study with results of our questionnaire-based survey that involved 57 HPC experts. The mapping study and the survey revealed that the desired features of programming languages for data-intensive HPC applications are portability, performance and usability. Furthermore, we observed that the majority of the programming languages used in the context of data-intensive HPC applications are text-based general-purpose programming languages. Typically these have a steep learning curve, which makes them difficult to adopt. We believe that the outcome of this study will inspire future research and development in programming languages for data-intensive HPC applications. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页数:17
相关论文
共 67 条
  • [1] Preparing HPC Applications for Exascale: Challenges and Recommendations
    Abraham, Erika
    Bekas, Costas
    Brandic, Ivona
    Genaim, Samir
    Johnsen, Einar Broch
    Kondov, Ivan
    Pllana, Sabri
    Streit, Achim
    [J]. PROCEEDINGS 2015 18TH INTERNATIONAL CONFERENCE ON NETWORK-BASED INFORMATION SYSTEMS (NBIS 2015), 2015, : 401 - 406
  • [2] [Anonymous], [No title captured]
  • [3] [Anonymous], [No title captured]
  • [4] [Anonymous], [No title captured]
  • [5] [Anonymous], [No title captured]
  • [6] [Anonymous], [No title captured]
  • [7] COMP Superscalar, an interoperable programming framework
    Badia, Rosa M.
    Conejero, Javier
    Diaz, Carlos
    Ejarque, Jorge
    Lezzi, Daniele
    Lordan, Francesc
    Ramon-Cortes, Cristian
    Sirvent, Raul
    [J]. SoftwareX, 2015, 3-4 : 32 - 36
  • [8] MUSCLE-HPC: A new high performance API to couple multiscale parallel applications
    Ben Belgacem, Mohamed
    Chopard, Bastien
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2017, 67 : 72 - 82
  • [9] PEPPHER: EFFICIENT AND PRODUCTIVE USAGE OF HYBRID COMPUTING SYSTEMS
    Benkner, Siegfried
    Pllana, Sabri
    Traeff, Jesper Larsson
    Tsigas, Philippas
    Dolinsky, Uwe
    Augonnet, Cedric
    Bachmayer, Beverly
    Kessler, Christoph
    Moloney, David
    Osipov, Vitaly
    [J]. IEEE MICRO, 2011, 31 (05) : 28 - 41
  • [10] Brown B., 2011, Are you ready for the era of "big data"?, V4, P24