The AllScale Runtime Application Model

被引:7
作者
Jordan, Herbert [1 ]
Gschwandtner, Philipp [1 ]
Zangerl, Peter [1 ]
Thoman, Peter [1 ]
Fahringer, Thomas [1 ]
Heller, Thomas [2 ]
Fey, Dietmar [2 ]
机构
[1] Univ Innsbruck, A-6020 Innsbruck, Austria
[2] Friedrich Alexander Univ Erlangen Nuremberg, D-91058 Erlangen, Germany
来源
2018 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING (CLUSTER) | 2018年
关键词
D O I
10.1109/CLUSTER.2018.00088
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Contemporary state-of-the-art runtime systems underlying widely utilized general purpose parallel programming languages and libraries like OpenMP, MPI, or OpenCL provide the foundation for accessing the parallel capabilities of modern computing architectures. In the tradition of their respective imperative host languages those runtime systems' main focus is on providing means for the distribution and synchronization of operations - while the organization and management of manipulated data is left to application developers. Consequently, the distribution of data remains inaccessible to those runtime systems. However, many desirable system-level features depend on a runtime system's ability to exercise control on the distribution of data. Thus, program models underlying traditional systems lack the potential for the support of those features. In this paper, we present a novel application model granting parallel runtime systems system-wide control over the distribution of user-defined shared data structures. Our model utilizes the high-level nature of parallel programming languages, in particular, the usage of well-typed data structures and the associated hiding of implementation details from the application developers. By being based on a generalization of such data structures and extending the resulting abstraction with features facilitating the automated management of the distribution of those, our model enables runtime systems to dynamically influence the placement and replication of shared data. This paper covers a rigorous formal description of our application model, as well as details on our prototype implementation and experimental results demonstrating its ability to efficiently and scalably manage various data structures in real-world environments.
引用
收藏
页码:445 / 455
页数:11
相关论文
共 30 条
[1]  
Aguilar X., 2017, ON DEMAND ON LINE MO
[2]  
AllScale Consortium, 2018, ALLSCALE
[3]  
AllScale Consortium, 2018, ALLSCALE API
[4]  
AllScale Consortium, 2018, ALLSCALE RUNT SYST
[5]  
AllScale Consortium, 2018, ALLSCALE COMP
[6]  
[Anonymous], 2001, LCPC
[7]  
[Anonymous], 2010, P USENIX WORKSH HOT
[8]  
[Anonymous], 2018 IEEE INT C CLUS
[9]  
[Anonymous], 2009, Hadoop: The Definitive Guide
[10]  
Brown K. J., 2011, Proceedings 2011 International Conference on Parallel Architectures and Compilation Techniques (PACT), P89, DOI 10.1109/PACT.2011.15