A topology-aware method for scientific application deployment on cloud

被引:1
作者
Fan, Pei [1 ]
Chen, Zhenbang [2 ]
Wang, Ji [2 ]
Zheng, Zibin [3 ,4 ]
Lyu, Michael R. [3 ,4 ]
机构
[1] China HuaYi Broadcasting Corp, Fuzhou 350001, Peoples R China
[2] Natl Univ Def Technol, Sch Comp Sci, Natl Key Lab Parallel & Distributed Proc, Changsha 410073, Hunan, Peoples R China
[3] Chinese Univ Hong Kong, Shenzhen Res Inst, Shenzhen, Peoples R China
[4] Chinese Univ Hong Kong, Dept Comp Sci & Engn, Hong Kong, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
topology-aware; communication topology; scientific applications; deployment; cloud computing; COMPONENT RANKING; MPI;
D O I
10.1504/IJWGS.2014.064937
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Nowadays, more and more scientific applications are moving to cloud computing. The optimal deployment of scientific applications is critical for providing good services to users. Scientific applications are usually topology-aware applications. Therefore, considering the topology of a scientific application during the development will benefit the performance of the application. However, it is challenging to automatically discover and make use of the communication pattern of a scientific application while deploying the application on cloud. To attack this challenge, in this paper, we propose a framework to discover the communication topology of a scientific application by pre-execution and multi-scale graph clustering, based on which the deployment can be optimised. In addition, we present a set of efficient collective operations for cloud based on the common interconnect topology. Comprehensive experiments are conducted by employing a well-known MPI benchmark and comparing the performance of our method with those of other methods. The experimental results show the effectiveness of our topology-aware deployment method.
引用
收藏
页码:338 / 370
页数:33
相关论文
共 57 条
[21]  
Fangzhe Chang, 2012, 2012 IEEE 5th International Conference on Cloud Computing (CLOUD), P327, DOI 10.1109/CLOUD.2012.91
[22]  
Faraj A., 2005, ICS 05, P393
[23]  
Foster I. R. I. T., 2008, P 4 INT WORKSHOP GRI, P1
[24]  
Gabriel E, 2004, LECT NOTES COMPUT SC, V3241, P97
[25]   Cloud computing paradigms for pleasingly parallel biomedical applications [J].
Gunarathne, Thilina ;
Wu, Tak-Lon ;
Choi, Jong Youl ;
Bae, Seung-Hee ;
Qiu, Judy .
CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2011, 23 (17) :2338-2354
[26]   A multi-scale algorithm for drawing graphs nicely [J].
Hadany, R ;
Harel, D .
DISCRETE APPLIED MATHEMATICS, 2001, 113 (01) :3-21
[27]   The scalable process topology interface of MPI 2.2 [J].
Hoefler, Torsten ;
Rabenseifner, Rolf ;
Ritzdorf, Hubert ;
de Supinski, Bronis R. ;
Thakur, Rajeev ;
Traeff, Jesper Larsson .
CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2011, 23 (04) :293-310
[28]  
Hoffa Christina, 2008, 2008 IEEE Fourth International Conference on eScience, P640, DOI 10.1109/eScience.2008.167
[29]   Data clustering: A review [J].
Jain, AK ;
Murty, MN ;
Flynn, PJ .
ACM COMPUTING SURVEYS, 1999, 31 (03) :264-323
[30]   Cluster analysis for gene expression data: A survey [J].
Jiang, DX ;
Tang, C ;
Zhang, AD .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2004, 16 (11) :1370-1386