A topology-aware method for scientific application deployment on cloud

被引:1
作者
Fan, Pei [1 ]
Chen, Zhenbang [2 ]
Wang, Ji [2 ]
Zheng, Zibin [3 ,4 ]
Lyu, Michael R. [3 ,4 ]
机构
[1] China HuaYi Broadcasting Corp, Fuzhou 350001, Peoples R China
[2] Natl Univ Def Technol, Sch Comp Sci, Natl Key Lab Parallel & Distributed Proc, Changsha 410073, Hunan, Peoples R China
[3] Chinese Univ Hong Kong, Shenzhen Res Inst, Shenzhen, Peoples R China
[4] Chinese Univ Hong Kong, Dept Comp Sci & Engn, Hong Kong, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
topology-aware; communication topology; scientific applications; deployment; cloud computing; COMPONENT RANKING; MPI;
D O I
10.1504/IJWGS.2014.064937
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Nowadays, more and more scientific applications are moving to cloud computing. The optimal deployment of scientific applications is critical for providing good services to users. Scientific applications are usually topology-aware applications. Therefore, considering the topology of a scientific application during the development will benefit the performance of the application. However, it is challenging to automatically discover and make use of the communication pattern of a scientific application while deploying the application on cloud. To attack this challenge, in this paper, we propose a framework to discover the communication topology of a scientific application by pre-execution and multi-scale graph clustering, based on which the deployment can be optimised. In addition, we present a set of efficient collective operations for cloud based on the common interconnect topology. Comprehensive experiments are conducted by employing a well-known MPI benchmark and comparing the performance of our method with those of other methods. The experimental results show the effectiveness of our topology-aware deployment method.
引用
收藏
页码:338 / 370
页数:33
相关论文
共 57 条
[1]  
Almasi George, 2005, P 19 ANN INT C SUP C, P253, DOI [DOI 10.1145/1088149.1088183, 10.1145/1088149.1088183]
[2]  
Ananth GramaAnshul Gupta., 2003, Introduction to Parallel Computing, VSecond
[3]   BOINC: A system for public-resource computing and storage [J].
Anderson, DP .
FIFTH IEEE/ACM INTERNATIONAL WORKSHOP ON GRID COMPUTING, PROCEEDINGS, 2004, :4-10
[4]  
[Anonymous], 1999, TR99020 U MINN DEP C
[5]  
[Anonymous], P 6 INT C GRID COMP
[6]  
[Anonymous], EHUKATIK0307
[7]  
[Anonymous], 2008, High-Performance Parallel Database Processing and Grid Databases
[8]  
[Anonymous], P 6 INT C PAR DISTR
[9]  
[Anonymous], 2012, P 3 ACM S CLOUD COMP
[10]  
[Anonymous], 2012, PROC 3 ACM S CLOUD C