Facilitating HPC operation and administration via cloud

被引:2
作者
Sha C. [1 ,2 ]
Zhang J. [1 ]
An L. [1 ]
Zhang Y. [1 ]
Wang Z. [3 ]
Ilijaš T. [4 ]
Bat N. [4 ]
Verlič M. [4 ]
Ji Q. [1 ]
机构
[1] Sugon Information Industry Co, Beijing
[2] School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing
[3] High School Affiliated to Renmin University, Beijing
[4] Arctur računalniški inženiring d.o.o., Nova Gorica
来源
Supercomputing Frontiers and Innovations | 2019年 / 6卷 / 01期
关键词
Administration; Cloud; EasyOP; HPC; Monitoring; Notifications; Operation; Supercomputer;
D O I
10.14529/jsfi190105
中图分类号
学科分类号
摘要
Experiencing a tremendous growth, Cloud Computing offers a number of advantages over other distributed platforms. Introducing the advantages of High Performance Computing (HPC) also brought forward the development of HPCaaS (HPC as a Service), which has mainly focused on exible access to resources, cost-effectiveness, and the no-maintenance-needed for end-users. Besides providing and using HPCaaS, HPC centers could leverage more from Cloud Comput- ing technology, for instance to facilitate operation and administration of deployed HPC systems, commonly faced by most supercomputer centers. This paper reports the product, EasyOP, developed to realize the idea that one or more Cloud or HPC facilities can be run over a centralized and unified control platform. The main purpose of EasyOP is that the information of HPC systems hardware and system software, failure alarms, jobs scheduling, etc. is sent to the Wuxi cloud computing center. After a series of analysis and processing, we are able to share many valuable data, including alarm and job scheduling status, to HPC users through SMS, email, and WeChat. More importantly, with the data accumulated on the cloud computing center, EasyOP can offer several easy-to-use functions, such as user(s) man- agement, monthly/yearly reports, one-screen monitoring and so on. By the end of 2016, EasyOP successfully served more than 50 HPC systems with almost 10000 nodes and over of 300 regular users. © The Authors 2019.
引用
收藏
页码:23 / 35
页数:12
相关论文
共 31 条
[1]  
Badger M., Zenoss Core 3.x Network and System Monitoring, (2011)
[2]  
Barth W., Nagios: System and Network Monitoring, (2008)
[3]  
Buyya R., Parmon: a portable and scalable monitoring system for clusters, Software Practice & Experience, 30, 7, pp. 723-739, (2015)
[4]  
Crasso M., Mateos C., Zunino A., Campo M., Easysoc: Making web service outsourcing easier, Information Sciences An International Journal, 259, 3, pp. 452-473, (2014)
[5]  
Cunha R.L.F., Rodrigues E.R., Tizzei L.P., Netto M.A.S., Job placement advisor based on turnaround predictions for HPC hybrid clouds, Future Generation Computer Systems, 67, pp. 35-46, (2016)
[6]  
Duran-Limon H.A., Flores-Contreras J., Parlavantzas N., Zhao M., Meulenert-Pena A., Efficient execution of the WRF model and other HPC applications in the cloud, Earth Science Informatics, 9, 3, pp. 1-18, (2016)
[7]  
Evans R.T., Browne J.C., Barth W.L., Understanding application and system performance through system-wide monitoring, pp. 1702-1710, (2016)
[8]  
Ferreto T.C., De Rose C.A.F., De Rose L., Rvision: An open and high configurable tool for cluster monitoring, In: IEEE/ACM International Symposium on CLUSTER Computing and the Grid, pp. 75-75, (2002)
[9]  
Fu W., Huang Q., Grideye: A service-oriented grid monitoring system with improved forecasting algorithm, In: International Conference on Grid and Cooperative Computing Workshops, pp. 5-12, (2006)
[10]  
Gupta A., Kale L.V., Gioachin F., March V., Suen C.H., Lee B.S., Faraboschi P., Kaufmann R., Milojicic D., The who, what, why, and how of high performance computing in the cloud, In: IEEE International Conference on Cloud Computing Technology and Science, pp. 306-314, (2014)