Artificial Intelligence Platform for Mobile Service Computing

被引:4
作者
Zhang, Haikuo [1 ,2 ,3 ]
Lu, Zhonghua [1 ,2 ]
Xu, Ke [1 ,2 ]
Pang, Yuchen [4 ]
Liu, Fang [1 ]
Chen, Liandong [5 ]
Wang, Jue [1 ]
Wang, Yangang [1 ]
Cao, Rongqiang [1 ]
机构
[1] Chinese Acad Sci, Comp Network Informat Ctr, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] China Internet Network Informat Ctr, Beijing 100190, Peoples R China
[4] Univ Illinois, Champaign, IL 61820 USA
[5] State Grid Hebei Elect Power Co, Shijiazhuang 050022, Hebei, Peoples R China
来源
JOURNAL OF SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY | 2019年 / 91卷 / 10期
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Artificial intelligence; Mobile service computing; Hadoop; Slurm; Schedule; TensorFlow; Caffe;
D O I
10.1007/s11265-019-1438-3
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Since the birth of artificial intelligence, the theory and the technology have become more mature, and the application field is expanding. Mobile networks and applications have grown quickly in recent years, and mobile computing is the new computing paradigm for mobile networks. In this paper, we build an artificial intelligence platform for a mobile service, which supports deep learning frameworks such as TensorFlow and Caffe. We describe the overall architecture of the AI platform for a GPU cluster in mobile service computing. In the GPU cluster, based on the scheduling layer, we propose Yarn by the Slurm scheduler to not only improve the distributed TensorFlow plug-in for the Slurm scheduling layer but also to extend YARN to manage and schedule GPUs. The front-end of the high-performance AI platform has the attributes of availability, scalability and efficiency. Finally, we verify the convenience, scalability, and effectiveness of the AI platform by comparing the performance of single-chip and distributed versions for the TensorFlow, Caffe and YARN systems.
引用
收藏
页码:1179 / 1189
页数:11
相关论文
共 31 条
[1]  
[Anonymous], 2013, Proceedings of the 30th International Conference on Machine Learning, Cycle
[2]  
[Anonymous], 2016, MULTIMEDIA TOOLS APP, DOI DOI 10.1186/s13041-016-0193-7
[3]  
[Anonymous], IDC iView: IDC Analyze the future
[4]  
[Anonymous], CUDA
[5]  
Christiansen B., 2017, SLURM OVEVIEW
[6]   Assessing yarn structure with image analysis methods [J].
Cybulska, M .
TEXTILE RESEARCH JOURNAL, 1999, 69 (05) :369-373
[7]  
Debo L, 2014, RES GPU CLUSTER SYST
[8]  
Ghemawat S, 2013, 19 ACM S OP SYST PRI
[9]   A high-performance, portable implementation of the MPI message passing interface standard [J].
Gropp, W ;
Lusk, E ;
Doss, N ;
Skjellum, A .
PARALLEL COMPUTING, 1996, 22 (06) :789-828
[10]  
Heigold G, 2013, INT CONF ACOUST SPEE, P8619, DOI 10.1109/ICASSP.2013.6639348