Computation Offloading for Machine Learning Web Apps in the Edge Server Environment

被引:55
作者
Jeong, Hyuk-Jin [1 ]
Jeong, InChang [1 ]
Lee, Hyeon-Jae [1 ]
Moon, Soo-Mook [1 ]
机构
[1] Seoul Natl Univ, Dept Elect & Comp Engn, Seoul, South Korea
来源
2018 IEEE 38TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS (ICDCS) | 2018年
基金
新加坡国家研究基金会;
关键词
edge computing; cloud computing; computation offloading; web application; machine learning; neural network;
D O I
10.1109/ICDCS.2018.00154
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Machine leaning apps require heavy computations, especially with the use of the deep neural network (DNN), so an embedded device with limited hardware cannot run the apps by itself. One solution for this problem is to offload DNN computations from the client to a nearby edge server. Existing approaches to DNN offloading with edge servers either specialize the edge server for fixed, specific apps, or customize the edge server for diverse apps, yet after migrating a large VM image that contains the client's back-end software system. In this paper, we propose a new and simple approach to offload DNN computations in the context of web apps. We migrate the current execution state of a web app from the client to the edge server just before executing a DNN computation, so that the edge server can execute the DNN computation with its powerful hardware. Then, we migrate the new execution state from the edge server to the client so that the client can continue to execute the app. We can save the execution state of the web app in the form of another web app called the snapshot, which immensely simplifies saving and restoring the execution state with a small overhead. We can offload any DNN app to any generic edge server, equipped with a browser and our offloading system. We address some issues related to offloading DNN apps such as how to send the DNN model and how to improve the privacy of user data. We also discuss how to install our offloading system on the edge server on demand. Our experiment with real DNN-based web apps shows that snapshot-based offloading achieves a promising performance result, comparable to running the app entirely on the server.
引用
收藏
页码:1492 / 1499
页数:8
相关论文
共 24 条
[21]  
Satyanarayanan M, 2017, COMPUTER, V50, P30, DOI 10.1109/MC.2017.9
[22]   The Case for VM-Based Cloudlets in Mobile Computing [J].
Satyanarayanan, Mahadev ;
Bahl, Paramvir ;
Caceres, Ramon ;
Davies, Nigel .
IEEE PERVASIVE COMPUTING, 2009, 8 (04) :14-23
[23]  
Szegedy C, 2014, Arxiv, DOI arXiv:1312.6199
[24]  
Zeqi Lai, 2017, FURION ENG HIGH QUAL