Resource Characterisation of Personal-Scale Sensing Models on Edge Accelerators

被引:41
作者
Antonini, Mattia [1 ,2 ]
Vu, Tran Huy [3 ]
Min, Chulhong [4 ]
Montanari, Alessandro [5 ]
Mathur, Akhil
Kawsar, Fahim [5 ]
机构
[1] FBK CREATE NET, Trento, Italy
[2] Univ Trento, Trento, Italy
[3] Singapore Management Univ, Singapore, Singapore
[4] Nokia Bell Labs, Cambridge, England
[5] Nokia Bell Labs, Cambridge, England
来源
PROCEEDINGS OF THE 2019 INTERNATIONAL WORKSHOP ON CHALLENGES IN ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING FOR INTERNET OF THINGS (AICHALLENGEIOT '19) | 2019年
关键词
resource characterisation; edge accelerators; sensing models;
D O I
10.1145/3363347.3363363
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Edge accelerator is a class of brand-new purpose-built System On a Chip (SoC) for running deep learning models efficiently on edge devices. These accelerators offer various benefits such as ultra-low latency, sensitive data protection, and high availability due to their locality and are opening up interminable opportunities for building sensory systems in the real world. Naturally, in the context of sensory awareness systems, e.g., IoT, wearables, and other sensory devices, the emergence of edge accelerators is pushing us to rethink how we design these systems at a personal-scale. To this end, in this paper we take a closer look at the performance of a set of edge accelerators in running a collection of personal-scale sensory deep learning models. We benchmark eight different models with varying architectures and tasks (i.e., motion, audio, and vision) across seven platform configurations with three different accelerators including Google Coral, NVidia Jetson Nano, and Intel Neural Compute Stick. We report on their execution performance concerning latency, memory, and power consumption while discussing their current workflows and limitations. The results and insights lay an empirical foundation for the development of sensory systems on edge accelerators.
引用
收藏
页码:49 / 55
页数:7
相关论文
共 20 条
[1]  
Almeida M., 2019, The 3rd International Workshop on Deep Learning for Mobile Systems and Applications, P1, DOI DOI 10.1145/3325413.3329793
[2]  
[Anonymous], EDGETPU MOD REQ
[3]  
[Anonymous], INT DISTR OPENVINO T
[4]  
[Anonymous], MOD OPT DEV GUID
[5]  
[Anonymous], 2014, P 2014 ACM INT JOINT
[6]  
[Anonymous], 2016, ARXIV160207360
[7]  
[Anonymous], 2017, CORR
[8]  
[Anonymous], 2015, P 2015 INT WORKSHOP
[9]  
[Anonymous], POSTTR QUANT
[10]  
[Anonymous], EXPERT SYSTEMS APPL