Joint FrontEdgeCloud IoVT Analytics: Resource-Effective Design and Scheduling

被引:13
作者
Chen, Youjia [1 ]
Zhao, Tiesong [1 ,2 ]
Cheng, Peng [3 ,4 ]
Ding, Ming [5 ]
Chen, Chang Wen [6 ]
机构
[1] Fuzhou Univ, Fujian Key Lab Intelligent Proc & Wireless Transm, Fuzhou 350025, Peoples R China
[2] Peng Cheng Lab, Shenzhen 518066, Peoples R China
[3] La Trobe Univ, Dept Comp Sci & Informat Technol, Bundoora, Vic 3086, Australia
[4] Univ Sydney, Sch Elect & Informat Engn, Sydney, NSW 2006, Australia
[5] CSIRO, Data61, Eveleigh, NSW 2015, Australia
[6] Hong Kong Polytech Univ, Dept Comp, Hong Kong, Peoples R China
基金
美国国家科学基金会;
关键词
Edge computing; Internet of Video Things (IoVT); resource scheduling; visual analytics; VISUAL INTERNET; VIDEO THINGS; IOT; OPTIMIZATION; INTELLIGENCE; MANAGEMENT; SYSTEM;
D O I
10.1109/JIOT.2022.3189035
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A tremendous amount of visual data are bing collected by the Internet of Video Things (IoVT) systems in which ubiquitous cameras deployed in cities enable new applications in the domains of smart transportation and public security. However, the limited resources in terms of communication, computing, and caching (3C) in the conventional cellular network make it challenging to adopt centralized artificial intelligence (AI) to conduct real-time video-based data analytics. In this work, based on the 5G network architecture with edge servers, a three-phase resource-effective solution is proposed to perform surveillance operations in a large-scale wireless IoVT. The proposed strategy integrates front-end cameras with simple on-chip neural networks performing real-time object-of-interest segmentation, edge servers, and cloud servers with AI functionality carrying out image-based target recognition and video-based target analytics tasks. More importantly, we design the optimal 3C strategy to achieve the best video analytics performance constrained by computing offload ratio, network resource allocation and video-related parameters. Extensive simulations with deep neural networks implemented both at the front-end cameras and in the cloud server have validated the effectiveness of the proposed solution.
引用
收藏
页码:23941 / 23953
页数:13
相关论文
共 46 条
[1]   A Novel Edge-Cloud Interworking Framework in the Video Analytics of the Internet of Things [J].
Ahn, Sanghong ;
Lee, Joohyung ;
Kim, Tae Yeon ;
Choi, Jun Kyun .
IEEE COMMUNICATIONS LETTERS, 2020, 24 (01) :178-182
[2]  
AlNaimi Noora, 2020, 2020 IEEE International Conference on Informatics, IoT, and Enabling Technologies (ICIoT), P627, DOI 10.1109/ICIoT48696.2020.9089560
[3]  
[Anonymous], MULTIPLE OBJECT TRAC
[4]  
[Anonymous], 2005, Artificial Intelligence: A Guide to Intelligent Systems
[5]   Design Criteria and Genetic Algorithm Aided Optimization of Three-Stage-Concatenated Space-Time Shift Keying Systems [J].
Babich, Fulvio ;
Crismani, Alessandro ;
Driusso, Marco ;
Hanzo, Lajos .
IEEE SIGNAL PROCESSING LETTERS, 2012, 19 (08) :543-546
[6]   Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics [J].
Bernardin, Keni ;
Stiefelhagen, Rainer .
EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING, 2008, 2008 (1)
[7]   Deep Learning-Based Multiple Object Visual Tracking on Embedded System for IoT and Mobile Edge Computing Applications [J].
Blanco-Filgueira, Beatriz ;
Garcia-Lesta, Daniel ;
Fernandez-Sanjurjo, Mauro ;
Manuel Brea, Victor ;
Lopez, Paula .
IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (03) :5423-5431
[8]   Internet of Video Things: Next-Generation IoT With Visual Sensors [J].
Chen, Chang Wen .
IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (08) :6676-6685
[9]   The Joint Exploration Model (JEM) for Video Compression With Capability Beyond HEVC [J].
Chen, Jianle ;
Karczewicz, Marta ;
Huang, Yu-Wen ;
Choi, Kiho ;
Ohm, Jens-Rainer ;
Sullivan, Gary J. .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (05) :1208-1225
[10]   Smart Campus Care and Guiding With Dedicated Video Footprinting Through Internet of Things Technologies [J].
Chen, Lien-Wu ;
Chen, Tsung-Ping ;
Chen, Da-En ;
Liu, Jun-Xian ;
Tsai, Ming-Fong .
IEEE ACCESS, 2018, 6 :43956-43966