Joint FrontEdgeCloud IoVT Analytics: Resource-Effective Design and Scheduling

被引:11
作者
Chen, Youjia [1 ]
Zhao, Tiesong [1 ,2 ]
Cheng, Peng [3 ,4 ]
Ding, Ming [5 ]
Chen, Chang Wen [6 ]
机构
[1] Fuzhou Univ, Fujian Key Lab Intelligent Proc & Wireless Transm, Fuzhou 350025, Peoples R China
[2] Peng Cheng Lab, Shenzhen 518066, Peoples R China
[3] La Trobe Univ, Dept Comp Sci & Informat Technol, Bundoora, Vic 3086, Australia
[4] Univ Sydney, Sch Elect & Informat Engn, Sydney, NSW 2006, Australia
[5] CSIRO, Data61, Eveleigh, NSW 2015, Australia
[6] Hong Kong Polytech Univ, Dept Comp, Hong Kong, Peoples R China
基金
美国国家科学基金会;
关键词
Edge computing; Internet of Video Things (IoVT); resource scheduling; visual analytics; VISUAL INTERNET; VIDEO THINGS; IOT; OPTIMIZATION; INTELLIGENCE; MANAGEMENT; SYSTEM;
D O I
10.1109/JIOT.2022.3189035
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A tremendous amount of visual data are bing collected by the Internet of Video Things (IoVT) systems in which ubiquitous cameras deployed in cities enable new applications in the domains of smart transportation and public security. However, the limited resources in terms of communication, computing, and caching (3C) in the conventional cellular network make it challenging to adopt centralized artificial intelligence (AI) to conduct real-time video-based data analytics. In this work, based on the 5G network architecture with edge servers, a three-phase resource-effective solution is proposed to perform surveillance operations in a large-scale wireless IoVT. The proposed strategy integrates front-end cameras with simple on-chip neural networks performing real-time object-of-interest segmentation, edge servers, and cloud servers with AI functionality carrying out image-based target recognition and video-based target analytics tasks. More importantly, we design the optimal 3C strategy to achieve the best video analytics performance constrained by computing offload ratio, network resource allocation and video-related parameters. Extensive simulations with deep neural networks implemented both at the front-end cameras and in the cloud server have validated the effectiveness of the proposed solution.
引用
收藏
页码:23941 / 23953
页数:13
相关论文
共 46 条
  • [1] A Novel Edge-Cloud Interworking Framework in the Video Analytics of the Internet of Things
    Ahn, Sanghong
    Lee, Joohyung
    Kim, Tae Yeon
    Choi, Jun Kyun
    [J]. IEEE COMMUNICATIONS LETTERS, 2020, 24 (01) : 178 - 182
  • [2] AlNaimi Noora, 2020, 2020 IEEE International Conference on Informatics, IoT, and Enabling Technologies (ICIoT), P627, DOI 10.1109/ICIoT48696.2020.9089560
  • [3] [Anonymous], MULTIPLE OBJECT TRAC
  • [4] Design Criteria and Genetic Algorithm Aided Optimization of Three-Stage-Concatenated Space-Time Shift Keying Systems
    Babich, Fulvio
    Crismani, Alessandro
    Driusso, Marco
    Hanzo, Lajos
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2012, 19 (08) : 543 - 546
  • [5] Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics
    Bernardin, Keni
    Stiefelhagen, Rainer
    [J]. EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING, 2008, 2008 (1)
  • [6] Deep Learning-Based Multiple Object Visual Tracking on Embedded System for IoT and Mobile Edge Computing Applications
    Blanco-Filgueira, Beatriz
    Garcia-Lesta, Daniel
    Fernandez-Sanjurjo, Mauro
    Manuel Brea, Victor
    Lopez, Paula
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (03): : 5423 - 5431
  • [7] Internet of Video Things: Next-Generation IoT With Visual Sensors
    Chen, Chang Wen
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (08) : 6676 - 6685
  • [8] The Joint Exploration Model (JEM) for Video Compression With Capability Beyond HEVC
    Chen, Jianle
    Karczewicz, Marta
    Huang, Yu-Wen
    Choi, Kiho
    Ohm, Jens-Rainer
    Sullivan, Gary J.
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (05) : 1208 - 1225
  • [9] Smart Campus Care and Guiding With Dedicated Video Footprinting Through Internet of Things Technologies
    Chen, Lien-Wu
    Chen, Tsung-Ping
    Chen, Da-En
    Liu, Jun-Xian
    Tsai, Ming-Fong
    [J]. IEEE ACCESS, 2018, 6 : 43956 - 43966
  • [10] Cooperative Caching for Scalable Video Coding Using Value-Decomposed Dimensional Networks
    Chen, Youjia
    Cai, Yuekai
    Zheng, Haifeng
    Hu, Jinsong
    Li, Jun
    [J]. CHINA COMMUNICATIONS, 2022, 19 (09) : 146 - 161