Edge Computing-Enabled Deep Learning for Real-time Video Optimization in IIoT

被引:33
作者
Dou, Wanchun [1 ]
Zhao, Xuan [1 ]
Yin, Xiaochun [2 ]
Wang, Huihui [3 ]
Luo, Yun [4 ]
Qi, Lianyong [5 ]
机构
[1] Nanjing Univ, Dept Comp Sci & Technol, State Key Lab Novel Software Technol, Nanjing 210023, Peoples R China
[2] WeiFang Univ Sci & Technol, Facil Hort Lab Univ Shandong, Weifang 262700, Peoples R China
[3] Jacksonville Univ, Dept Engn, Jacksonville, FL 32211 USA
[4] Univ Technol Sydney, Fac Engn & Informat Technol, Ultimo, NSW 2007, Australia
[5] Qufu Normal Univ, Sch Informat Sci & Engn, Rizhao 276826, Peoples R China
基金
美国国家科学基金会;
关键词
Deep learning; edge computing; industrial Internet of Things (IIoT); key frame; real-time video streaming optimization;
D O I
10.1109/TII.2020.3020386
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Real-time multimedia applications have gained immense popularity in the industrial Internet of Things (IIoT) paradigm. Due to the impact of the complex industrial environment, the transmission of video streaming is usually unstable. In the duration of a low bandwidth transmission, existing optimization methods often reduce the original resolution of some frames in a random way to avoid the video interruption. If the key frames with some important content are selected to be transmitted with a low resolution, it will greatly reduce the effect of industrial supervision. In view of this challenge, a real-time video streaming optimization method by reducing the number of video frames transmitted in the IIoT environment is proposed. Concretely, a deep learning-based object detection algorithm is recruited to effectively select the key frames in our method. The key frames with the original resolution will be transmitted along with audio data. As some nonkey frames are selectively discarded, it is helpful for smooth network transmitting with fewer bandwidth requirements. Moreover, we employ edge servers to run the object detection algorithm, and adjust video transmission flexibly. Extensive experiments are conducted to validate the effectiveness, and dependability of our method.
引用
收藏
页码:2842 / 2851
页数:10
相关论文
共 23 条
[1]   Security of the Internet of Things: Vulnerabilities, Attacks, and Countermeasures [J].
Butun, Ismail ;
Osterberg, Patrik ;
Song, Houbing .
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2020, 22 (01) :616-644
[2]  
Dastjerdi NS, 2017, INT CONF IMAG PROC
[3]   Cost-Effective Low-Delay Design for Multiparty Cloud Video Conferencing [J].
Hajiesmaili, Mohammad H. ;
Mak, Lok To ;
Wang, Zhi ;
Wu, Chuan ;
Chen, Minghua ;
Khonsari, Ahmad .
IEEE TRANSACTIONS ON MULTIMEDIA, 2017, 19 (12) :2760-2774
[4]  
He KM, 2017, IEEE I CONF COMP VIS, P2980, DOI [10.1109/TPAMI.2018.2844175, 10.1109/ICCV.2017.322]
[5]   Intelligent Embedded Vision for Summarization of Multiview Videos in IIoT [J].
Hussain, Tanveer ;
Muhammad, Khan ;
Del Ser, Javier ;
Baik, Sung Wook ;
de Albuquerque, Victor Hugo C. .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2020, 16 (04) :2592-2602
[6]  
Khan UA, 2017, 2017 14TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED VIDEO AND SIGNAL BASED SURVEILLANCE (AVSS)
[7]   Efficient payload communications for IoT-enabled ViSAR vehicles using discrete cosine transform-based quasi-sparse bit injection [J].
Khosravi, Mohammad R. ;
Samadi, Sadegh .
EURASIP JOURNAL ON WIRELESS COMMUNICATIONS AND NETWORKING, 2019, 2019 (01)
[8]   Reliable Data Aggregation in Internet of ViSAR Vehicles Using Chained Dual-Phase Adaptive Interpolation and Data Embedding [J].
Khosravi, Mohammad Reza ;
Samadi, Sadegh .
IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (04) :2603-2610
[9]  
Li YJ, 2017, IEEE INT CON MULTI, P1303, DOI 10.1109/ICME.2017.8019352
[10]   Distributed Resource Allocation in Blockchain-Based Video Streaming Systems With Mobile Edge Computing [J].
Liu, Mengting ;
Yu, F. Richard ;
Teng, Yinglei ;
Leung, Victor C. M. ;
Song, Mei .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2019, 18 (01) :695-708