Target Detection Based on Two-Stream Convolution Neural Network With Self-Powered Sensors Information

被引:25
作者
Huang, Li [1 ]
Xiang, Zhao [2 ]
Yun, Juntong
Sun, Ying [1 ]
Liu, Yuting [1 ]
Jiang, Du [1 ]
Ma, Hongjie [3 ]
Yu, Hui [4 ,5 ,6 ]
机构
[1] Wuhan Univ Sci & Technol, Wuhan, Peoples R China
[2] Wuhan Univ Sci & Technol, Comp Sci, Wuhan, Peoples R China
[3] Univ Portsmouth, Sch Energy & Elect Engn, Portsmouth, England
[4] Univ Glasgow, Glasgow, Scotland
[5] Queens Univ Belfast, Belfast, North Ireland
[6] Univ Portsmouth, Fac Creat & Cultural Ind CCI, Portsmouth, England
基金
中国国家自然科学基金;
关键词
Depthwise separable convolution; MobileNet; self-powered sensors information; target detection; two-stream convolutional neural network (CNN); YOLOv4; RECOGNITION; FUSION; IMAGE;
D O I
10.1109/JSEN.2022.3220341
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
With the rapid development of artificial intelligence, a neural network is widely used in various fields. The target detection algorithm is mainly based on a neural network, but the accuracy of the target detection algorithm is greatly related to the complexity of the scene and texture. A target detection algorithm based on the RGB-D image from the perspective of the lightweight of the target detection network model and the integration of the depth map to overcome the weak environmental illumination with self-powered sensors information is proposed. This article analyzes the networkmodel structure of YOLOv4 andMobileNet, compares the variation of parameter numbers between depthwise separable convolution and convolutional neural networks, and combines the advantages of the YOLOv4 network and the MobileNetv3 network. The main network of three effective feature layers in YOLOv4 is replaced by the MobileNetv3 network for initial feature layer extraction to strengthen the feature extraction network. At the same time, the standard convolutionmodels in the network are replaced by depthwise separable convolution. The proposed method is compared with YOLOv4 and YOLOv4-MobileNetv3 in this article, and the experimental results show that the proposed network retains its original advantages in accuracy, but the size of the network model is about 23% of that of the YOLOv4 network model, the processing speed is about 42% higher than that of the YOLOv4 network model, and the detection accuracy can still reach 83% in the environment with poor lighting conditions.
引用
收藏
页码:20681 / 20690
页数:10
相关论文
共 64 条
[1]   Improved single shot multibox detector target detection method based on deep feature fusion [J].
Bai, Dongxu ;
Sun, Ying ;
Tao, Bo ;
Tong, Xiliang ;
Xu, Manman ;
Jiang, Guozhang ;
Chen, Baojia ;
Cao, Yongcheng ;
Sun, Nannan ;
Li, Zeshen .
CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2022, 34 (04)
[2]   Jointly network: a network based on CNN and RBM for gesture recognition [J].
Cheng, Wentao ;
Sun, Ying ;
Li, Gongfa ;
Jiang, Guozhang ;
Liu, Honghai .
NEURAL COMPUTING & APPLICATIONS, 2019, 31 (Suppl 1) :309-323
[3]   Gesture recognition based on surface electromyography-featureimage [J].
Cheng, Yangwei ;
Li, Gongfa ;
Yu, Mingchao ;
Jiang, Du ;
Yun, Juntong ;
Liu, Ying ;
Liu, Yibo ;
Chen, Disi .
CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2021, 33 (06)
[4]   Gesture recognition based on multi-modal feature weight [J].
Duan, Haojie ;
Sun, Ying ;
Cheng, Wentao ;
Jiang, Du ;
Yun, Juntong ;
Liu, Ying ;
Liu, Yibo ;
Zhou, Dalin .
CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2021, 33 (05)
[5]   Corner Proposal Network for Anchor-Free, Two-Stage Object Detection [J].
Duan, Kaiwen ;
Xie, Lingxi ;
Qi, Honggang ;
Bai, Song ;
Huang, Qingming ;
Tian, Qi .
COMPUTER VISION - ECCV 2020, PT III, 2020, 12348 :399-416
[6]   Substation instrumentation target detection based on multi-scale feature fusion [J].
Feng, Qiaosheng ;
Huang, Li ;
Sun, Ying ;
Tong, Xiliang ;
Liu, Xin ;
Xie, Yuanmin ;
Li, Jun ;
Fan, Hanwen ;
Chen, Baojia .
CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2022, 34 (23)
[7]   Classification of Infrared Objects in Manifold Space Using Kullback-Leibler Divergence of Gaussian Distributions of Image Points [J].
Ge, Huilin ;
Zhu, Zhiyu ;
Lou, Kang ;
Wei, Wei ;
Liu, Runbang ;
Damasevicius, Robertas ;
Wozniak, Marcin .
SYMMETRY-BASEL, 2020, 12 (03)
[8]   Tracking Video Target via Particle Filtering on Manifold [J].
Ge, Huilin ;
Zhu, Zhiyu ;
Lou, Kang .
INFORMATION TECHNOLOGY AND CONTROL, 2019, 48 (04) :538-544
[9]   Fast R-CNN [J].
Girshick, Ross .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :1440-1448
[10]   Surface Defect Segmentation Algorithm of Steel Plate Based on Geometric Median Filter Pruning [J].
Hao, Zhiqiang ;
Wang, Zhigang ;
Bai, Dongxu ;
Tong, Xiliang .
FRONTIERS IN BIOENGINEERING AND BIOTECHNOLOGY, 2022, 10