Small-Object Detection in UAV-Captured Images via Multi-Branch Parallel Feature Pyramid Networks

被引:94
作者
Liu, Yingjie [1 ]
Yang, Fengbao [1 ]
Hu, Peng [1 ]
机构
[1] North Univ China, Sch Informat & Commun Engn, Taiyuan 030051, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Object detection; Detectors; Proposals; Unmanned aerial vehicles; Noise measurement; Computer architecture; Unmanned aerial vehicle; object detection; multi-branch parallel feature pyramid networks (MPFPN); feature fusion; cascade architecture;
D O I
10.1109/ACCESS.2020.3014910
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Small object is one of the primary challenges in the field of object detection, which is notably pronounced to the detection in the images from Unmanned Aerial Vehicles (UAV). Existing detectors based on deep-learning methods usually apply the feature extraction networks with a large down-sampling factor to obtain higher-level features. However, such big stride tends to make the feature information of small objects become the little point or even vanish in the low-resolution feature maps due to the limitation of pixels. Therefore, a novel structure called Multi-branch Parallel Feature Pyramid Networks (MPFPN) is proposed in this article, which aims to extract more abundant feature information of the objects with a small size. Specifically, the parallel branch is designed to recover the features that missed in the deeper layers. Meanwhile, a supervised spatial attention module (SSAM) is applied to weaken the impact of background noise inference and focus object information. Furthermore, we adopt cascade architecture in the Fast R-CNN stage for a more powerful localization capability. Experiments on the public drone-based datasets named VisDrone-DET demonstrate that our method achieves competitive performance compared with other state-of-the-art detection algorithms.
引用
收藏
页码:145740 / 145750
页数:11
相关论文
共 45 条
[1]  
[Anonymous], 2014, LECT NOTES COMPUT SC
[2]  
[Anonymous], 2010, INT J COMPUT VISION, DOI DOI 10.1007/s11263-009-0275-4
[3]  
[Anonymous], 2017, P IEEE INT C COMPUTE
[4]  
Bochkovskiy A., 2020, ARXIV200410934
[5]   Cascade R-CNN: High Quality Object Detection and Instance Segmentation [J].
Cai, Zhaowei ;
Vasconcelos, Nuno .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (05) :1483-1498
[6]   Multiple-Oriented and Small Object Detection with Convolutional Neural Networks for Aerial Image [J].
Chen, Chao ;
Zhong, Jiandan ;
Tan, Yi .
REMOTE SENSING, 2019, 11 (18)
[7]   Deformable Convolutional Networks [J].
Dai, Jifeng ;
Qi, Haozhi ;
Xiong, Yuwen ;
Li, Yi ;
Zhang, Guodong ;
Hu, Han ;
Wei, Yichen .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :764-773
[8]  
Dai J, 2016, PROCEEDINGS 2016 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL TECHNOLOGY (ICIT), P1796, DOI 10.1109/ICIT.2016.7475036
[9]   Mathematical Investigation on the Sustainability of UAV Logistics [J].
Eun, Joonyup ;
Song, Byung Duk ;
Lee, Sangbok ;
Lim, Dae-Eun .
SUSTAINABILITY, 2019, 11 (21)
[10]  
Fu C.-Y., 2017, ARXIV170106659