A Novel Method of Small Object Detection in UAV Remote Sensing Images Based on Feature Alignment of Candidate Regions

被引:8
作者
Wang, Jinkang [1 ]
Shao, Faming [1 ]
He, Xiaohui [1 ]
Lu, Guanlin [1 ]
机构
[1] Army Engn Univ Peoples Liberat Army China, Coll Field Engn, Nanjing 210007, Peoples R China
基金
中国国家自然科学基金;
关键词
UAV remote sensing images; small object; feature alignment; polarization hybrid domain attention; CONVOLUTIONAL NEURAL-NETWORK;
D O I
10.3390/drones6100292
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
To solve the problem of low detection accuracy of small objects in UAV optical remote sensing images due to low contrast, dense distribution, and weak features, this paper proposes a small object detection method based on feature alignment of candidate regions is proposed for remote sensing images. Firstly, AFA-FPN (Attention-based Feature Alignment FPN) defines the corresponding relationship between feature mappings, solves the misregistration of features between adjacent levels, and improves the recognition ability of small objects by aligning and fusing shallow spatial features and deep semantic features. Secondly, the PHDA (Polarization Hybrid Domain Attention) module captures local areas containing small object features through parallel channel domain attention and spatial domain attention. It assigns a larger weight to these areas to alleviate the interference of background noise. Then, the rotation branch uses RROI to rotate the horizontal frame obtained by RPN, which avoids missing detection of small objects with dense distribution and arbitrary direction. Next, the rotation branch uses RROI to rotate the horizontal box obtained by RPN. It solves the problem of missing detection of small objects with dense distribution and arbitrary direction and prevents feature mismatch between the object and candidate regions. Finally, the loss function is improved to better reflect the difference between the predicted value and the ground truth. Experiments are conducted on a self-made dataset. The experimental results show that the mAP of the proposed method reaches 82.04% and the detection speed reaches 24.3 FPS, which is significantly higher than that of the state-of-the-art methods. Meanwhile, the ablation experiment verifies the rationality of each module.
引用
收藏
页数:24
相关论文
共 56 条
[1]  
Bochkovskiy A., 2020, PREPRINT
[2]  
Chen Z., 2020, EUROPEAN C COMPUTER
[3]   Learning Rotation-Invariant Convolutional Neural Networks for Object Detection in VHR Optical Remote Sensing Images [J].
Cheng, Gong ;
Zhou, Peicheng ;
Han, Junwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2016, 54 (12) :7405-7415
[4]  
Cui L., 2018, ARXIV, DOI [10.1007/s11432-019-2723-1, DOI 10.1007/S11432-019-2723-1]
[5]  
Dai JF, 2016, ADV NEUR IN, V29
[6]   Ship Object Detection of Remote Sensing Image Based on Visual Attention [J].
Dong, Yuxin ;
Chen, Fukun ;
Han, Shuang ;
Liu, Hao .
REMOTE SENSING, 2021, 13 (16)
[7]   Rotation-aware and multi-scale convolutional neural network for object detection in remote sensing images [J].
Fu, Kun ;
Chang, Zhonghan ;
Zhang, Yue ;
Xu, Guangluan ;
Zhang, Keshu ;
Sun, Xian .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2020, 161 :294-308
[8]   Fast R-CNN [J].
Girshick, Ross .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :1440-1448
[9]   AugFPN: Improving Multi-scale Feature Learning for Object Detection [J].
Guo, Chaoxu ;
Fan, Bin ;
Zhang, Qian ;
Xiang, Shiming ;
Pan, Chunhong .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :12592-12601
[10]   Align Deep Features for Oriented Object Detection [J].
Han, Jiaming ;
Ding, Jian ;
Li, Jie ;
Xia, Gui-Song .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60