Small Object Detection in UAV Remote Sensing Images Based on Intra-Group Multi-Scale Fusion Attention and Adaptive Weighted Feature Fusion Mechanism

被引:3
作者
Yuan, Zhe [1 ]
Gong, Jianglei [1 ]
Guo, Baolong [1 ]
Wang, Chao [1 ]
Liao, Nannan [1 ]
Song, Jiawei [1 ]
Wu, Qiming [1 ]
机构
[1] Xidian Univ, Inst Intelligent Control & Image Engn, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
UAV remote sensing images; small object detection; feature fusion; attention mechanism; adaptive; TARGET DETECTION; OPTIMIZATION;
D O I
10.3390/rs16224265
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
In view of the issues of missed and false detections encountered in small object detection for UAV remote sensing images, and the inadequacy of existing algorithms in terms of complexity and generalization ability, we propose a small object detection model named IA-YOLOv8 in this paper. This model integrates the intra-group multi-scale fusion attention mechanism and the adaptive weighted feature fusion approach. In the feature extraction phase, the model employs a hybrid pooling strategy that combines Avg and Max pooling to replace the single Max pooling operation used in the original SPPF framework. Such modifications enhance the model's ability to capture the minute features of small objects. In addition, an adaptive feature fusion module is introduced, which is capable of automatically adjusting the weights based on the significance and contribution of features at different scales to improve the detection sensitivity for small objects. Simultaneously, a lightweight intra-group multi-scale fusion attention module is implemented, which aims to effectively mitigate background interference and enhance the saliency of small objects. Experimental results indicate that the proposed IA-YOLOv8 model has a parameter quantity of 10.9 MB, attaining an average precision (mAP) value of 42.1% on the Visdrone2019 test set, an mAP value of 82.3% on the DIOR test set, and an mAP value of 39.8% on the AI-TOD test set. All these results outperform the existing detection algorithms, demonstrating the superior performance of the IA-YOLOv8 model in the task of small object detection for UAV remote sensing.
引用
收藏
页数:26
相关论文
共 65 条
[51]   UAV Target Detection Algorithm Based on Improved YOLOv8 [J].
Wang, Feng ;
Wang, Hongyuan ;
Qin, Zhiyong ;
Tang, Jiaying .
IEEE ACCESS, 2023, 11 :116534-116544
[52]   Tiny Object Detection in Aerial Images [J].
Wang, Jinwang ;
Yang, Wen ;
Guo, Haowen ;
Zhang, Ruixiang ;
Xia, Gui-Song .
2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, :3791-3798
[53]   Edge-based target detection for unmanned aerial vehicles using competitive Bird Swarm Algorithm [J].
Wang, Xiaohua ;
Deng, Yimin ;
Duan, Haibin .
AEROSPACE SCIENCE AND TECHNOLOGY, 2018, 78 :708-720
[54]   Small Object Detection Based on Deep Learning for Remote Sensing: A Comprehensive Review [J].
Wang, Xuan ;
Wang, Aoran ;
Yi, Jinglei ;
Song, Yongchao ;
Chehri, Abdellah .
REMOTE SENSING, 2023, 15 (13)
[55]   A comprehensive survey of oriented object detection in remote sensing images [J].
Wen, Long ;
Cheng, Yu ;
Fang, Yi ;
Li, Xinyu .
EXPERT SYSTEMS WITH APPLICATIONS, 2023, 224
[56]   Adaptive Feature Fusion and Improved Attention Mechanism-Based Small Object Detection for UAV Target Tracking [J].
Xiong, Xuanrui ;
He, Mengting ;
Li, Tianyu ;
Zheng, Guifeng ;
Xu, Wen ;
Fan, Xiaolin ;
Zhang, Yuan .
IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (12) :21239-21249
[57]  
Yang Y., 2019, INT C GEN EV COMP, P253
[58]  
Yu J., 2016, P 24 ACM INT C MULT, P516, DOI DOI 10.1145/2964284.2967274
[59]   Marine environmental monitoring with unmanned vehicle platforms: Present applications and future prospects [J].
Yuan, Shuyun ;
Li, Ying ;
Bao, Fangwen ;
Xu, Haoxiang ;
Yang, Yuping ;
Yan, Qiushi ;
Zhong, Shuqiao ;
Yin, Haoyang ;
Xu, Jiajun ;
Huang, Ziwei ;
Lin, Jian .
SCIENCE OF THE TOTAL ENVIRONMENT, 2023, 858
[60]   Neural Network Compression via Low Frequency Preference [J].
Zhang, Chaoyan ;
Li, Cheng ;
Guo, Baolong ;
Liao, Nannan .
REMOTE SENSING, 2023, 15 (12)