Small Object Detection in UAV Remote Sensing Images Based on Intra-Group Multi-Scale Fusion Attention and Adaptive Weighted Feature Fusion Mechanism

被引:1
作者
Yuan, Zhe [1 ]
Gong, Jianglei [1 ]
Guo, Baolong [1 ]
Wang, Chao [1 ]
Liao, Nannan [1 ]
Song, Jiawei [1 ]
Wu, Qiming [1 ]
机构
[1] Xidian Univ, Inst Intelligent Control & Image Engn, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
UAV remote sensing images; small object detection; feature fusion; attention mechanism; adaptive; TARGET DETECTION; OPTIMIZATION;
D O I
10.3390/rs16224265
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
In view of the issues of missed and false detections encountered in small object detection for UAV remote sensing images, and the inadequacy of existing algorithms in terms of complexity and generalization ability, we propose a small object detection model named IA-YOLOv8 in this paper. This model integrates the intra-group multi-scale fusion attention mechanism and the adaptive weighted feature fusion approach. In the feature extraction phase, the model employs a hybrid pooling strategy that combines Avg and Max pooling to replace the single Max pooling operation used in the original SPPF framework. Such modifications enhance the model's ability to capture the minute features of small objects. In addition, an adaptive feature fusion module is introduced, which is capable of automatically adjusting the weights based on the significance and contribution of features at different scales to improve the detection sensitivity for small objects. Simultaneously, a lightweight intra-group multi-scale fusion attention module is implemented, which aims to effectively mitigate background interference and enhance the saliency of small objects. Experimental results indicate that the proposed IA-YOLOv8 model has a parameter quantity of 10.9 MB, attaining an average precision (mAP) value of 42.1% on the Visdrone2019 test set, an mAP value of 82.3% on the DIOR test set, and an mAP value of 39.8% on the AI-TOD test set. All these results outperform the existing detection algorithms, demonstrating the superior performance of the IA-YOLOv8 model in the task of small object detection for UAV remote sensing.
引用
收藏
页数:26
相关论文
共 65 条
  • [1] Adhikari G., 2011, 2011 International Conference on Image Information Processing, P1
  • [2] Investigation of Autonomous Multi-UAV Systems for Target Detection in Distributed Environment: Current Developments and Open Challenges
    Adoni, Wilfried Yves Hamilton
    Lorenz, Sandra
    Fareedh, Junaidh Shaik
    Gloaguen, Richard
    Bussmann, Michael
    [J]. DRONES, 2023, 7 (04)
  • [3] Inside-Outside Net: Detecting Objects in Context with Skip Pooling and Recurrent Neural Networks
    Bell, Sean
    Zitnick, C. Lawrence
    Bala, Kavita
    Girshick, Ross
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 2874 - 2883
  • [4] Bochkovskiy A, 2020, Arxiv, DOI [arXiv:2004.10934, 10.48550/arXiv.2004.10934]
  • [5] Cascade R-CNN: Delving into High Quality Object Detection
    Cai, Zhaowei
    Vasconcelos, Nuno
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 6154 - 6162
  • [6] Deep Feature Fusion for VHR Remote Sensing Scene Classification
    Chaib, Souleyman
    Liu, Huan
    Gu, Yanfeng
    Yao, Hongxun
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2017, 55 (08): : 4775 - 4784
  • [7] Attentional Feature Fusion
    Dai, Yimian
    Gieseke, Fabian
    Oehmcke, Stefan
    Wu, Yiquan
    Barnard, Kobus
    [J]. 2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WACV 2021, 2021, : 3559 - 3568
  • [8] VisDrone-SOT2019: The Vision Meets Drone Single Object Tracking Challenge Results
    Du, Dawei
    Zhu, Pengfei
    Wen, Longyin
    Bian, Xiao
    Ling, Haibin
    Hu, Qinghua
    Zheng, Jiayu
    Peng, Tao
    Wang, Xinyao
    Zhang, Yue
    Bo, Liefeng
    Shi, Hailin
    Zhu, Rui
    Han, Bo
    Zhang, Chunhui
    Liu, Guizhong
    Wu, Han
    Wen, Hao
    Wang, Haoran
    Fan, Jiaqing
    Chen, Jie
    Gao, Jie
    Zhang, Jie
    Zhou, Jinghao
    Zhou, Jinliu
    Wang, Jinwang
    Wan, Jiuqing
    Kittler, Josef
    Zhang, Kaihua
    Huang, Kaiqi
    Yang, Kang
    Zhang, Kangkai
    Huang, Lianghua
    Zhou, Lijun
    Shi, Lingling
    Ding, Lu
    Wang, Ning
    Wang, Peng
    Hu, Qintao
    Laganiere, Robert
    Ma, Ruiyan
    Zhang, Ruohan
    Zou, Shanrong
    Zhao, Shengwei
    Li, Shengyang
    Zhu, Shengyin
    Li, Shikun
    Ge, Shiming
    Xuan, Shiyu
    Xu, Tianyang
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 199 - 212
  • [9] M-YOLOv8s: An improved small target detection algorithm for UAV aerial photography☆
    Duan, Siyao
    Wang, Ting
    Li, Tao
    Yang, Wankou
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 104
  • [10] Gadzicki K., 2020, P 2020 IEEE 23 INT C, P1