Accurate UAV Small Object Detection Based on HRFPN and EfficentVMamba

被引:0
作者
Wu, Shixiao [1 ]
Lu, Xingyuan [2 ]
Guo, Chengcheng [3 ,4 ]
Guo, Hong [5 ]
机构
[1] Wuhan Business Univ, Sch Informat Engn, Wuhan 430056, Peoples R China
[2] Tianjin Univ Technol, Key Lab Comp Vis & Syst, Minist Educ, Tianjin 300384, Peoples R China
[3] Wuhan Coll, Sch Informat Engn, Wuhan 430212, Peoples R China
[4] Wuhan Univ, Sch Elect Informat, Wuhan 430072, Peoples R China
[5] Tianjin Univ Technol, Sch Comp Sci & Engn, Tianjin 300384, Peoples R China
关键词
small object detection; deep learning; HRNet; Mamba; YOLO; feature fusion; NEURAL-NETWORK;
D O I
10.3390/s24154966
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
(1) Background: Small objects in Unmanned Aerial Vehicle (UAV) images are often scattered throughout various regions of the image, such as the corners, and may be blocked by larger objects, as well as susceptible to image noise. Moreover, due to their small size, these objects occupy a limited area in the image, resulting in a scarcity of effective features for detection. (2) Methods: To address the detection of small objects in UAV imagery, we introduce a novel algorithm called High-Resolution Feature Pyramid Network Mamba-Based YOLO (HRMamba-YOLO). This algorithm leverages the strengths of a High-Resolution Network (HRNet), EfficientVMamba, and YOLOv8, integrating a Double Spatial Pyramid Pooling (Double SPP) module, an Efficient Mamba Module (EMM), and a Fusion Mamba Module (FMM) to enhance feature extraction and capture contextual information. Additionally, a new Multi-Scale Feature Fusion Network, High-Resolution Feature Pyramid Network (HRFPN), and FMM improved feature interactions and enhanced the performance of small object detection. (3) Results: For the VisDroneDET dataset, the proposed algorithm achieved a 4.4% higher Mean Average Precision (mAP) compared to YOLOv8-m. The experimental results showed that HRMamba achieved a mAP of 37.1%, surpassing YOLOv8-m by 3.8% (Dota1.5 dataset). For the UCAS_AOD dataset and the DIOR dataset, our model had a mAP 1.5% and 0.3% higher than the YOLOv8-m model, respectively. To be fair, all the models were trained without a pre-trained model. (4) Conclusions: This study not only highlights the exceptional performance and efficiency of HRMamba-YOLO in small object detection tasks but also provides innovative solutions and valuable insights for future research.
引用
收藏
页数:23
相关论文
共 43 条
  • [11] Jocher G., Ultralytics YOLO
  • [12] Density Map Guided Object Detection in Aerial Images
    Li, Changlin
    Yang, Taojiannan
    Zhu, Sijie
    Chen, Chen
    Guan, Shanyue
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 737 - 746
  • [13] Li CY, 2022, Arxiv, DOI [arXiv:2209.02976, DOI 10.48550/ARXIV.2209.02976]
  • [14] Feature Pyramid Networks for Object Detection
    Lin, Tsung-Yi
    Dollar, Piotr
    Girshick, Ross
    He, Kaiming
    Hariharan, Bharath
    Belongie, Serge
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 936 - 944
  • [15] Liu JR, 2024, Arxiv, DOI [arXiv:2402.03302, DOI 10.48550/ARXIV.2402.03302]
  • [16] UAV-YOLO: Small Object Detection on Unmanned Aerial Vehicle Perspective
    Liu, Mingjie
    Wang, Xianhao
    Zhou, Anjian
    Fu, Xiuyuan
    Ma, Yiwei
    Piao, Changhao
    [J]. SENSORS, 2020, 20 (08)
  • [17] Path Aggregation Network for Instance Segmentation
    Liu, Shu
    Qi, Lu
    Qin, Haifang
    Shi, Jianping
    Jia, Jiaya
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 8759 - 8768
  • [18] SSD: Single Shot MultiBox Detector
    Liu, Wei
    Anguelov, Dragomir
    Erhan, Dumitru
    Szegedy, Christian
    Reed, Scott
    Fu, Cheng-Yang
    Berg, Alexander C.
    [J]. COMPUTER VISION - ECCV 2016, PT I, 2016, 9905 : 21 - 37
  • [19] Real-Time Object Detection for the Running Train Based on the Improved YOLO V4 Neural Network
    Liu, Yang
    Gao, Mengfei
    Zong, Humin
    Wang, Xinping
    Li, Jinshuang
    [J]. JOURNAL OF ADVANCED TRANSPORTATION, 2022, 2022
  • [20] Fast Automatic Vehicle Detection in UAV Images Using Convolutional Neural Networks
    Luo, Xin
    Tian, Xiaoyue
    Zhang, Huijie
    Hou, Weimin
    Leng, Geng
    Xu, Wenbo
    Jia, Haitao
    He, Xixu
    Wang, Meng
    Zhang, Jian
    [J]. REMOTE SENSING, 2020, 12 (12)