Object Detection in Remote Sensing Images Based on Adaptive Multi-Scale Feature Fusion Method

被引:14
|
作者
Liu, Chun [1 ]
Zhang, Sixuan [1 ]
Hu, Mengjie [1 ]
Song, Qing [1 ]
机构
[1] Beijing Univ Posts & Telecommun, Pattern Recognit & Intelligent Vis PRIV, Beijing 100876, Peoples R China
关键词
feature fusion; remote sensing; object detection; attention mechanism;
D O I
10.3390/rs16050907
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Multi-scale object detection is critical for analyzing remote sensing images. Traditional feature pyramid networks, which are aimed at accommodating objects of varying sizes through multi-level feature extraction, face significant challenges due to the diverse scale variations present in remote sensing images. This situation often forces single-level features to span a broad spectrum of object sizes, complicating accurate localization and classification. To tackle these challenges, this paper proposes an innovative algorithm that incorporates an adaptive multi-scale feature enhancement and fusion module (ASEM), which enhances remote sensing image object detection through sophisticated multi-scale feature fusion. Our method begins by employing a feature pyramid to gather coarse multi-scale features. Subsequently, it integrates a fine-grained feature extraction module at each level, utilizing atrous convolutions with varied dilation rates to refine multi-scale features, which markedly improves the information capture from widely varied object scales. Furthermore, an adaptive enhancement module is applied to the features of each level by employing an attention mechanism for feature fusion. This strategy concentrates on the features of critical scale, which significantly enhance the effectiveness of capturing essential feature information. Compared with the baseline method, namely, Rotated FasterRCNN, our method achieved an mAP of 74.21% ( 0.81%) on the DOTA-v1.0 dataset and an mAP of 84.90% (+9.2%) on the HRSC2016 dataset. These results validated the effectiveness and practicality of our method and demonstrated its significant application value in multi-scale remote sensing object detection tasks.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] A multi-scale pyramid feature fusion-based object detection method for remote sensing images
    Huangfu, Panpan
    Dang, Lanxue
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2023, 44 (24) : 7790 - 7807
  • [2] Research on Object Detection Algorithm for Remote Sensing Images Based on Multi-Scale Feature Fusion
    Xu, Siyuan
    Wu, Weilin
    Computer Engineering and Applications, 2024, 60 (23) : 249 - 256
  • [3] Remote Sensing Object Detection Method Based on Attention Mechanism and Multi-scale Feature Fusion
    Liu, Yang
    Xiao, Yewei
    2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 7155 - 7160
  • [4] BMF-CNN: an object detection method based on multi-scale feature fusion in VHR remote sensing images
    Dong, Zhong
    Lin, Baojun
    REMOTE SENSING LETTERS, 2020, 11 (03) : 215 - 224
  • [5] Small object detection in remote sensing images based on attention mechanism and multi-scale feature fusion
    Zhang, Li-guo
    Wang, Lei
    Jin, Mei
    Geng, Xing-shuo
    Shen, Qian
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2022, 43 (09) : 3280 - 3297
  • [6] Multi-scale object detection in UAV images based on adaptive feature fusion
    Tan, Siqi
    Duan, Zhijian
    Pu, Longzhong
    PLOS ONE, 2024, 19 (03):
  • [7] MULTI-SCALE FEATURE FUSION NETWORK FOR OBJECT DETECTION IN VHR OPTICAL REMOTE SENSING IMAGES
    Zhang, Wenhua
    Jiao, Licheng
    Liu, Xu
    Liu, Jia
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 330 - 333
  • [8] A Multi-Feature Fusion and Attention Network for Multi-Scale Object Detection in Remote Sensing Images
    Cheng, Yong
    Wang, Wei
    Zhang, Wenjie
    Yang, Ling
    Wang, Jun
    Ni, Huan
    Guan, Tingzhao
    He, Jiaxin
    Gu, Yakang
    Tran, Ngoc Nguyen
    REMOTE SENSING, 2023, 15 (08)
  • [9] Adaptive Orientation Object-Detection Method for Large-scale Remote Sensing Images Based on Multi-scale Block Fusion
    Wang, Yanli
    Dong, Zhipeng
    Wang, Mi
    Ding, Yi
    PHOTOGRAMMETRIC ENGINEERING AND REMOTE SENSING, 2025, 91 (01):
  • [10] Lightweight Multi-Scale Feature Fusion Network for Salient Object Detection in Optical Remote Sensing Images
    Li, Jun
    Huang, Kaigen
    ELECTRONICS, 2025, 14 (01):