Enhanced few-shot object detection for remote sensing images based on target characteristics

被引:0
作者
Wang, Jian [1 ]
Zhao, Zeya [2 ]
Shao, Jiang [1 ]
Zou, Xiaochun [3 ]
Zhao, Xinbo [1 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, Xian 710072, Peoples R China
[2] Beijing Inst Tracking & Commun Technol, Beijing 100094, Peoples R China
[3] Northwestern Polytech Univ, Sch Elect & Informat, Xian 710072, Peoples R China
关键词
Few-shot object detection; Remote sensing images; Object detection; Target characteristics;
D O I
10.1016/j.engappai.2025.110315
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Few-shot object detection (FSOD) in remote sensing images (RSIs) is a challenging and hot issue due to the characteristics of targets in remote sensing images such as varying sizes, complex backgrounds, target occlusions, and unbalanced target categories. Two-stage fine-tuning approach (TFA) has been shown to be the most competitive approach for few-shot learning. However, previous methods of fine-tuning remote sensing images using single-feature improvements had a limited effect on the result. In this paper, we propose a novel few-shot object detection method that coordinates multiple methods to gradually improve detection accuracy by focusing on the characteristics of remote sensing targets. More specifically, our model contains three main components: a novel context-aware weighted feature fusion module (CA-WFFM) that enhances the discrimination between background and foreground structures in complex scenarios, an edge detection block (EDB), which combines handcrafted features, that enhances the stability of the network when the target is occluded or the sample is limited, and a selective random neighborhood oversampling (SRNO) strategy, that balances the base and novel category samples. These coordinated improvements were evaluated using the Drones In Optics Recognition (DIOR) and NWPU-VHR-10.v2 (VHR-10.v2) datasets with multiple training sample splits. Experimental results indicate that our method surpasses existing methods in novel class detection and also provides a new research approach for few-shot object detection. This involves designing algorithms based on target characteristics to enhance the overall detection capability of few-shot object detection models.
引用
收藏
页数:16
相关论文
共 43 条
[1]   Cascade R-CNN: Delving into High Quality Object Detection [J].
Cai, Zhaowei ;
Vasconcelos, Nuno .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :6154-6162
[2]  
Cheng G., 2023, IEEE Trans. Geosci. Remote Sens., V60
[3]   Learning Rotation-Invariant Convolutional Neural Networks for Object Detection in VHR Optical Remote Sensing Images [J].
Cheng, Gong ;
Zhou, Peicheng ;
Han, Junwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2016, 54 (12) :7405-7415
[4]   Attention-Based Multi-Level Feature Fusion for Object Detection in Remote Sensing Images [J].
Dong, Xiaohu ;
Qin, Yao ;
Gao, Yinghui ;
Fu, Ruigang ;
Liu, Songlin ;
Ye, Yuanxin .
REMOTE SENSING, 2022, 14 (15)
[5]  
Finn C, 2017, PR MACH LEARN RES, V70
[6]   Rich feature hierarchies for accurate object detection and semantic segmentation [J].
Girshick, Ross ;
Donahue, Jeff ;
Darrell, Trevor ;
Malik, Jitendra .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :580-587
[7]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
[8]   Multi-strategy multi-objective differential evolutionary algorithm with reinforcement learning [J].
Han, Yupeng ;
Peng, Hu ;
Mei, Changrong ;
Cao, Lianglin ;
Deng, Changshou ;
Wang, Hui ;
Wu, Zhijian .
KNOWLEDGE-BASED SYSTEMS, 2023, 277
[9]   Low-shot Visual Recognition by Shrinking and Hallucinating Features [J].
Hariharan, Bharath ;
Girshick, Ross .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :3037-3046
[10]   Learning Rotated Inscribed Ellipse for Oriented Object Detection in Remote Sensing Images [J].
He, Xu ;
Ma, Shiping ;
He, Linyuan ;
Ru, Le ;
Wang, Chen .
REMOTE SENSING, 2021, 13 (18)