Retentive Compensation and Personality Filtering for Few-Shot Remote Sensing Object Detection

被引:12
作者
Wu, Jiashan [1 ]
Lang, Chunbo [1 ]
Cheng, Gong [1 ]
Xie, Xingxing [1 ]
Han, Junwei [1 ]
机构
[1] Northwestern Polytech Univ, Sch Automat, Xian 710129, Peoples R China
基金
美国国家科学基金会;
关键词
Remote sensing; Prototypes; Object detection; Task analysis; Filtering; Training; Satellite images; Few-shot object detection; remote sensing; fine-tuning; metric learning; TERM;
D O I
10.1109/TCSVT.2024.3367168
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In recent years, few-shot object detection (FSOD) in remote sensing images has attracted increasing attention. Numerous studies address the challenges posed by both intra-class and inter-class variance through strategies such as augmenting sample diversity and incorporating multi-scale features. However, these features still encompass a considerable amount of noise attributes due to the complex characteristic of satellite images, persistently and adversely affecting classification. In contrast, we advocate for the belief that a limited yet refined set of features surpasses a multitude of coarse features. Accordingly, we tackle above issues through the meticulous refinement of representative category features, enhancing performance by eliminating irrelevant attributes that interfere with classification. Specifically, two pivotal modules: retentive compensation module (RCM) and personality filtering module (PFM), are introduced. The former module RCM systematically scrutinizes features proximate to the category center, yielding prototypes that exhibit both intra-class compactness and inter-class distinctiveness. Furthermore, the latter module PFM utilizes previous obtained prototypes to supervise the filtering process, diminishing the intra-class variance by excluding personality features which could impede the classification task. The integration of the above two modules enables a holistic feature representation, capturing inherent similarities within individual classes while accentuating distinctions between classes. Experiments have been conducted on the DIOR and NWPU VHR-10.v2 datasets, and the results demonstrate that our proposed approach exceeds several state-of-the-art methods. Code is available at https://github.com/yomik-js/RP-FSOD.
引用
收藏
页码:5805 / 5817
页数:13
相关论文
共 63 条
[1]  
Chen H., 2023, IEEE T CIRCUITS SYST
[2]   Multiscale Object Contrastive Learning-Derived Few-Shot Object Detection in VHR Imagery [J].
Chen, Jie ;
Qin, Dengda ;
Hou, Dongyang ;
Zhang, Jun ;
Deng, Min ;
Sun, Geng .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[3]   High-Quality R-CNN Object Detection Using Multi-Path Detection Calibration Network [J].
Chen, Xiaoyu ;
Li, Hongliang ;
Wu, Qingbo ;
Ngan, King Ngi ;
Xu, Linfeng .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (02) :715-727
[4]   SFRNet: Fine-Grained Oriented Object Recognition via Separate Feature Refinement [J].
Cheng, Gong ;
Li, Qingyang ;
Wang, Guangxing ;
Xie, Xingxing ;
Min, Lingtong ;
Han, Junwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
[5]   Class attention network for image recognition [J].
Cheng, Gong ;
Lai, Pujian ;
Gao, Decheng ;
Han, Junwei .
SCIENCE CHINA-INFORMATION SCIENCES, 2023, 66 (03)
[6]   Holistic Prototype Activation for Few-Shot Segmentation [J].
Cheng, Gong ;
Lang, Chunbo ;
Han, Junwei .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (04) :4650-4666
[7]   SPNet: Siamese-Prototype Network for Few-Shot Remote Sensing Image Scene Classification [J].
Cheng, Gong ;
Cai, Liming ;
Lang, Chunbo ;
Yao, Xiwen ;
Chen, Jinyong ;
Guo, Lei ;
Han, Junwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[8]   Prototype-CNN for Few-Shot Object Detection in Remote Sensing Images [J].
Cheng, Gong ;
Yan, Bowei ;
Shi, Peizhen ;
Li, Ke ;
Yao, Xiwen ;
Guo, Lei ;
Han, Junwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[9]   Feature Enhancement Network for Object Detection in Optical Remote Sensing Images [J].
Cheng, Gong ;
Lang, Chunbo ;
Wu, Maoxiong ;
Xie, Xingxing ;
Yao, Xiwen ;
Han, Junwei .
JOURNAL OF REMOTE SENSING, 2021, 2021
[10]   Task-wise attention guided part complementary learning for few-shot image classification [J].
Cheng, Gong ;
Li, Ruimin ;
Lang, Chunbo ;
Han, Junwei .
SCIENCE CHINA-INFORMATION SCIENCES, 2021, 64 (02)