Retentive Compensation and Personality Filtering for Few-Shot Remote Sensing Object Detection

被引:5
作者
Wu, Jiashan [1 ]
Lang, Chunbo [1 ]
Cheng, Gong [1 ]
Xie, Xingxing [1 ]
Han, Junwei [1 ]
机构
[1] Northwestern Polytech Univ, Sch Automat, Xian 710129, Peoples R China
基金
美国国家科学基金会;
关键词
Remote sensing; Prototypes; Object detection; Task analysis; Filtering; Training; Satellite images; Few-shot object detection; remote sensing; fine-tuning; metric learning; TERM;
D O I
10.1109/TCSVT.2024.3367168
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In recent years, few-shot object detection (FSOD) in remote sensing images has attracted increasing attention. Numerous studies address the challenges posed by both intra-class and inter-class variance through strategies such as augmenting sample diversity and incorporating multi-scale features. However, these features still encompass a considerable amount of noise attributes due to the complex characteristic of satellite images, persistently and adversely affecting classification. In contrast, we advocate for the belief that a limited yet refined set of features surpasses a multitude of coarse features. Accordingly, we tackle above issues through the meticulous refinement of representative category features, enhancing performance by eliminating irrelevant attributes that interfere with classification. Specifically, two pivotal modules: retentive compensation module (RCM) and personality filtering module (PFM), are introduced. The former module RCM systematically scrutinizes features proximate to the category center, yielding prototypes that exhibit both intra-class compactness and inter-class distinctiveness. Furthermore, the latter module PFM utilizes previous obtained prototypes to supervise the filtering process, diminishing the intra-class variance by excluding personality features which could impede the classification task. The integration of the above two modules enables a holistic feature representation, capturing inherent similarities within individual classes while accentuating distinctions between classes. Experiments have been conducted on the DIOR and NWPU VHR-10.v2 datasets, and the results demonstrate that our proposed approach exceeds several state-of-the-art methods. Code is available at https://github.com/yomik-js/RP-FSOD.
引用
收藏
页码:5805 / 5817
页数:13
相关论文
共 63 条
  • [1] Chen H., 2023, IEEE T CIRCUITS SYST
  • [2] Multiscale Object Contrastive Learning-Derived Few-Shot Object Detection in VHR Imagery
    Chen, Jie
    Qin, Dengda
    Hou, Dongyang
    Zhang, Jun
    Deng, Min
    Sun, Geng
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [3] High-Quality R-CNN Object Detection Using Multi-Path Detection Calibration Network
    Chen, Xiaoyu
    Li, Hongliang
    Wu, Qingbo
    Ngan, King Ngi
    Xu, Linfeng
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (02) : 715 - 727
  • [4] SFRNet: Fine-Grained Oriented Object Recognition via Separate Feature Refinement
    Cheng, Gong
    Li, Qingyang
    Wang, Guangxing
    Xie, Xingxing
    Min, Lingtong
    Han, Junwei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [5] Class attention network for image recognition
    Cheng, Gong
    Lai, Pujian
    Gao, Decheng
    Han, Junwei
    [J]. SCIENCE CHINA-INFORMATION SCIENCES, 2023, 66 (03)
  • [6] Holistic Prototype Activation for Few-Shot Segmentation
    Cheng, Gong
    Lang, Chunbo
    Han, Junwei
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (04) : 4650 - 4666
  • [7] SPNet: Siamese-Prototype Network for Few-Shot Remote Sensing Image Scene Classification
    Cheng, Gong
    Cai, Liming
    Lang, Chunbo
    Yao, Xiwen
    Chen, Jinyong
    Guo, Lei
    Han, Junwei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [8] Prototype-CNN for Few-Shot Object Detection in Remote Sensing Images
    Cheng, Gong
    Yan, Bowei
    Shi, Peizhen
    Li, Ke
    Yao, Xiwen
    Guo, Lei
    Han, Junwei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [9] Feature Enhancement Network for Object Detection in Optical Remote Sensing Images
    Cheng, Gong
    Lang, Chunbo
    Wu, Maoxiong
    Xie, Xingxing
    Yao, Xiwen
    Han, Junwei
    [J]. JOURNAL OF REMOTE SENSING, 2021, 2021
  • [10] Task-wise attention guided part complementary learning for few-shot image classification
    Cheng, Gong
    Li, Ruimin
    Lang, Chunbo
    Han, Junwei
    [J]. SCIENCE CHINA-INFORMATION SCIENCES, 2021, 64 (02)