Retentive Compensation and Personality Filtering for Few-Shot Remote Sensing Object Detection

被引:5
作者
Wu, Jiashan [1 ]
Lang, Chunbo [1 ]
Cheng, Gong [1 ]
Xie, Xingxing [1 ]
Han, Junwei [1 ]
机构
[1] Northwestern Polytech Univ, Sch Automat, Xian 710129, Peoples R China
基金
美国国家科学基金会;
关键词
Remote sensing; Prototypes; Object detection; Task analysis; Filtering; Training; Satellite images; Few-shot object detection; remote sensing; fine-tuning; metric learning; TERM;
D O I
10.1109/TCSVT.2024.3367168
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In recent years, few-shot object detection (FSOD) in remote sensing images has attracted increasing attention. Numerous studies address the challenges posed by both intra-class and inter-class variance through strategies such as augmenting sample diversity and incorporating multi-scale features. However, these features still encompass a considerable amount of noise attributes due to the complex characteristic of satellite images, persistently and adversely affecting classification. In contrast, we advocate for the belief that a limited yet refined set of features surpasses a multitude of coarse features. Accordingly, we tackle above issues through the meticulous refinement of representative category features, enhancing performance by eliminating irrelevant attributes that interfere with classification. Specifically, two pivotal modules: retentive compensation module (RCM) and personality filtering module (PFM), are introduced. The former module RCM systematically scrutinizes features proximate to the category center, yielding prototypes that exhibit both intra-class compactness and inter-class distinctiveness. Furthermore, the latter module PFM utilizes previous obtained prototypes to supervise the filtering process, diminishing the intra-class variance by excluding personality features which could impede the classification task. The integration of the above two modules enables a holistic feature representation, capturing inherent similarities within individual classes while accentuating distinctions between classes. Experiments have been conducted on the DIOR and NWPU VHR-10.v2 datasets, and the results demonstrate that our proposed approach exceeds several state-of-the-art methods. Code is available at https://github.com/yomik-js/RP-FSOD.
引用
收藏
页码:5805 / 5817
页数:13
相关论文
共 63 条
  • [11] Remote Sensing Image Scene Classification: Benchmark and State of the Art
    Cheng, Gong
    Han, Junwei
    Lu, Xiaoqiang
    [J]. PROCEEDINGS OF THE IEEE, 2017, 105 (10) : 1865 - 1883
  • [12] Multi-class geospatial object detection and geographic image classification based on collection of part detectors
    Cheng, Gong
    Han, Junwei
    Zhou, Peicheng
    Guo, Lei
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2014, 98 : 119 - 132
  • [13] Cheng X., 2022, IEEE Trans. Circuits Syst. Video Technol., P1
  • [14] Geng J., 2023, IEEE T CIRCUITS SYST, P1
  • [15] Han GX, 2022, AAAI CONF ARTIF INTE, P780
  • [16] Deep Residual Learning for Image Recognition
    He, Kaiming
    Zhang, Xiangyu
    Ren, Shaoqing
    Sun, Jian
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 770 - 778
  • [17] Hsieh TI, 2019, ADV NEUR IN, V32
  • [18] IRA-FSOD: Instant-Response and Accurate Few-Shot Object Detector
    Huang, Junying
    Cao, Junhao
    Lin, Liang
    Zhang, Dongyu
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (11) : 6912 - 6923
  • [19] Dynamic Harris Hawks Optimization with Mutation Mechanism for Satellite Image Segmentation
    Jia, Heming
    Lang, Chunbo
    Oliva, Diego
    Song, Wenlong
    Peng, Xiaoxu
    [J]. REMOTE SENSING, 2019, 11 (12)
  • [20] Few-shot Object Detection via Feature Reweighting
    Kang, Bingyi
    Liu, Zhuang
    Wang, Xin
    Yu, Fisher
    Feng, Jiashi
    Darrell, Trevor
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 8419 - 8428