Few-Shot Object Detection Based on Contrastive Class-Attention Feature Reweighting for Remote Sensing Images

被引:1
|
作者
Miao, Wang [1 ]
Zhao, Zihao [1 ]
Geng, Jie [1 ]
Jiang, Wen [1 ]
机构
[1] Northwest ern Polytech Univ, Sch Elect & Informat, Xian 710129, Peoples R China
基金
中国国家自然科学基金;
关键词
Class-attention reweighting; contrastive learning; few-shot object detection (FSOD); remote sensing image; BIG DATA; CLASSIFICATION; ADAPTATION;
D O I
10.1109/JSTARS.2023.3347561
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Remote sensing image object detection with deep neural networks has been highly successful, but it heavily relies on a large number of labeled samples for optimal performance. Unfortunately, when faced with limited labeled samples, the performance of object detection deteriorates. In order to overcome these limitations, we propose a few-shot object detection (FSOD) method based on the reweighting of contrastive class-attention features for remote sensing images. A Siamese representation embedding model based on contrastive learning with a distinguishing operator is proposed to deal with interclass feature ambiguity between base classes and novel classes under complex backgrounds. At the same time, the attention class weights method on region of interest (ROI) features is utilized to boost the discrimination of the novel class features. We conducted comprehensive experiments on two widely used remote sensing object detection datasets, RSOD and DIOR. The proposed FSOD model demonstrated superior performance compared to MM-RCNN, achieving an improvement of approximately 4.7% in terms of mAP on the DIOR dataset. In addition, in comparison to the self-adaptive attention network (SAAN), the FSOD model exhibited an improvement of approximately 3.4% in mAP on the RSOD dataset.
引用
收藏
页码:2800 / 2814
页数:15
相关论文
共 50 条
  • [21] Mutually Reinforcing Structure with Proposal Contrastive Consistency for Few-Shot Object Detection
    Ma, Tianxue
    Bi, Mingwei
    Zhang, Jian
    Yuan, Wang
    Zhang, Zhizhong
    Xie, Yuan
    Ding, Shouhong
    Ma, Lizhuang
    COMPUTER VISION, ECCV 2022, PT XX, 2022, 13680 : 400 - 416
  • [22] Object Detection in Remote Sensing Images by Combining Feature Enhancement and Hybrid Attention
    Zheng, Jin
    Wang, Tong
    Zhang, Zhi
    Wang, Hongwei
    APPLIED SCIENCES-BASEL, 2022, 12 (12):
  • [23] Multiscale Object Contrastive Learning-Derived Few-Shot Object Detection in VHR Imagery
    Chen, Jie
    Qin, Dengda
    Hou, Dongyang
    Zhang, Jun
    Deng, Min
    Sun, Geng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [24] Few-Shot Object Detection in Remote Sensing Imagery via Fuse Context Dependencies and Global Features
    Wang, Bin
    Ma, Guorui
    Sui, Haigang
    Zhang, Yongxian
    Zhang, Haiming
    Zhou, Yuan
    REMOTE SENSING, 2023, 15 (14)
  • [25] Object detection in remote sensing images based on region mask contrastive distillation
    Jie Z.
    Zilong Z.
    Yan L.
    Rui L.
    Manyan Z.
    Dongnan Daxue Xuebao (Ziran Kexue Ban)/Journal of Southeast University (Natural Science Edition), 2024, 54 (03): : 761 - 771
  • [26] ODCL: An Object Disentanglement and Contrastive Learning Model for Few-Shot Industrial Defect Detection
    Li, Guodong
    Peng, Furong
    Wu, Zhisheng
    Wang, Sheng
    Xu, Richard Yi Da
    IEEE SENSORS JOURNAL, 2024, 24 (11) : 18568 - 18577
  • [27] Defect Detection for Wear Debris Based on Few-Shot Contrastive Learning
    Li, Hang
    Li, Li
    Wang, Hongbing
    APPLIED SCIENCES-BASEL, 2022, 12 (23):
  • [28] Foreground-Background Contrastive Learning for Few-Shot Remote Sensing Image Scene Classification
    Geng, Jie
    Xue, Bohan
    Jiang, Wen
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [29] Self-Supervised Feature Representation and Few-Shot Land Cover Classification of Multimodal Remote Sensing Images
    Xue, Zhixiang
    Liu, Bing
    Yu, Anzhu
    Yu, Xuchu
    Zhang, Pengqiang
    Tan, Xiong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [30] Feature reassembly and self-attention for oriented object detection in remote sensing images
    Min L.
    Fan Z.
    Xie X.
    Lyu Q.
    National Remote Sensing Bulletin, 2023, 27 (12) : 2716 - 2725