Few-Shot Object Detection Based on Contrastive Class-Attention Feature Reweighting for Remote Sensing Images

被引:1
|
作者
Miao, Wang [1 ]
Zhao, Zihao [1 ]
Geng, Jie [1 ]
Jiang, Wen [1 ]
机构
[1] Northwest ern Polytech Univ, Sch Elect & Informat, Xian 710129, Peoples R China
基金
中国国家自然科学基金;
关键词
Class-attention reweighting; contrastive learning; few-shot object detection (FSOD); remote sensing image; BIG DATA; CLASSIFICATION; ADAPTATION;
D O I
10.1109/JSTARS.2023.3347561
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Remote sensing image object detection with deep neural networks has been highly successful, but it heavily relies on a large number of labeled samples for optimal performance. Unfortunately, when faced with limited labeled samples, the performance of object detection deteriorates. In order to overcome these limitations, we propose a few-shot object detection (FSOD) method based on the reweighting of contrastive class-attention features for remote sensing images. A Siamese representation embedding model based on contrastive learning with a distinguishing operator is proposed to deal with interclass feature ambiguity between base classes and novel classes under complex backgrounds. At the same time, the attention class weights method on region of interest (ROI) features is utilized to boost the discrimination of the novel class features. We conducted comprehensive experiments on two widely used remote sensing object detection datasets, RSOD and DIOR. The proposed FSOD model demonstrated superior performance compared to MM-RCNN, achieving an improvement of approximately 4.7% in terms of mAP on the DIOR dataset. In addition, in comparison to the self-adaptive attention network (SAAN), the FSOD model exhibited an improvement of approximately 3.4% in mAP on the RSOD dataset.
引用
收藏
页码:2800 / 2814
页数:15
相关论文
共 50 条
  • [1] Few-Shot Object Detection on Remote Sensing Images
    Li, Xiang
    Deng, Jingyu
    Fang, Yi
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [2] Few-Shot Object Detection via Transfer Learning and Contrastive Reweighting
    Wu, Zhen
    Li, Haowei
    Zhang, Dongyu
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT VII, 2023, 14260 : 78 - 87
  • [3] Few-Shot Object Detection With Self-Adaptive Attention Network for Remote Sensing Images
    Xiao, Zixuan
    Qi, Jiahao
    Xue, Wei
    Zhong, Ping
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 4854 - 4865
  • [4] InfRS: Incremental Few-Shot Object Detection in Remote Sensing Images
    Li, Wuzhou
    Zhou, Jiawei
    Li, Xiang
    Cao, Yi
    Jin, Guang
    Zhang, Xuemin
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [5] Multiscale Feature Knowledge Distillation and Implicit Object Discovery for Few-Shot Object Detection in Remote Sensing Images
    Chen, Jie
    Guo, Ya
    Qin, Dengda
    Zhu, Jingru
    Gou, Zhenbo
    Sun, Geng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
  • [6] Attention-Based Contrastive Learning for Few-Shot Remote Sensing Image Classification
    Xu, Yulong
    Bi, Hanbo
    Yu, Hongfeng
    Lu, Wanxuan
    Li, Peifeng
    Li, Xinming
    Sun, Xian
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [7] Few-Shot Object Detection With Multilevel Information Interaction for Optical Remote Sensing Images
    Wang, Lefan
    Mei, Shaohui
    Wang, Yi
    Lian, Jiawei
    Han, Zonghao
    Chen, Xiaoning
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [8] Few-Shot Multi-Class Ship Detection in Remote Sensing Images Using Attention Feature Map and Multi-Relation Detector
    Zhang, Haopeng
    Zhang, Xingyu
    Meng, Gang
    Guo, Chen
    Jiang, Zhiguo
    REMOTE SENSING, 2022, 14 (12)
  • [9] Balancing Attention to Base and Novel Categories for Few-Shot Object Detection in Remote Sensing Imagery
    Zhu, Zining
    Wang, Peijin
    Diao, Wenhui
    Yang, Jinze
    Kong, Lingyu
    Wang, Hongqi
    Sun, Xian
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
  • [10] Few-shot Object Detection with Refined Contrastive Learning
    Shangguan, Zeyu
    Huai, Lian
    Liu, Tong
    Jiang, Xingqun
    2023 IEEE 35TH INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE, ICTAI, 2023, : 991 - 996