Few-Shot Object Detection Based on Contrastive Class-Attention Feature Reweighting for Remote Sensing Images

被引:1
|
作者
Miao, Wang [1 ]
Zhao, Zihao [1 ]
Geng, Jie [1 ]
Jiang, Wen [1 ]
机构
[1] Northwest ern Polytech Univ, Sch Elect & Informat, Xian 710129, Peoples R China
基金
中国国家自然科学基金;
关键词
Class-attention reweighting; contrastive learning; few-shot object detection (FSOD); remote sensing image; BIG DATA; CLASSIFICATION; ADAPTATION;
D O I
10.1109/JSTARS.2023.3347561
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Remote sensing image object detection with deep neural networks has been highly successful, but it heavily relies on a large number of labeled samples for optimal performance. Unfortunately, when faced with limited labeled samples, the performance of object detection deteriorates. In order to overcome these limitations, we propose a few-shot object detection (FSOD) method based on the reweighting of contrastive class-attention features for remote sensing images. A Siamese representation embedding model based on contrastive learning with a distinguishing operator is proposed to deal with interclass feature ambiguity between base classes and novel classes under complex backgrounds. At the same time, the attention class weights method on region of interest (ROI) features is utilized to boost the discrimination of the novel class features. We conducted comprehensive experiments on two widely used remote sensing object detection datasets, RSOD and DIOR. The proposed FSOD model demonstrated superior performance compared to MM-RCNN, achieving an improvement of approximately 4.7% in terms of mAP on the DIOR dataset. In addition, in comparison to the self-adaptive attention network (SAAN), the FSOD model exhibited an improvement of approximately 3.4% in mAP on the RSOD dataset.
引用
收藏
页码:2800 / 2814
页数:15
相关论文
共 50 条
  • [41] Object Detection of Remote Sensing Image Based on Multi-Scale Feature Fusion and Attention Mechanism
    Du, Zuoqiang
    Liang, Yuan
    IEEE ACCESS, 2024, 12 : 8619 - 8632
  • [42] Foreground Feature Attention Module Based on Unsupervised Saliency Detector for Few-Shot Learning
    Kong, Zhengmin
    Fu, Zhuolin
    Xiong, Feng
    Zhang, Chenggang
    IEEE ACCESS, 2021, 9 : 51179 - 51188
  • [43] Adaptive Composite Feature Generation for Object Detection in Remote Sensing Images
    Zhang, Ziye
    Mei, Shaohui
    Ma, Mingyang
    Han, Zonghao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [44] A Few-Shot Learning Method for SAR Images Based on Weighted Distance and Feature Fusion
    Gao, Fei
    Xu, Jingming
    Lang, Rongling
    Wang, Jun
    Hussain, Amir
    Zhou, Huiyu
    REMOTE SENSING, 2022, 14 (18)
  • [45] DMML-Net: Deep Metametric Learning for Few-Shot Geographic Object Segmentation in Remote Sensing Imagery
    Wang, Bing
    Wang, Zhirui
    Sun, Xian
    Wang, Hongqi
    Fu, Kun
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [46] Object Detection Based on Adaptive Feature-Aware Method in Optical Remote Sensing Images
    Wang, Jiaqi
    Gong, Zhihui
    Liu, Xiangyun
    Guo, Haitao
    Yu, Donghang
    Ding, Lei
    REMOTE SENSING, 2022, 14 (15)
  • [47] Multimodal Deep Learning-based Feature Fusion for Object Detection in Remote Sensing Images
    Yin, Shoulin
    Wang, Qunming
    Wang, Liguo
    Ivanovic, Mirjana
    Li, Hang
    COMPUTER SCIENCE AND INFORMATION SYSTEMS, 2025, 22 (01) : 327 - 344
  • [48] CLOUD DETECTION METHOD BASED ON FEATURE EXTRACTION IN REMOTE SENSING IMAGES
    Yu Changhui
    Yuan Yuan
    Miao Minjing
    Zhu Menglu
    8TH INTERNATIONAL SYMPOSIUM ON SPATIAL DATA QUALITY, 2013, 40-2 (w1): : 173 - 177
  • [49] Deep-Feature-Based Autoencoder Network for Few-Shot Malicious Traffic Detection
    He, Mingshu
    Wang, Xiaojuan
    Zhou, Junhua
    Xi, Yuanyuan
    Jin, Lei
    Wang, Xinlei
    SECURITY AND COMMUNICATION NETWORKS, 2021, 2021
  • [50] An Efficient Few-Shot Object Detection Method for Railway Intrusion via Fine-Tune Approach and Contrastive Learning
    Ye, Tao
    Zheng, Zhikang
    Li, Xiaosong
    Zhao, Zongyang
    Gao, Xiao-Zhi
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72