Transformation-Invariant Network for Few-Shot Object Detection in Remote-Sensing Images

被引:16
|
作者
Liu, Nanqing [1 ]
Xu, Xun [1 ,2 ]
Celik, Turgay [1 ,3 ]
Gan, Zongxin [1 ]
Li, Heng-Chao [1 ]
机构
[1] Southwest Jiaotong Univ, Sch Informat Sci & Technol, Chengdu 611756, Peoples R China
[2] ASTAR, I2R, Singapore 138632, Singapore
[3] Univ Witwatersrand, Sch Elect & Informat Engn, ZA-2000 Johannesburg, South Africa
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2023年 / 61卷
基金
中国国家自然科学基金;
关键词
Object detection; Training; Remote sensing; Feature extraction; Task analysis; Metalearning; Airplanes; Few-shot learning; meta-learning; object detection; remote-sensing images (RSIs); transformation invariance;
D O I
10.1109/TGRS.2023.3332652
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Object detection in remote-sensing images (RSIs) relies on a large amount of labeled data for training. However, the increasing number of new categories and class imbalance make exhaustive annotation impractical. Few-shot object detection (FSOD) addresses this issue by leveraging meta-learning on seen base classes and fine-tuning on novel classes with limited labeled samples. Nonetheless, the substantial scale and orientation variations of objects in RSIs pose significant challenges to existing FSOD methods. To overcome these challenges, we propose integrating a feature pyramid network (FPN) and utilizing prototype features to enhance query features, thereby improving existing FSOD methods. We refer to this modified FSOD approach as a Strong Baseline, which has demonstrated significant performance improvements compared to the original baselines. Furthermore, we tackle the issue of spatial misalignment caused by orientation variations between the query and support images by introducing a transformation-invariant network (TINet). TINet ensures geometric invariance and explicitly aligns the features of the query and support branches, resulting in additional performance gains while maintaining the same inference speed as the Strong Baseline. Extensive experiments on three widely used remote-sensing object detection datasets, that is, NWPU VHR-10.v2, DIOR, and HRRSD demonstrated the effectiveness of the proposed method.
引用
收藏
页码:1 / 14
页数:14
相关论文
共 50 条
  • [41] Learning to Cooperate: Decision Fusion Method for Few-Shot Remote-Sensing Scene Classification
    Xing, Lei
    Shao, Shuai
    Ma, Yuteng
    Wang, Yanjiang
    Liu, Weifeng
    Liu, Baodi
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [42] Balanced Orthogonal Subspace Separation Detector for Few-Shot Object Detection in Aerial Imagery
    Jiang, Hongxiang
    Wang, Qixiong
    Feng, Jiaqi
    Zhang, Guangyun
    Yin, Jihao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [43] Few-Shot Object Detection in Remote Sensing Image Interpretation: Opportunities and Challenges
    Liu, Sixu
    You, Yanan
    Su, Haozheng
    Meng, Gang
    Yang, Wei
    Liu, Fang
    REMOTE SENSING, 2022, 14 (18)
  • [44] GFENet: Generalization Feature Extraction Network for Few-Shot Object Detection
    Ke, Xiao
    Chen, Qiuqin
    Liu, Hao
    Guo, Wenzhong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (12) : 12741 - 12755
  • [45] Multi-scale Self-attention-based Few-shot Object Detection for Remote Sensing Images
    Wang, Run
    Wang, Qiong
    Yu, Jiawei
    Tong, Jiaxing
    2022 IEEE 24TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2022,
  • [46] Research Progress on Few-Shot Learning for Remote Sensing Image Interpretation
    Sun, Xian
    Wang, Bing
    Wang, Zhirui
    Li, Hao
    Li, Hengchao
    Fu, Kun
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 2387 - 2402
  • [47] Generalized Few-Shot Semantic Segmentation for Remote Sensing Images
    Jia, Yuyu
    Li, Jiabo
    Wang, Qi
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
  • [48] DMML-Net: Deep Metametric Learning for Few-Shot Geographic Object Segmentation in Remote Sensing Imagery
    Wang, Bing
    Wang, Zhirui
    Sun, Xian
    Wang, Hongqi
    Fu, Kun
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [49] Masked Second-Order Pooling for Few-Shot Remote-Sensing Scene Classification
    Deng, Jianan
    Wang, Qianli
    Liu, Nanqing
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5
  • [50] Few-Shot Scene Classification With Multi-Attention Deepemd Network in Remote Sensing
    Yuan, Zhengwu
    Huang, Wendong
    Li, Lin
    Luo, Xiaobo
    IEEE ACCESS, 2021, 9 : 19891 - 19901