Transformation-Invariant Network for Few-Shot Object Detection in Remote-Sensing Images

被引:16
|
作者
Liu, Nanqing [1 ]
Xu, Xun [1 ,2 ]
Celik, Turgay [1 ,3 ]
Gan, Zongxin [1 ]
Li, Heng-Chao [1 ]
机构
[1] Southwest Jiaotong Univ, Sch Informat Sci & Technol, Chengdu 611756, Peoples R China
[2] ASTAR, I2R, Singapore 138632, Singapore
[3] Univ Witwatersrand, Sch Elect & Informat Engn, ZA-2000 Johannesburg, South Africa
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2023年 / 61卷
基金
中国国家自然科学基金;
关键词
Object detection; Training; Remote sensing; Feature extraction; Task analysis; Metalearning; Airplanes; Few-shot learning; meta-learning; object detection; remote-sensing images (RSIs); transformation invariance;
D O I
10.1109/TGRS.2023.3332652
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Object detection in remote-sensing images (RSIs) relies on a large amount of labeled data for training. However, the increasing number of new categories and class imbalance make exhaustive annotation impractical. Few-shot object detection (FSOD) addresses this issue by leveraging meta-learning on seen base classes and fine-tuning on novel classes with limited labeled samples. Nonetheless, the substantial scale and orientation variations of objects in RSIs pose significant challenges to existing FSOD methods. To overcome these challenges, we propose integrating a feature pyramid network (FPN) and utilizing prototype features to enhance query features, thereby improving existing FSOD methods. We refer to this modified FSOD approach as a Strong Baseline, which has demonstrated significant performance improvements compared to the original baselines. Furthermore, we tackle the issue of spatial misalignment caused by orientation variations between the query and support images by introducing a transformation-invariant network (TINet). TINet ensures geometric invariance and explicitly aligns the features of the query and support branches, resulting in additional performance gains while maintaining the same inference speed as the Strong Baseline. Extensive experiments on three widely used remote-sensing object detection datasets, that is, NWPU VHR-10.v2, DIOR, and HRRSD demonstrated the effectiveness of the proposed method.
引用
收藏
页码:1 / 14
页数:14
相关论文
共 50 条
  • [1] Few-Shot Object Detection on Remote Sensing Images
    Li, Xiang
    Deng, Jingyu
    Fang, Yi
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [2] Discriminative Prototype Learning for Few-Shot Object Detection in Remote-Sensing Images
    Guo, Manke
    You, Yanan
    Liu, Fang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61 : 1 - 13
  • [3] Few-Shot Object Detection With Self-Adaptive Attention Network for Remote Sensing Images
    Xiao, Zixuan
    Qi, Jiahao
    Xue, Wei
    Zhong, Ping
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 4854 - 4865
  • [4] Prototype-CNN for Few-Shot Object Detection in Remote Sensing Images
    Cheng, Gong
    Yan, Bowei
    Shi, Peizhen
    Li, Ke
    Yao, Xiwen
    Guo, Lei
    Han, Junwei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [5] InfRS: Incremental Few-Shot Object Detection in Remote Sensing Images
    Li, Wuzhou
    Zhou, Jiawei
    Li, Xiang
    Cao, Yi
    Jin, Guang
    Zhang, Xuemin
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [6] Arbitrary Oriented Few-Shot Object Detection in Remote Sensing Images
    Wu, Wei
    Jiang, Chengeng
    Yang, Liao
    Wang, Weisheng
    Chen, Quanjun
    Zhang, Junjian
    Yang, Haiping
    Chen, Zuohui
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 17930 - 17944
  • [7] Few-Shot Object Detection in Remote-Sensing Images via Label-Consistent Classifier and Gradual Regression
    Liu, Yanxing
    Pan, Zongxu
    Yang, Jianwei
    Zhang, Bingchen
    Zhou, Guangyao
    Hu, Yuxin
    Ye, Qixiang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 14
  • [8] Few-Shot Object Detection via Context-Aware Aggregation for Remote Sensing Images
    Zhou, Yong
    Hu, Han
    Zhao, Jiaqi
    Zhu, Hancheng
    Yao, Rui
    Du, Wen-Liang
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [9] Few-Shot Object Detection of Remote Sensing Images via Two-Stage Fine-Tuning
    Zhao, Zhitao
    Tang, Ping
    Zhao, Lijun
    Zhang, Zheng
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [10] Multiscale Feature Knowledge Distillation and Implicit Object Discovery for Few-Shot Object Detection in Remote Sensing Images
    Chen, Jie
    Guo, Ya
    Qin, Dengda
    Zhu, Jingru
    Gou, Zhenbo
    Sun, Geng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63