Transformation-Invariant Network for Few-Shot Object Detection in Remote-Sensing Images

被引:16
|
作者
Liu, Nanqing [1 ]
Xu, Xun [1 ,2 ]
Celik, Turgay [1 ,3 ]
Gan, Zongxin [1 ]
Li, Heng-Chao [1 ]
机构
[1] Southwest Jiaotong Univ, Sch Informat Sci & Technol, Chengdu 611756, Peoples R China
[2] ASTAR, I2R, Singapore 138632, Singapore
[3] Univ Witwatersrand, Sch Elect & Informat Engn, ZA-2000 Johannesburg, South Africa
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2023年 / 61卷
基金
中国国家自然科学基金;
关键词
Object detection; Training; Remote sensing; Feature extraction; Task analysis; Metalearning; Airplanes; Few-shot learning; meta-learning; object detection; remote-sensing images (RSIs); transformation invariance;
D O I
10.1109/TGRS.2023.3332652
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Object detection in remote-sensing images (RSIs) relies on a large amount of labeled data for training. However, the increasing number of new categories and class imbalance make exhaustive annotation impractical. Few-shot object detection (FSOD) addresses this issue by leveraging meta-learning on seen base classes and fine-tuning on novel classes with limited labeled samples. Nonetheless, the substantial scale and orientation variations of objects in RSIs pose significant challenges to existing FSOD methods. To overcome these challenges, we propose integrating a feature pyramid network (FPN) and utilizing prototype features to enhance query features, thereby improving existing FSOD methods. We refer to this modified FSOD approach as a Strong Baseline, which has demonstrated significant performance improvements compared to the original baselines. Furthermore, we tackle the issue of spatial misalignment caused by orientation variations between the query and support images by introducing a transformation-invariant network (TINet). TINet ensures geometric invariance and explicitly aligns the features of the query and support branches, resulting in additional performance gains while maintaining the same inference speed as the Strong Baseline. Extensive experiments on three widely used remote-sensing object detection datasets, that is, NWPU VHR-10.v2, DIOR, and HRRSD demonstrated the effectiveness of the proposed method.
引用
收藏
页码:1 / 14
页数:14
相关论文
共 50 条
  • [31] Few-Shot Object Detection With Self-Adaptive Global Similarity and Two-Way Foreground Stimulator in Remote Sensing Images
    Zhang, Yuchen
    Zhang, Bo
    Wang, Bin
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 : 7263 - 7276
  • [32] Adaptive meta-knowledge transfer network for few-shot object detection very high resolution remote sensing images
    Chen, Xi
    Jiang, Wanyue
    Qi, Honggang
    Liu, Min
    Ma, Heping
    Yu, Philip L. H.
    Wen, Ying
    Han, Zhen
    Zhang, Shuqi
    Cao, Guitao
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2024, 127
  • [33] Rotated Feature Network for Multiorientation Object Detection of Remote-Sensing Images
    Zhou, Kaibo
    Zhang, Zhixin
    Gao, Changxin
    Liu, Jie
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2021, 18 (01) : 33 - 37
  • [34] Meta-Learning-Based Incremental Few-Shot Object Detection
    Cheng, Meng
    Wang, Hanli
    Long, Yu
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (04) : 2158 - 2169
  • [35] Controllable Generative Knowledge-Driven Few-Shot Object Detection From Optical Remote Sensing Imagery
    Zhang, Tong
    Zhuang, Yin
    Wang, Guanqun
    Chen, He
    Wang, Hao
    Li, Lianlin
    Li, Jun
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
  • [36] Enhanced few-shot object detection for remote sensing images based on target characteristics
    Wang, Jian
    Zhao, Zeya
    Shao, Jiang
    Zou, Xiaochun
    Zhao, Xinbo
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2025, 148
  • [37] Decoupled Metric Network for Single-Stage Few-Shot Object Detection
    Lu, Yue
    Chen, Xingyu
    Wu, Zhengxing
    Yu, Junzhi
    IEEE TRANSACTIONS ON CYBERNETICS, 2023, 53 (01) : 514 - 525
  • [38] ITNet: Low-Shot Instance Transformation Network for Weakly Supervised Object Detection in Remote Sensing Images
    Liu, Peng
    Pan, Zongxu
    Lei, Bin
    Hu, Yuxin
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 13
  • [39] Diversity-Infused Network for Unsupervised Few-Shot Remote Sensing Scene Classification
    Hou, Liyuan
    Ji, Zhong
    Wang, Xuan
    Yu, Yunlong
    Pang, Yanwei
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5
  • [40] Few-Shot Object Detection via Sample Processing
    Xu, Honghui
    Wang, Xinqing
    Shao, Faming
    Duan, Baoguo
    Zhang, Peng
    IEEE ACCESS, 2021, 9 (09): : 29207 - 29221