Transformation-Invariant Network for Few-Shot Object Detection in Remote-Sensing Images

被引:16
|
作者
Liu, Nanqing [1 ]
Xu, Xun [1 ,2 ]
Celik, Turgay [1 ,3 ]
Gan, Zongxin [1 ]
Li, Heng-Chao [1 ]
机构
[1] Southwest Jiaotong Univ, Sch Informat Sci & Technol, Chengdu 611756, Peoples R China
[2] ASTAR, I2R, Singapore 138632, Singapore
[3] Univ Witwatersrand, Sch Elect & Informat Engn, ZA-2000 Johannesburg, South Africa
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2023年 / 61卷
基金
中国国家自然科学基金;
关键词
Object detection; Training; Remote sensing; Feature extraction; Task analysis; Metalearning; Airplanes; Few-shot learning; meta-learning; object detection; remote-sensing images (RSIs); transformation invariance;
D O I
10.1109/TGRS.2023.3332652
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Object detection in remote-sensing images (RSIs) relies on a large amount of labeled data for training. However, the increasing number of new categories and class imbalance make exhaustive annotation impractical. Few-shot object detection (FSOD) addresses this issue by leveraging meta-learning on seen base classes and fine-tuning on novel classes with limited labeled samples. Nonetheless, the substantial scale and orientation variations of objects in RSIs pose significant challenges to existing FSOD methods. To overcome these challenges, we propose integrating a feature pyramid network (FPN) and utilizing prototype features to enhance query features, thereby improving existing FSOD methods. We refer to this modified FSOD approach as a Strong Baseline, which has demonstrated significant performance improvements compared to the original baselines. Furthermore, we tackle the issue of spatial misalignment caused by orientation variations between the query and support images by introducing a transformation-invariant network (TINet). TINet ensures geometric invariance and explicitly aligns the features of the query and support branches, resulting in additional performance gains while maintaining the same inference speed as the Strong Baseline. Extensive experiments on three widely used remote-sensing object detection datasets, that is, NWPU VHR-10.v2, DIOR, and HRRSD demonstrated the effectiveness of the proposed method.
引用
收藏
页码:1 / 14
页数:14
相关论文
共 50 条
  • [21] Balancing Attention to Base and Novel Categories for Few-Shot Object Detection in Remote Sensing Imagery
    Zhu, Zining
    Wang, Peijin
    Diao, Wenhui
    Yang, Jinze
    Kong, Lingyu
    Wang, Hongqi
    Sun, Xian
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
  • [22] Few-Shot Object Detection in Remote Sensing: Lifting the Curse of Incompletely Annotated Novel Objects
    Zhang, Fahong
    Shi, Yilei
    Xiong, Zhitong
    Zhu, Xiao Xiang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 14
  • [23] Few-Shot Object Detection of Remote Sensing Image via Calibration
    Li, Ruolei
    Zeng, Yilong
    Wu, Jianfeng
    Wang, Yongli
    Zhang, Xiaoli
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [24] DIVERSITY MEASUREMENT-BASED META-LEARNING FOR FEW-SHOT OBJECT DETECTION OF REMOTE SENSING IMAGES
    Wang, Lefan
    Zhang, Shun
    Han, Zonghao
    Feng, Yan
    Wei, Jiang
    Mei, Shaohui
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 3087 - 3090
  • [25] FSOD4RSI: Few-Shot Object Detection for Remote Sensing Images via Features Aggregation and Scale Attention
    Gao, Honghao
    Wu, Shuping
    Wang, Ye
    Kim, Jung Yoon
    Xu, Yueshen
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 4784 - 4796
  • [26] Few-Shot Object Detection and Viewpoint Estimation for Objects in the Wild
    Xiao, Yang
    Lepetit, Vincent
    Marlet, Renaud
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (03) : 3090 - 3106
  • [27] Few-shot Object Detection with Feature Attention Highlight Module in Remote Sensing Images
    Xiao, Zixuan
    Zhong, Ping
    Quan, Yuan
    Yin, Xuping
    Xue, Wei
    2020 INTERNATIONAL CONFERENCE ON IMAGE, VIDEO PROCESSING AND ARTIFICIAL INTELLIGENCE, 2020, 11584
  • [28] Multi-Modal Prototypes for Few-Shot Object Detection in Remote Sensing Images
    Liu, Yanxing
    Pan, Zongxu
    Yang, Jianwei
    Zhou, Peiling
    Zhang, Bingchen
    REMOTE SENSING, 2024, 16 (24)
  • [29] Scale Information Enhancement for Few-Shot Object Detection on Remote Sensing Images
    Yang, Zhenyu
    Zhang, Yongxin
    Zheng, Jv
    Yu, Zhibin
    Zheng, Bing
    Piciarelli, Claudio
    Melo-Pinto, Pedro
    REMOTE SENSING, 2023, 15 (22)
  • [30] Temporal Speciation Network for Few-Shot Object Detection
    Zhao, Xiaowei
    Liu, Xianglong
    Ma, Yuqing
    Bai, Shihao
    Shen, Yifan
    Hao, Zeyu
    Liu, Aishan
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 8267 - 8278