Dual-Awareness Attention for Few-Shot Object Detection

被引:61
|
作者
Chen, Tung-, I [1 ]
Liu, Yueh-Cheng [1 ]
Su, Hung-Ting [1 ]
Chang, Yu-Cheng [1 ]
Lin, Yu-Hsiang [1 ]
Yeh, Jia-Fong [1 ]
Chen, Wen-Chin [1 ]
Hsu, Winston H. [1 ,2 ]
机构
[1] Natl Taiwan Univ, Taipei 106, Taiwan
[2] Mobile Drive Technol, Taipei 236, Taiwan
关键词
Feature extraction; Object detection; Detectors; Correlation; Task analysis; Power capacitors; Adaptation models; Deep learning; object detection; visual attention; few-shot object detection; NETWORKS;
D O I
10.1109/TMM.2021.3125195
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
While recent progress has significantly boosted few-shot classification (FSC) performance, few-shot object detection (FSOD) remains challenging for modern learning systems. Existing FSOD systems follow FSC approaches, ignoring critical issues such as spatial variability and uncertain representations, and consequently result in low performance. Observing this, we propose a novel Dual-Awareness Attention (DAnA) mechanism that enables networks to adaptively interpret the given support images. DAnA transforms support images into query-position-aware (QPA) features, guiding detection networks precisely by assigning customized support information to each local region of the query. In addition, the proposed DAnA component is flexible and adaptable to multiple existing object detection frameworks. By adopting DAnA, conventional object detection networks, Faster R-CNN and RetinaNet, which are not designed explicitly for few-shot learning, reach state-of-the-art performance in FSOD tasks. In comparison with previous methods, our model significantly increases the performance by 47% (+6.9 AP), showing remarkable ability under various evaluation settings.
引用
收藏
页码:291 / 301
页数:11
相关论文
共 50 条
  • [31] InfRS: Incremental Few-Shot Object Detection in Remote Sensing Images
    Li, Wuzhou
    Zhou, Jiawei
    Li, Xiang
    Cao, Yi
    Jin, Guang
    Zhang, Xuemin
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [32] Toward Generalized Few-Shot Open-Set Object Detection
    Su, Binyi
    Zhang, Hua
    Li, Jingzhi
    Zhou, Zhong
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 1389 - 1402
  • [33] Few-Shot Object Detection of Remote Sensing Image via Calibration
    Li, Ruolei
    Zeng, Yilong
    Wu, Jianfeng
    Wang, Yongli
    Zhang, Xiaoli
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [34] Balancing Attention to Base and Novel Categories for Few-Shot Object Detection in Remote Sensing Imagery
    Zhu, Zining
    Wang, Peijin
    Diao, Wenhui
    Yang, Jinze
    Kong, Lingyu
    Wang, Hongqi
    Sun, Xian
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
  • [35] Few-Shot Air Object Detection Network
    Cai, Wei
    Wang, Xin
    Jiang, Xinhao
    Yang, Zhiyong
    Di, Xingyu
    Gao, Weijie
    ELECTRONICS, 2023, 12 (19)
  • [36] SD-FSOD: Self-Distillation Paradigm via Distribution Calibration for Few-Shot Object Detection
    Chen, Han
    Wang, Qi
    Xie, Kailin
    Lei, Liang
    Lin, Matthieu Gaetan
    Lv, Tian
    Liu, Yongjin
    Luo, Jiebo
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (07) : 5963 - 5976
  • [37] Spatial reasoning for few-shot object detection
    Kim, Geonuk
    Jung, Hong-Gyu
    Lee, Seong-Whan
    PATTERN RECOGNITION, 2021, 120
  • [38] Few-shot object detection via message transfer mechanism
    Lv, Wen
    Shi, Hongbo
    Tan, Shuai
    Song, Bing
    Tao, Yang
    JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (02)
  • [39] FSODS: A Lightweight Metalearning Method for Few-Shot Object Detection on SAR Images
    Zhou, Zheng
    Chen, Jie
    Huang, Zhixiang
    Wan, Huiyao
    Chang, Pei
    Li, Zhao
    Yao, Baidong
    Wu, Bocai
    Sun, Long
    Xing, Mengdao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [40] Multi-View Part-Based Few-Shot Object Detection
    Ma, Jingkai
    Bai, Shuang
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024,