Dual-Awareness Attention for Few-Shot Object Detection

被引:61
|
作者
Chen, Tung-, I [1 ]
Liu, Yueh-Cheng [1 ]
Su, Hung-Ting [1 ]
Chang, Yu-Cheng [1 ]
Lin, Yu-Hsiang [1 ]
Yeh, Jia-Fong [1 ]
Chen, Wen-Chin [1 ]
Hsu, Winston H. [1 ,2 ]
机构
[1] Natl Taiwan Univ, Taipei 106, Taiwan
[2] Mobile Drive Technol, Taipei 236, Taiwan
关键词
Feature extraction; Object detection; Detectors; Correlation; Task analysis; Power capacitors; Adaptation models; Deep learning; object detection; visual attention; few-shot object detection; NETWORKS;
D O I
10.1109/TMM.2021.3125195
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
While recent progress has significantly boosted few-shot classification (FSC) performance, few-shot object detection (FSOD) remains challenging for modern learning systems. Existing FSOD systems follow FSC approaches, ignoring critical issues such as spatial variability and uncertain representations, and consequently result in low performance. Observing this, we propose a novel Dual-Awareness Attention (DAnA) mechanism that enables networks to adaptively interpret the given support images. DAnA transforms support images into query-position-aware (QPA) features, guiding detection networks precisely by assigning customized support information to each local region of the query. In addition, the proposed DAnA component is flexible and adaptable to multiple existing object detection frameworks. By adopting DAnA, conventional object detection networks, Faster R-CNN and RetinaNet, which are not designed explicitly for few-shot learning, reach state-of-the-art performance in FSOD tasks. In comparison with previous methods, our model significantly increases the performance by 47% (+6.9 AP), showing remarkable ability under various evaluation settings.
引用
收藏
页码:291 / 301
页数:11
相关论文
共 50 条
  • [41] Few-Shot Object Counting and Detection
    Thanh Nguyen
    Chau Pham
    Khoi Nguyen
    Minh Hoai
    COMPUTER VISION, ECCV 2022, PT XX, 2022, 13680 : 348 - 365
  • [42] Retentive Compensation and Personality Filtering for Few-Shot Remote Sensing Object Detection
    Wu, Jiashan
    Lang, Chunbo
    Cheng, Gong
    Xie, Xingxing
    Han, Junwei
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (07) : 5805 - 5817
  • [43] CAMCFormer: Cross-Attention and Multicorrelation Aided Transformer for Few-Shot Object Detection in Optical Remote Sensing Images
    Wang, Lefan
    Mei, Shaohui
    Wang, Yi
    Lian, Jiawei
    Han, Zonghao
    Feng, Yan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
  • [44] Few-Shot Object Detection of drones
    Zou Weibao
    Liu Xindi
    Yang Jitao
    Qu Wei
    INTERNATIONAL CONFERENCE ON ELECTRICAL, COMPUTER AND ENERGY TECHNOLOGIES (ICECET 2021), 2021, : 1030 - 1034
  • [45] Foreground Feature Attention Module Based on Unsupervised Saliency Detector for Few-Shot Learning
    Kong, Zhengmin
    Fu, Zhuolin
    Xiong, Feng
    Zhang, Chenggang
    IEEE ACCESS, 2021, 9 : 51179 - 51188
  • [46] Few-shot Object Detection with Feature Attention Highlight Module in Remote Sensing Images
    Xiao, Zixuan
    Zhong, Ping
    Quan, Yuan
    Yin, Xuping
    Xue, Wei
    2020 INTERNATIONAL CONFERENCE ON IMAGE, VIDEO PROCESSING AND ARTIFICIAL INTELLIGENCE, 2020, 11584
  • [47] Few-shot warhead fragment group object detection based on feature reassembly and attention
    He, Meng
    Wu, Jiangpeng
    Liang, Chao
    Hu, Pengyu
    Ren, Yuan
    He, Xuan
    Liu, Qianghui
    Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2024, 32 (12): : 1929 - 1940
  • [48] MM-RCNN: Toward Few-Shot Object Detection in Remote Sensing Images With Meta Memory
    Li, Jianxiang
    Tian, Yan
    Xu, Yiping
    Hu, Xinli
    Zhang, Zili
    Wang, Hu
    Xiao, Yiwen
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [49] Few-Shot Object Detection via Knowledge Transfer
    Kim, Geonuk
    Jung, Hong-Gyu
    Lee, Seong-Whan
    2020 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2020, : 3564 - 3569
  • [50] Efficient Feature Enhancement for Few-Shot Object Detection
    Li, Lin
    Lei, Zhou
    Chen, Shengbo
    Xu, Qingguo
    2022 IEEE 6TH ADVANCED INFORMATION TECHNOLOGY, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (IAEAC), 2022, : 1206 - 1210