EBiDA-FPN: enhanced bi-directional attention feature pyramid network for object detection

被引:0
作者
Yang, Xiaobao [1 ,2 ]
He, Yulong [2 ]
Wu, Junsheng [3 ]
Wang, Wentao [4 ]
Sun, Wei [2 ]
Ma, Sugang [2 ]
Hou, Zhiqiang [2 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, Xian, Peoples R China
[2] Xian Univ Posts & Telecommun, Sch Comp Sci & Technol, Xian, Peoples R China
[3] Northwestern Polytech Univ, Sch Software, Xian, Peoples R China
[4] Rizhao Branch China Telecom Corp Ltd, Rizhao, Peoples R China
基金
中国国家自然科学基金;
关键词
object detection; convolutional neural network; self-attention; feature pyramid network;
D O I
10.1117/1.JEI.33.2.023013
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
As a fundamental task in computer vision, object detection has long been a challenging visual task. However, current object detection models lack attention to salient features when fusing the lateral connections and top-down information flows in feature pyramid networks (FPNs). To address this, we propose a method for object detection based on an enhanced bi-directional attention feature pyramid network, which aims to enhance the feature representation capability of lateral connections and top-down links in FPN. This method adopts the triplet module to give attention to salient features in the original multi-scale information in spatial and channel dimensions, establishing an enhanced triplet attention. In addition, it introduces improved top and down attention to fuse contextual information using the correlation of features between adjacent scales. Furthermore, adaptively spatial feature fusion and self-attention are introduced to expand the receptive field and improve the detection performance of deep levels. Extensive experiments conducted on the PASCAL VOC, MS COCO, KITTI, and CrowdHuman datasets demonstrate that our method achieves performance gains of 1.8%, 0.8%, 0.5%, and 0.2%, respectively. These results indicate that our method has significant effects and is competitive compared with advanced detectors. (c) 2024 SPIE and IS&T
引用
收藏
页数:16
相关论文
共 60 条
[1]  
Ale L, 2018, IEEE INT CONF BIG DA, P5197, DOI 10.1109/BigData.2018.8622025
[2]  
Bochkovskiy A, 2020, Arxiv, DOI arXiv:2004.10934
[3]   Cascade R-CNN: High Quality Object Detection and Instance Segmentation [J].
Cai, Zhaowei ;
Vasconcelos, Nuno .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (05) :1483-1498
[4]   Cascade R-CNN: Delving into High Quality Object Detection [J].
Cai, Zhaowei ;
Vasconcelos, Nuno .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :6154-6162
[5]  
Cao JX, 2020, Arxiv, DOI arXiv:2005.11475
[6]  
Carion N., 2020, EUR C COMP VIS, P213, DOI 10.1007/978-3-030-58452-813
[7]   RetinaNet With Difference Channel Attention and Adaptively Spatial Feature Fusion for Steel Surface Defect Detection [J].
Cheng, Xun ;
Yu, Jianbo .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70 (70)
[8]  
Dai JF, 2016, ADV NEUR IN, V29
[9]  
Deng L, 2019, arXiv
[10]  
Dong Zhang, 2020, Computer Vision - ECCV 2020. 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12373), P323, DOI 10.1007/978-3-030-58604-1_20