EBiDA-FPN: enhanced bi-directional attention feature pyramid network for object detection

被引:0
作者
Yang, Xiaobao [1 ,2 ]
He, Yulong [2 ]
Wu, Junsheng [3 ]
Wang, Wentao [4 ]
Sun, Wei [2 ]
Ma, Sugang [2 ]
Hou, Zhiqiang [2 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, Xian, Peoples R China
[2] Xian Univ Posts & Telecommun, Sch Comp Sci & Technol, Xian, Peoples R China
[3] Northwestern Polytech Univ, Sch Software, Xian, Peoples R China
[4] Rizhao Branch China Telecom Corp Ltd, Rizhao, Peoples R China
基金
中国国家自然科学基金;
关键词
object detection; convolutional neural network; self-attention; feature pyramid network;
D O I
10.1117/1.JEI.33.2.023013
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
As a fundamental task in computer vision, object detection has long been a challenging visual task. However, current object detection models lack attention to salient features when fusing the lateral connections and top-down information flows in feature pyramid networks (FPNs). To address this, we propose a method for object detection based on an enhanced bi-directional attention feature pyramid network, which aims to enhance the feature representation capability of lateral connections and top-down links in FPN. This method adopts the triplet module to give attention to salient features in the original multi-scale information in spatial and channel dimensions, establishing an enhanced triplet attention. In addition, it introduces improved top and down attention to fuse contextual information using the correlation of features between adjacent scales. Furthermore, adaptively spatial feature fusion and self-attention are introduced to expand the receptive field and improve the detection performance of deep levels. Extensive experiments conducted on the PASCAL VOC, MS COCO, KITTI, and CrowdHuman datasets demonstrate that our method achieves performance gains of 1.8%, 0.8%, 0.5%, and 0.2%, respectively. These results indicate that our method has significant effects and is competitive compared with advanced detectors. (c) 2024 SPIE and IS&T
引用
收藏
页数:16
相关论文
共 50 条
[21]   Latent Feature Pyramid Network for Object Detection [J].
Xie, Jin ;
Pang, Yanwei ;
Nie, Jing ;
Cao, Jiale ;
Han, Jungong .
IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 :2153-2163
[22]   Info-FPN: An Informative Feature Pyramid Network for object detection in remote sensing images [J].
Chen, Silin ;
Zhao, Jiaqi ;
Zhou, Yong ;
Wang, Hanzheng ;
Yao, Rui ;
Zhang, Lixu ;
Xue, Yong .
EXPERT SYSTEMS WITH APPLICATIONS, 2023, 214
[23]   CB-FPN: object detection feature pyramid network based on context information and bidirectional efficient fusion [J].
Zhibo Liu ;
Jian Cheng .
Pattern Analysis and Applications, 2023, 26 (3) :1441-1452
[24]   POD-YOLO Object Detection Model Based on Bi-directional Dynamic Cross-level Pyramid Network [J].
Zhang, Yu ;
Ma, Ming ;
Wang, Zhongxiang ;
Li, Jing ;
Sun, Yan .
ENGINEERING LETTERS, 2024, 32 (05) :995-1003
[25]   LR-FPN: Enhancing Remote Sensing Object Detection with Location Refined Feature Pyramid Network [J].
Li, Hanqian ;
Zhang, Ruinan ;
Pan, Ye ;
Ren, Junchi ;
Shen, Fei .
2024 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN 2024, 2024,
[26]   Attentional feature pyramid network for small object detection [J].
Min, Kyungseo ;
Lee, Gun-Hee ;
Lee, Seong-Whan .
NEURAL NETWORKS, 2022, 155 :439-450
[27]   Bidirectional Parallel Feature Pyramid Network for Object Detection [J].
Zhang, Zhengning ;
Zhang, Lin ;
Wang, Yue ;
Feng, Pengming ;
Sun, Baochen .
IEEE ACCESS, 2022, 10 :49422-49432
[28]   HYPER FEATURE FUSION PYRAMID NETWORK FOR OBJECT DETECTION [J].
Huang, Shouzhi ;
Li, Xiaoyu ;
Jiang, Zhuqing ;
Guo, Xiaoqiang ;
Men, Aidong .
2018 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW 2018), 2018,
[29]   A Novel Lightweight Object Detection Network with Attention Modules and Hierarchical Feature Pyramid [J].
Yang, Shengying ;
Chen, Linfeng ;
Wang, Junxia ;
Jin, Wuyin ;
Yu, Yunxiang .
SYMMETRY-BASEL, 2023, 15 (11)
[30]   Pyramid attention object detection network with multi-scale feature fusion [J].
Chen, Xiu ;
Li, Yujie ;
Nakatoh, Yoshihisa .
COMPUTERS & ELECTRICAL ENGINEERING, 2022, 104