Multi-level feature fusion pyramid network for object detection

被引:14
|
作者
Guo, Zebin [1 ]
Shuai, Hui [1 ]
Liu, Guangcan [1 ]
Zhu, Yisheng [1 ]
Wang, Wenqing [1 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Jiangsu Key Lab Big Data Anal Technol B DAT, Automat, Nanjing, Peoples R China
来源
VISUAL COMPUTER | 2023年 / 39卷 / 09期
基金
中国国家自然科学基金;
关键词
Object detection; Multi-level fusion; Feature pyramid; Receptive field; Object detection dataset;
D O I
10.1007/s00371-022-02589-w
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Scale variation is one of the challenges in object detection. In this paper, we design a Multi-Level Feature Fusion Pyramid Network (MLFFPN) that can fuse features with different receptive fields so as to produce reliable object representations robust against scale variation. Specifically, we perform feature extraction on the backbone network with convolutional kernels of different sizes, reconstructing the feature pyramids with the various receptive fields by adding top-down paths and lateral connections. Then, the reconstructed feature pyramids are fused. Finally, the bottom-up path enhancement is added for the final prediction. To verify the proposed method, we constructed a large-scale object detection dataset containing in total 225,944 instances and 16,000 images of 30 classes of common objects. In this study, we introduce MLFFPN into the object detection network and conduct a series of experiments on our datasets and MSCOCO datasets. Without bells and whistles, MLFFPN achieves a considerable detection improvement over the baseline network.
引用
收藏
页码:4267 / 4277
页数:11
相关论文
共 50 条
  • [1] Multi-level feature fusion pyramid network for object detection
    Zebin Guo
    Hui Shuai
    Guangcan Liu
    Yisheng Zhu
    Wenqing Wang
    The Visual Computer, 2023, 39 : 4267 - 4277
  • [2] Multi-level refinement enriched feature pyramid network for object detection
    Aziz, Lubna
    Salam, Md. Sah Bin Haji F. C.
    Ayub, Sara
    IMAGE AND VISION COMPUTING, 2021, 115
  • [3] Multi-level refinement enriched feature pyramid network for object detection
    Aziz, Lubna
    FC, Md. Sah Bin Haji Salam
    Ayub, Sara
    Image and Vision Computing, 2021, 115
  • [4] Multi-Level Refinement Feature Pyramid Network for Scale Imbalance Object Detection
    Aziz, Lubna
    Salam, Md Sah Bin Haji
    Sheikh, Usman Ullah
    Khan, Surat
    Ayub, Huma
    Ayub, Sara
    IEEE ACCESS, 2021, 9 : 156492 - 156506
  • [5] MLA-Net: Feature Pyramid Network with Multi-Level Local Attention for Object Detection
    Yang, Xiaobao
    Wang, Wentao
    Wu, Junsheng
    Ding, Chen
    Ma, Sugang
    Hou, Zhiqiang
    MATHEMATICS, 2022, 10 (24)
  • [6] Triplet Network with Multi-level Feature Fusion for Object Tracking
    Cao, Yang
    Wan, Bo
    Wang, Quan
    Cheng, Fei
    2020 JOINT 9TH INTERNATIONAL CONFERENCE ON INFORMATICS, ELECTRONICS & VISION (ICIEV) AND 2020 4TH INTERNATIONAL CONFERENCE ON IMAGING, VISION & PATTERN RECOGNITION (ICIVPR), 2020,
  • [7] HYPER FEATURE FUSION PYRAMID NETWORK FOR OBJECT DETECTION
    Huang, Shouzhi
    Li, Xiaoyu
    Jiang, Zhuqing
    Guo, Xiaoqiang
    Men, Aidong
    2018 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW 2018), 2018,
  • [8] Pyramid attention object detection network with multi-scale feature fusion
    Chen, Xiu
    Li, Yujie
    Nakatoh, Yoshihisa
    COMPUTERS & ELECTRICAL ENGINEERING, 2022, 104
  • [9] A multi-level feature weight fusion model for salient object detection
    Zhang, Shanqing
    Chen, Yujie
    Meng, Yiheng
    Lu, Jianfeng
    Li, Li
    Bai, Rui
    MULTIMEDIA SYSTEMS, 2023, 29 (03) : 887 - 895
  • [10] REVISITING MULTI-LEVEL FEATURE FUSION: A SIMPLE YET EFFECTIVE NETWORK FOR SALIENT OBJECT DETECTION
    Qiu, Yu
    Liu, Yun
    Ma, Xiaoxu
    Liu, Lei
    Gao, Hongcan
    Xu, Jing
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 4010 - 4014