MSFYOLO: Feature fusion-based detection for small objects

被引:23
|
作者
Song, Ziying [1 ,2 ]
Zhang, Yu [2 ]
Liu, Yi [2 ]
Yang, Kuihe [2 ]
Sun, Meiling [2 ]
机构
[1] Hebei Normal Univ Sci & Technol, Qinhuangdao 066000, Hebei, Peoples R China
[2] Hebei Univ Sci & Technol, Sch Informat Sci & Engn, Shijiazhuang 050018, Hebei, Peoples R China
关键词
Feature extraction; Object detection; Semantics; Training; Mathematical models; Task analysis; Information science; Feature extraction network; Feature pyramid; Multi-scale feature fusion;
D O I
10.1109/TLA.2022.9693567
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
At present, the effect of object detection algorithm in small object detection is very poor, mainly because the low-level network lacks semantic information and the characteristic information expressed by small object inspection data is very lack. In view of the above difficulties, this paper proposes a small object detection algorithm based on multi-scale feature fusion. By learning shallow features at the shallow level and deep features at the deep level, the proposed multi-scale feature learning scheme focuses on the fusion of concrete features and abstract features. It constructs object detector (MSFYOLO) based on multi-scale deep feature learning network and considers the relationship between a single object and local environment. Combining global information with local information, the feature pyramid is constructed by fusing different depth feature layers in the network. In addition, this paper also proposes a new feature extraction network (CourNet), through the way of feature visualization compared with the mainstream backbone network, the network can better express the small object feature information. The proposed algorithm is valuated on the MS COCO and achieved leading performance with 11.7% improvement in FPS, 17.0% improvement in AP, 81.0% improvement in ARS, and 23.3% reduction in computational FPLOs compared to YOLOv3. This study shows that the combination of global information and local information is helpful to detect the expression of small objects in different illumination. MSFYOLO uses CourNet as the backbone network, which has high efficiency and a good balance between accuracy and speed.
引用
收藏
页码:823 / 830
页数:8
相关论文
共 50 条
  • [41] Deep Learning Feature Fusion-Based Retina Image Classification
    Zhang Tianfu
    Zhong Shuncong
    Lian Chaoming
    Zhou Ning
    Xie Maosong
    LASER & OPTOELECTRONICS PROGRESS, 2020, 57 (24)
  • [42] A review of feature fusion-based media popularity prediction methods
    Liu, An-An
    Wang, Xiaowen
    Xu, Ning
    Guo, Junbo
    Jin, Guoqing
    Zhang, Quan
    Tang, Yejun
    Zhang, Shenyuan
    VISUAL INFORMATICS, 2022, 6 (04) : 78 - 89
  • [43] Multisensor Feature Fusion-Based Model for Business English Translation
    Zheng, Pingfei
    Scientific Programming, 2022, 2022
  • [44] Comprehensive Feature and Texture Fusion-based Image Registration Approach
    Bowen, Francis
    Du, Eliza Y.
    Hu, Jianghai
    MOBILE MULTIMEDIA/IMAGE PROCESSING, SECURITY, AND APPLICATIONS 2012, 2012, 8406
  • [45] The effects of fusion-based feature extraction for fabric defect classification
    Ciklacandir, Fatma Gunseli Yasar
    Utku, Semih
    Ozdemir, Hakan
    TEXTILE RESEARCH JOURNAL, 2023, 93 (23-24) : 5448 - 5460
  • [46] Multisensor Feature Fusion-Based Model for Business English Translation
    Zheng, Pingfei
    SCIENTIFIC PROGRAMMING, 2022, 2022
  • [47] A feature fusion-based prognostics approach for rolling element bearings
    Akpudo, Ugochukwu Ejike
    Hur, Jang-Wook
    JOURNAL OF MECHANICAL SCIENCE AND TECHNOLOGY, 2020, 34 (10) : 4025 - 4035
  • [48] An interlayer feature fusion-based heterogeneous graph neural network
    Feng, Ke
    Rao, Guozheng
    Zhang, Li
    Cong, Qing
    APPLIED INTELLIGENCE, 2023, 53 (21) : 25626 - 25639
  • [49] A multi-scale pyramid feature fusion-based object detection method for remote sensing images
    Huangfu, Panpan
    Dang, Lanxue
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2023, 44 (24) : 7790 - 7807
  • [50] Signal Fusion-based Detection with an Intuitive Weighting Method
    Lu, Jing
    Zhou, Shenghua
    Wang, Jianlai
    Li, Dawei
    Feng, Tieshan
    Liu, Hongwei
    Ma, Hui
    2020 IEEE RADAR CONFERENCE (RADARCONF20), 2020,