Diverse multi-scale features absorption for lightweight object detection models in inclement weather conditions

被引:0
|
作者
Le, Trung-Hieu [1 ]
Hoang, Quoc-Viet [1 ]
Nguyen, Van-Hau [1 ]
Huang, Shih-Chia [2 ]
机构
[1] Hung Yen Univ Technol & Educ, Fac Informat Technol, Hung Yen 17000, Vietnam
[2] Natl Taipei Univ Technol, Dept Elect Engn, Taipei 10608, Taiwan
关键词
Lightweight detection model; Object detection; Multi-scale features; Visibility enhancement; VISIBILITY;
D O I
10.1016/j.compeleceng.2025.110221
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, numerous lightweight object detection models have been introduced and successfully deployed on low-computation devices. However, these models mainly focus on detecting objects in favorable weather conditions and do not adequately account for inclement conditions, particularly in the presence of fog. This significantly leads to the drastic performance degradation of object detectors, primarily attributable to the decreased visibility. To tackle the aforementioned deficiency, we introduce a novel diverse multi-scale feature absorption network (DMFA-Net) to guide lightweight detectors work efficiently in foggy weather conditions. Our approach achieves its objective through the close collaboration of three subnetworks: a detection enhancement subnetwork, a depth mining subnetwork, and a lightweight detection subnetwork. The lightweight detection subnetwork achieves a significant accuracy improvement by absorbing and learning a range of useful features from both the detection enhancement and depth mining subnetworks through diverse multi-scale feature absorption loss. Extensive experiments demonstrate that our DMFA-Net effectively boosts baseline lightweight detectors in accurately localizing and classifying objects, without adding any computational cost. Additionally, it outperforms representative competing approaches on both synthesized and real-world foggy image datasets.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] DSNet: Joint Semantic Learning for Object Detection in Inclement Weather Conditions
    Huang, Shih-Chia
    Le, Trung-Hieu
    Jaw, Da-Wei
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (08) : 2623 - 2633
  • [2] Multi-scale Lightweight Neural Network for Real-Time Object Detection
    Li, Yuan
    Wu, Qiaojun
    Chen, Song
    Kang, Yi
    PRICAI 2022: TRENDS IN ARTIFICIAL INTELLIGENCE, PT III, 2022, 13631 : 199 - 211
  • [3] MULTI-SCALE SHARED FEATURES FOR CASCADE OBJECT DETECTION
    Lin, Zhe
    Hua, Gang
    Davis, Larry S.
    2012 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2012), 2012, : 1865 - 1868
  • [4] Enhanced SSD with interactive multi-scale attention features for object detection
    Shuren Zhou
    Jia Qiu
    Multimedia Tools and Applications, 2021, 80 : 11539 - 11556
  • [5] Enhanced SSD with interactive multi-scale attention features for object detection
    Zhou, Shuren
    Qiu, Jia
    MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (08) : 11539 - 11556
  • [6] A Local Top-Down Module for Object Detection with Multi-scale Features
    Huang, Shihua
    Wang, Lu
    Yang, Peiyu
    Deng, Qingxu
    PATTERN RECOGNITION AND COMPUTER VISION (PRCV 2018), PT IV, 2018, 11259 : 65 - 77
  • [7] SAN: Learning Relationship Between Convolutional Features for Multi-scale Object Detection
    Kim, Yonghyun
    Kang, Bong-Nam
    Kim, Daijin
    COMPUTER VISION - ECCV 2018, PT V, 2018, 11209 : 328 - 343
  • [8] Selective Multi-scale Learning for Object Detection
    Chen, Junliang
    Lu, Weizeng
    Shen, Linlin
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2021, PT II, 2021, 12892 : 3 - 14
  • [9] Feature Enhancement for Multi-scale Object Detection
    Huicheng Zheng
    Jiajie Chen
    Lvran Chen
    Ye Li
    Zhiwei Yan
    Neural Processing Letters, 2020, 51 : 1907 - 1919
  • [10] Feature Enhancement for Multi-scale Object Detection
    Zheng, Huicheng
    Chen, Jiajie
    Chen, Lvran
    Li, Ye
    Yan, Zhiwei
    NEURAL PROCESSING LETTERS, 2020, 51 (02) : 1907 - 1919