3FL-Net: An Efficient Approach for Improving Performance of Lightweight Detectors in Rainy Weather Conditions

被引:7
作者
Huang, Shih-Chia [1 ]
Jaw, Da-Wei [2 ]
Hoang, Quoc-Viet [1 ,3 ]
Le, Trung-Hieu [1 ,3 ]
机构
[1] Natl Taipei Univ Technol, Dept Elect Engn, Taipei 10608, Taiwan
[2] Natl Taiwan Univ, Dept Elect Engn, Taipei 10617, Taiwan
[3] Hung Yen Univ Technol & Educ, Fac Informat Technol, Hungyen 160000, Vietnam
关键词
Feature extraction; Rain; Detectors; Object detection; Meteorology; Training; Task analysis; lightweight detector; CNN; OBJECT DETECTION; VEHICLE;
D O I
10.1109/TITS.2023.3235339
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Numerous lightweight detection models have been presented in recent years, yet these detectors are inclined to develop for operating under normal weather conditions without adequate studies for rainy conditions. This is one of the causes leads drastically performance degradation of object detectors due to the decrease in visibility. To address above insufficiency, we propose a new and effective approach, named 3FL-Net, to elevate the performance of lightweight object detectors in the presence of rain. Our approach fulfills the goal by closely incorporating four subnetworks, namely feature enhancement subnetwork, feature extraction subnetwork, feature adaptation subnetwork, and lightweight detection subnetwork. The lightweight detection subnetwork achieved the accuracy improvement by learning diverse features from the feature enhancement subnetwork and feature extraction subnetwork via the feature adaptation subnetwork. To further drive the development in object detection induced by rain, we introduce a large-scale driving dataset, called iRain. The full iRain consists of 17,950 real-world rain images, which covers most of the driving scenarios and 85,081 instances explaining five prevalent object classes. Experiment results on divergent rain datasets expose that our 3FL-Net considerably improves the performance of lightweight detectors and surpasses that of the combination models between rain removal and object detection methods.
引用
收藏
页码:4293 / 4305
页数:13
相关论文
共 64 条
  • [21] Self-Adaptive Feature Transformation Networks for Object Detection in low luminance Images
    Huang, Shih-Chia
    Quoc-Viet Hoang
    Jaw, Da-Wei
    [J]. ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2022, 13 (01)
  • [22] SFA-Net: A Selective Features Absorption Network for Object Detection in Rainy Weather Conditions
    Huang, Shih-Chia
    Hoang, Quoc-Viet
    Le, Trung-Hieu
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (08) : 5122 - 5132
  • [23] DSNet: Joint Semantic Learning for Object Detection in Inclement Weather Conditions
    Huang, Shih-Chia
    Le, Trung-Hieu
    Jaw, Da-Wei
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (08) : 2623 - 2633
  • [24] Iandola F. N., 2016, ARXIV
  • [25] DesnowGAN: An Efficient Single Image Snow Removal Framework Using Cross-Resolution Lateral Connection and GANs
    Jaw, Da-Wei
    Huang, Shih-Chia
    Kuo, Sy-Yen
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (04) : 1342 - 1350
  • [26] Jiang Y, 2019, CHIN AUTOM CONGR, P4842, DOI [10.1109/CAC48633.2019.8997079, 10.1109/cac48633.2019.8997079]
  • [27] Joseph RK, 2016, CRIT POL ECON S ASIA, P1
  • [28] A survey of the recent architectures of deep convolutional neural networks
    Khan, Asifullah
    Sohail, Anabia
    Zahoora, Umme
    Qureshi, Aqsa Saeed
    [J]. ARTIFICIAL INTELLIGENCE REVIEW, 2020, 53 (08) : 5455 - 5516
  • [29] Kingma DP, 2014, ADV NEUR IN, V27
  • [30] ImageNet Classification with Deep Convolutional Neural Networks
    Krizhevsky, Alex
    Sutskever, Ilya
    Hinton, Geoffrey E.
    [J]. COMMUNICATIONS OF THE ACM, 2017, 60 (06) : 84 - 90