3FL-Net: An Efficient Approach for Improving Performance of Lightweight Detectors in Rainy Weather Conditions

被引:7
作者
Huang, Shih-Chia [1 ]
Jaw, Da-Wei [2 ]
Hoang, Quoc-Viet [1 ,3 ]
Le, Trung-Hieu [1 ,3 ]
机构
[1] Natl Taipei Univ Technol, Dept Elect Engn, Taipei 10608, Taiwan
[2] Natl Taiwan Univ, Dept Elect Engn, Taipei 10617, Taiwan
[3] Hung Yen Univ Technol & Educ, Fac Informat Technol, Hungyen 160000, Vietnam
关键词
Feature extraction; Rain; Detectors; Object detection; Meteorology; Training; Task analysis; lightweight detector; CNN; OBJECT DETECTION; VEHICLE;
D O I
10.1109/TITS.2023.3235339
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Numerous lightweight detection models have been presented in recent years, yet these detectors are inclined to develop for operating under normal weather conditions without adequate studies for rainy conditions. This is one of the causes leads drastically performance degradation of object detectors due to the decrease in visibility. To address above insufficiency, we propose a new and effective approach, named 3FL-Net, to elevate the performance of lightweight object detectors in the presence of rain. Our approach fulfills the goal by closely incorporating four subnetworks, namely feature enhancement subnetwork, feature extraction subnetwork, feature adaptation subnetwork, and lightweight detection subnetwork. The lightweight detection subnetwork achieved the accuracy improvement by learning diverse features from the feature enhancement subnetwork and feature extraction subnetwork via the feature adaptation subnetwork. To further drive the development in object detection induced by rain, we introduce a large-scale driving dataset, called iRain. The full iRain consists of 17,950 real-world rain images, which covers most of the driving scenarios and 85,081 instances explaining five prevalent object classes. Experiment results on divergent rain datasets expose that our 3FL-Net considerably improves the performance of lightweight detectors and surpasses that of the combination models between rain removal and object detection methods.
引用
收藏
页码:4293 / 4305
页数:13
相关论文
共 64 条
  • [1] Driver-Activity Recognition in the Context of Conditionally Autonomous Driving
    Braunagel, Christian
    Stolzmann, Wolfgang
    Kasneci, Enkelejda
    Rosenstiel, Wolfgang
    [J]. 2015 IEEE 18TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS, 2015, : 1652 - 1657
  • [2] THE LAPLACIAN PYRAMID AS A COMPACT IMAGE CODE
    BURT, PJ
    ADELSON, EH
    [J]. IEEE TRANSACTIONS ON COMMUNICATIONS, 1983, 31 (04) : 532 - 540
  • [3] Tiny-RetinaNet: A One-Stage Detector for Real-Time Object Detection
    Cheng, Miao
    Bai, Jianan
    Li, Luyi
    Chen, Qing
    Zhou, Xiangming
    Zhang, Hequn
    Zhang, Peng
    [J]. ELEVENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING (ICGIP 2019), 2020, 11373
  • [4] Hybrid RESNET and Regional Convolution Neural Network Framework for Accident Estimation in Smart Roads
    Djenouri, Youcef
    Srivastava, Gautam
    Djenouri, Djamel
    Belhadi, Asma
    Lin, Jerry Chun-Wei
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (12) : 25335 - 25344
  • [5] Everingham M, 2012, PASCAL VISUAL OBJECT
  • [6] Lightweight Pyramid Networks for Image Deraining
    Fu, Xueyang
    Liang, Borong
    Huang, Yue
    Ding, Xinghao
    Paisley, John
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (06) : 1794 - 1807
  • [7] Removing rain from single images via a deep detail network
    Fu, Xueyang
    Huang, Jiabin
    Zeng, Delu
    Huang, Yue
    Ding, Xinghao
    Paisley, John
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 1715 - 1723
  • [8] Clearing the Skies: A Deep Network Architecture for Single-Image Rain Removal
    Fu, Xueyang
    Huang, Jiabin
    Ding, Xinghao
    Liao, Yinghao
    Paisley, John
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (06) : 2944 - 2956
  • [9] Girshick R, 2016, PROC CVPR IEEE, DOI [10.1109/CVPR.2016.91, DOI 10.1109/CVPR.2016.91]
  • [10] Rich feature hierarchies for accurate object detection and semantic segmentation
    Girshick, Ross
    Donahue, Jeff
    Darrell, Trevor
    Malik, Jitendra
    [J]. 2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 580 - 587