Adaptive Dehazing YOLO for Object Detection

被引:8
作者
Zhang, Kaiwen [1 ]
Yan, Xuefeng [1 ,2 ]
Wang, Yongzhen [1 ]
Qi, Junchen [3 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Nanjing, Peoples R China
[2] Collaborat Innovat Ctr Novel Software Technol & I, Nanjing, Peoples R China
[3] North China Elect Power Univ, Baoding, Peoples R China
来源
ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT VII | 2023年 / 14260卷
关键词
Object detection; Image restoration; Adverse weather;
D O I
10.1007/978-3-031-44195-0_2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
While CNN-based object detection methods operate smoothly in normal images, they produce poor detection results under adverse weather conditions due to image degradation. To address this issue, we propose a novel Adaptive Dehazing YOLO (DH-YOLO) frame-work to reduce the impact of weather information on the detection tasks. DH-YOLO is a multi-task learning paradigm that jointly optimizes object detection and image restoration tasks in an end-to-end fashion. In the image restoration module, the feature extraction network serves as an encoder, and a Feature Filtering Module (FFM) is used to remove redundant features. The FFM contains an Adaptive Dehazing Module for image recovery, whose parameters are quickly calculated using a lightweight Cascaded Partial Decoder. This allows the framework to make use of weather-invariant information in hazy images to extract haze-free features. By sharing three feature layers at different scales between the two subtasks, the performance of the object detection network is improved by the use of clear features. DH-YOLO is based on YOLOv4 and forms a unified, end-to-end model with the above modules. Experimental results show that our method outperforms many advanced detection methods on real-world foggy datasets, demonstrating its effectiveness in object detection under adverse weather conditions.
引用
收藏
页码:14 / 27
页数:14
相关论文
共 30 条
[1]  
Bochkovskiy A, 2020, Arxiv, DOI arXiv:2004.10934
[2]   Domain Adaptive Faster R-CNN for Object Detection in the Wild [J].
Chen, Yuhua ;
Li, Wen ;
Sakaridis, Christos ;
Dai, Dengxin ;
Van Gool, Luc .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :3339-3348
[3]  
Ge Z, 2021, Arxiv, DOI [arXiv:2107.08430, DOI 10.48550/ARXIV.2107.08430, 10.48550/arXiv.2107.08430]
[4]   Fast R-CNN [J].
Girshick, Ross .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :1440-1448
[5]   Rich feature hierarchies for accurate object detection and semantic segmentation [J].
Girshick, Ross ;
Donahue, Jeff ;
Darrell, Trevor ;
Malik, Jitendra .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :580-587
[6]  
Gopalan R, 2011, IEEE I CONF COMP VIS, P999, DOI 10.1109/ICCV.2011.6126344
[7]   Single Image Haze Removal Using Dark Channel Prior [J].
He, Kaiming ;
Sun, Jian ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (12) :2341-2353
[8]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[9]   MULTISCALE DOMAIN ADAPTIVE YOLO FOR CROSS-DOMAIN OBJECT DETECTION [J].
Hnewa, Mazin ;
Radha, Hayder .
2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, :3323-3327
[10]   SFA-Net: A Selective Features Absorption Network for Object Detection in Rainy Weather Conditions [J].
Huang, Shih-Chia ;
Hoang, Quoc-Viet ;
Le, Trung-Hieu .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (08) :5122-5132