Cross-Domain Adaptive Object Detection Based on CNN Image Enhancement in Foggy Conditions

被引:1
作者
Guo, Ying [1 ]
Liang, Ruilin [1 ]
Wang, Runmin [1 ]
机构
[1] The Joint Laboratory for Internet of Vehicles of Ministry of Education- China Mobile Communications Corporation, Chang’an University, Xi’an
关键词
autopilot; convolutional neural networks(CNN); domain adaptation; image enhancement; object detection; YOLOv4;
D O I
10.3778/j.issn.1002-8331.2211-0132
中图分类号
学科分类号
摘要
This paper proposes a cross-domain adaptive object detection method based on CNN(convolutional neural networks)image enhancement, which addresses the problem that the accuracy of target detection algorithm decreases due to the low quality of images captured by the visual perception system of autonomous vehicles in foggy conditions. An end-to-end target detection network is constructed, which integrates DIP(digital image processing)and CNN adaptive image enhancement module, to improve the image quality in foggy weather through a small CNN parameter predictor that learns enhancement parameters adaptively. Furthermore, a multi-scale DA(domain adaptive)module is connected to YOLOv4 backbone, which through adversarial training, reduces the domain differences caused by foggy conditions and increases the accuracy of target detection in foggy weather. In the stage of training, CNN, DA and YOLOv4 are learned in an end-to-end manner. In the stage of detection, both CNN and DA modules are removed, only using the images that pre-training weights have adaptively detected in normal and foggy weather, which will not increase the complexity of the original network and thus satisfy the timing requirement of autonomous vehicles. An experiment based on the open dataset Foggy Cityscapes indicates that the proposed method can significantly enhance the image quality in foggy weather, increasing the average accuracy of target detection by 10.4%, which effectively enhances the target detection ability of autonomous vehicles in foggy conditions. © 2023 Journal of Computer Engineering and Applications Beijing Co., Ltd.; Science Press. All rights reserved.
引用
收藏
页码:187 / 195
页数:8
相关论文
共 39 条
[1]  
ZHU X L, WANG H C,, YOU H M,, Et al., Survey on testing of intelligent systems in autonomous vehicles[J], Journal of Software, 32, 7, pp. 2056-2077, (2021)
[2]  
ZHOU J, ZHANG D., Moving vehicle detection for automatic traffic monitoring[J], IEEE Transportation Vehicle Technology, 56, 1, pp. 51-59, (2007)
[3]  
MANDELOS N A,, KERAMITSOGLOU I, KIRANOUDIS C T., A background subtraction algorithm for detecting and tracking vehicles[J], Expert System Apply, 38, 3, pp. 1619-1631, (2011)
[4]  
MAO Z H, ZHU J L,, WU X, Et al., Review of YOLO based target detection for autonomous driving[J], Computer Engineering and Applications, 58, 15, pp. 68-77, (2022)
[5]  
XU Q,, LI Y,, WANG G., Pedestrian-vehicle detection based on deep learning[J], Journal of Jilin University(Engineering Edition), 49, 5, pp. 1661-1667, (2019)
[6]  
WANG Y D, GUO J C, WANG T B., Algorithm for foggy-image pedestrian and vehicle detection[J], Journal of Xi’an University of Electronic Science and Technology, 47, 4, pp. 70-77, (2020)
[7]  
ZHU Q, MAI J, SHAO L., A fast single image haze removal algorithm using color attenuation prior[J], IEEE Transactions on Image Processing, 24, 11, pp. 3522-3533, (2015)
[8]  
LI B Y, PENG X L, WANG Z Y, Et al., AOD-Net:all-in-one dehazing network[C], Proceedings of the 2017 IEEE International Conference on Computer Vision, pp. 4780-4788, (2017)
[9]  
CAI B, JIA K, Et al., DehazeNet:an end-to-end system for single image haze removal[J], IEEE Transactions on Image Processing, 25, 11, pp. 5187-5198, (2016)
[10]  
ENGIN D, EKENEL H K., Cycle-Dehaze:enhanced cycleGAN for single image dehazing[C], Proceedings of the 2018 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, pp. 938-946, (2018)