Cross-Domain Adaptive Object Detection Based on CNN Image Enhancement in Foggy Conditions

被引:1
作者
Guo, Ying [1 ]
Liang, Ruilin [1 ]
Wang, Runmin [1 ]
机构
[1] The Joint Laboratory for Internet of Vehicles of Ministry of Education- China Mobile Communications Corporation, Chang’an University, Xi’an
关键词
autopilot; convolutional neural networks(CNN); domain adaptation; image enhancement; object detection; YOLOv4;
D O I
10.3778/j.issn.1002-8331.2211-0132
中图分类号
学科分类号
摘要
This paper proposes a cross-domain adaptive object detection method based on CNN(convolutional neural networks)image enhancement, which addresses the problem that the accuracy of target detection algorithm decreases due to the low quality of images captured by the visual perception system of autonomous vehicles in foggy conditions. An end-to-end target detection network is constructed, which integrates DIP(digital image processing)and CNN adaptive image enhancement module, to improve the image quality in foggy weather through a small CNN parameter predictor that learns enhancement parameters adaptively. Furthermore, a multi-scale DA(domain adaptive)module is connected to YOLOv4 backbone, which through adversarial training, reduces the domain differences caused by foggy conditions and increases the accuracy of target detection in foggy weather. In the stage of training, CNN, DA and YOLOv4 are learned in an end-to-end manner. In the stage of detection, both CNN and DA modules are removed, only using the images that pre-training weights have adaptively detected in normal and foggy weather, which will not increase the complexity of the original network and thus satisfy the timing requirement of autonomous vehicles. An experiment based on the open dataset Foggy Cityscapes indicates that the proposed method can significantly enhance the image quality in foggy weather, increasing the average accuracy of target detection by 10.4%, which effectively enhances the target detection ability of autonomous vehicles in foggy conditions. © 2023 Journal of Computer Engineering and Applications Beijing Co., Ltd.; Science Press. All rights reserved.
引用
收藏
页码:187 / 195
页数:8
相关论文
共 39 条
[21]  
ZHANG S Z, Et al., Domain adaptive YOLO for one-stage cross-domain detection[J]
[22]  
HNEWA M, RADHA H., Multiscale domain adaptive YOLO for cross-domain object detection[C], Proceedings of the 2021 IEEE International Conference on Image Processing, pp. 3323-3327, (2021)
[23]  
KHODAMBASHI S, MOGHADDAM M., An impulse noise fading technique based on local histogram processing[C], Proceedings of the 2009 IEEE International Symposium on Signal Processing and Information Technology, pp. 95-100, (2009)
[24]  
PARIHAR A S, GUPTA Y K, SINGODIA Y, Et al., A comparative study of image dehazing algorithms[C], Proceedings of the 5th International Conference on Communication and Electronics Systems, pp. 766-771, (2020)
[25]  
LIU F, SHAO X P,, Et al., Polarimetric dehazing utilizing spatial frequency segregation of images[J], Applied Optics, 54, 27, pp. 8116-8122, (2015)
[26]  
ZHANG W H, GAO S S, JING C, Et al., Single image dehazing method under the influence of un-uniform illumination[C], 2016 IEEE 14th International Conference on Dependable,Autonomic & Secure Computing,International Conference on Pervasive Intelligence & Computing,International Conference on Big Data Intelligence & Computing & Cyber Science & Technology Congress, pp. 233-238, (2016)
[27]  
YU R S, LIU W Y, ZHANG Y S, Et al., Deep exposure:learning to expose photos with asynchronously reinforced adversarial learning[C], Proceedings of the 32nd International Conference on Neural Information Processing Systems, pp. 2153-2163, (2018)
[28]  
HU Y M,, HE H, Et al., Exposure:a white-box photo post-processing framework[J], ACM Transactions on Graphics, 37, 2, (2018)
[29]  
ZENG H, CAI J R,, LI L, Et al., Learning image-adaptive 3D lookup tables for high performance photo enhancement in real-time[J], IEEE Transactions on Pattern Analysis and Machine Intelligence, 44, 4, pp. 2058-2073, (2020)
[30]  
HSU H K, YAO C H, TSAI Y H, Et al., Progressive domain adaptation for object detection[C], 2020 IEEE Winter Conference on Applications of Computer Vision, pp. 749-757, (2020)