Generative Adversarial and Self-Supervised Dehazing Network

被引:51
作者
Zhang, Shengdong [1 ,2 ]
Zhang, Xiaoqin [1 ]
Wan, Shaohua [3 ]
Ren, Wenqi [4 ]
Zhao, Liping [2 ]
Shen, Linlin [5 ]
机构
[1] Wenzhou Univ, Key Lab Intelligent Informat Safety & Emergency Zh, Wenzhou 325035, Peoples R China
[2] Shaoxing Univ, Dept Comp Sci & Engn, Shaoxing 312000, Peoples R China
[3] Univ Elect Sci & Technol China, Shenzhen Inst Adv Study, Shenzhen 518110, Peoples R China
[4] Sun Yat Sen Univ, Sch Cyber Sci & Technol, Shenzhen 518107, Peoples R China
[5] Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen 518060, Peoples R China
基金
中国国家自然科学基金;
关键词
Dehazing; domain shift; generative adversarial; natural haze images; self-supervised; visual Internet of Things (IoT);
D O I
10.1109/TII.2023.3316180
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Owing to the fast developments of economics, a lot of devices and objects have been connected and have formed the Internet of Things (IoT). Visual sensors have been applied in vehicle navigation, traffic situational awareness, and traffic safety management. However, the particles in the air degrade the imaging quality, which affects the performance of vehicle navigation, traffic situational awareness, and traffic safety management. Deep-learning-based dehazing methods were proposed to address this issue. However, these methods are trained with simulated hazy images and cannot generalize to natural haze images well. To address the domain shift problem, some methods resort to zero-shot learning or domain adaption to boost the generalization of the model on natural haze images. However, the relevance between dehazed results and clean images is ignored by zero-shot dehazing methods. Domain-adaption-based dehazing methods ignore the relationship between the dehazed results and the hazy images. To overcome these issues, a generative adversarial and self-supervised dehazing network is introduced to boost the dehazing performance on real haze images. First, generative adversarial is employed to construct the relevance between dehazed results and haze-free images, which can boost the natural appearance of dehazed results. Second, self-supervised learning is employed to construct the relevance between the dehazed results and hazy images, which can restrict the solution space of dehazing. To show the effectiveness of the proposed model, we conduct extensive experiments on real and simulated haze images. Compared with state-of-the-art methods, the proposed model achieves state-of-the-art dehazing performance.
引用
收藏
页码:4187 / 4197
页数:11
相关论文
共 54 条
[1]   Self-Guided Image Dehazing Using Progressive Feature Fusion [J].
Bai, Haoran ;
Pan, Jinshan ;
Xiang, Xinguang ;
Tang, Jinhui .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 :1217-1229
[2]   Non-Local Image Dehazing [J].
Berman, Dana ;
Treibitz, Tali ;
Avidan, Shai .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1674-1682
[3]   Single Image Dehazing Using Color Ellipsoid Prior [J].
Bui, Trung Minh ;
Kim, Wonha .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (02) :999-1009
[4]   DehazeNet: An End-to-End System for Single Image Haze Removal [J].
Cai, Bolun ;
Xu, Xiangmin ;
Jia, Kui ;
Qing, Chunmei ;
Tao, Dacheng .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (11) :5187-5198
[5]   PSD: Principled Synthetic-to-Real Dehazing Guided by Physical Priors [J].
Chen, Zeyuan ;
Wang, Yangchao ;
Yang, Yang ;
Liu, Dong .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :7176-7185
[6]   Referenceless Prediction of Perceptual Fog Density and Perceptual Image Defogging [J].
Choi, Lark Kwon ;
You, Jaehee ;
Bovik, Alan Conrad .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (11) :3888-3901
[7]   Multi-Scale Boosted Dehazing Network with Dense Feature Fusion [J].
Dong, Hang ;
Pan, Jinshan ;
Xiang, Lei ;
Hu, Zhe ;
Zhang, Xinyi ;
Wang, Fei ;
Yang, Ming-Hsuan .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :2154-2164
[8]   Cycle-Dehaze: Enhanced CycleGAN for Single Image Dehazing [J].
Engin, Deniz ;
Genc, Anil ;
Ekenel, Hazim Kemal .
PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, :938-946
[9]   Dehazing Using Color-Lines [J].
Fattal, Raanan .
ACM TRANSACTIONS ON GRAPHICS, 2014, 34 (01)
[10]   You Do Not Need Additional Priors or Regularizers in Retinex-based Low-light Image Enhancement [J].
Fu, Huiyuan ;
Zheng, Wenkai ;
Meng, Xiangyu ;
Wang, Xin ;
Wang, Chuanming ;
Ma, Huadong .
2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, :18125-18134