DW-GAN: A Discrete Wavelet Transform GAN for NonHomogeneous Dehazing

被引:96
作者
Fu, Minghan [1 ]
Liu, Huan [1 ]
Yu, Yankun [1 ]
Chen, Jun [1 ]
Wang, Keyan [2 ]
机构
[1] McMaster Univ, Dept Elect & Comp Engn, Hamilton, ON, Canada
[2] Xidian Univ, State Key Lab Integrated Serv Networks, Xian, Peoples R China
来源
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021 | 2021年
关键词
D O I
10.1109/CVPRW53098.2021.00029
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Hazy images are often subject to color distortion, blurring, and other visible quality degradation. Some existing CNN-based methods have great performance on removing homogeneous haze, but they are not robust in non-homogeneous case. The reasons are mainly in two folds. Firstly, due to the complicated haze distribution, texture details are easy to be lost during the dehazing process. Secondly, since the training pairs are hard to be collected, training on limited data can easily lead to over-fitting problem. To tackle these two issues, we introduce a novel dehazing network using 2D discrete wavelet transform, namely DW-GAN. Specifically, we propose a two-branch network to deal with the aforementioned problems. By utilizing wavelet transform in DWT branch, our proposed method can retain more high frequency knowledge in feature maps. In order to prevent over-fitting, ImageNet pre-trained Res2Net is adopted in the knowledge adaptation branch. Owing to the robust feature representations of ImageNet pre-training, the generalization ability of our network is improved dramatically. Finally, a patch-based discriminator is used to reduce artifacts of the restored images. Extensive experimental results demonstrate that the proposed method outperforms the state-of-the-arts quantitatively and qualitatively.
引用
收藏
页码:203 / 212
页数:10
相关论文
共 48 条
[1]   NTIRE 2021 NonHomogeneous Dehazing Challenge Report [J].
Ancuti, Codruta O. ;
Ancuti, Cosmin ;
Vasluianu, Florin-Alexandru ;
Timofte, Radu ;
Fu, Minghan ;
Liu, Huan ;
Yu, Yankun ;
Chen, Jun ;
Wang, Keyan ;
Chang, Jerome ;
Wang, Xiyao ;
Liu, Jing ;
Xu, Yi ;
Zhang, Xinjian ;
Zhao, Minyi ;
Zhou, Shuigeng ;
Chen, Tianyi ;
Fu, Jiahui ;
Jiang, Wentao ;
Gao, Chen ;
Liu, Si ;
Wang, Yudong ;
Guo, Jichang ;
Li, Chongyi ;
Yan, Qixin ;
Zheng, Sida ;
Zamir, Syed Waqas ;
Arora, Aditya ;
Dudhane, Akshay ;
Khan, Salman ;
Hayat, Munawar ;
Khan, Fahad Shahbaz ;
Shao, Ling ;
Zhang, Haichuan ;
Guo, Tiantong ;
Monga, Vishal ;
Yang, Wenjin ;
Lin, Jin ;
Luo, Xiaotong ;
Huang, Guowen ;
Chen, Shuxin ;
Qu, Yanyun ;
Xu, Kele ;
Yang, Lehan ;
Sun, Pengliang ;
Niu, Xuetong ;
Zheng, Junjun ;
Ruan, Xiaotong ;
Wang, Yunfeng ;
Yang, Jiang .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, :627-646
[2]   NH-HAZE: An Image Dehazing Benchmark with Non-Homogeneous Hazy and Haze-Free Images [J].
Ancuti, Codruta O. ;
Ancuti, Cosmin ;
Timofte, Radu .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, :1798-1805
[3]   NTIRE 2020 Challenge on NonHomogeneous Dehazing [J].
Ancuti, Codruta O. ;
Ancuti, Cosmin ;
Vasluianu, Florin-Alexandru ;
Timofte, Radu ;
Liu, Jing ;
Wu, Haiyan ;
Xie, Yuan ;
Qu, Yanyun ;
Ma, Lizhuang ;
Huang, Ziling ;
Deng, Qili ;
Chao, Ju-Chin ;
Yang, Tsung-Shan ;
Chen, Peng-Wen ;
Hsu, Po-Min ;
Liao, Tzu-Yi ;
Sun, Chung-En ;
Wu, Pei-Yuan ;
Do, Jeonghyeok ;
Park, Jongmin ;
Kim, Munchurl ;
Metwaly, Kareem ;
Li, Xuelu ;
Guo, Tiantong ;
Monga, Vishal ;
Yu, Mingzhao ;
Cherukuri, Venkateswararao ;
Chuang, Shiue-Yuan ;
Lin, Tsung-Nan ;
Lee, David ;
Chang, Jerome ;
Wang, Zhan-Han ;
Chang, Yu-Bang ;
Lin, Chang-Hong ;
Dong, Yu ;
Zhou, Hongyu ;
Kong, Xiangzhen ;
Das, Sourya Dipta ;
Dutta, Saikat ;
Zhao, Xuan ;
Ouyang, Bing ;
Estrada, Dennis ;
Wang, Meiqi ;
Su, Tianqi ;
Chen, Siyi ;
Sun, Bangyong ;
de Dravo, Vincent Whannou ;
Yu, Zhe ;
Narang, Pratik ;
Mehra, Aryan .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, :2029-2044
[4]  
Ancuti CO, 2019, IEEE IMAGE PROC, P1014, DOI [10.1109/ICIP.2019.8803046, 10.1109/icip.2019.8803046]
[5]  
[Anonymous], 2017, arXiv
[6]  
[Anonymous], 2016, ADV NEURAL INFORM PR
[7]   Beyond Deep Residual Learning for Image Restoration: Persistent Homology-Guided Manifold Simplification [J].
Bae, Woong ;
Yoo, Jaejun ;
Ye, Jong Chul .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1141-1149
[8]   Non-Local Image Dehazing [J].
Berman, Dana ;
Treibitz, Tali ;
Avidan, Shai .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1674-1682
[9]   DehazeNet: An End-to-End System for Single Image Haze Removal [J].
Cai, Bolun ;
Xu, Xiangmin ;
Jia, Kui ;
Qing, Chunmei ;
Tao, Dacheng .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (11) :5187-5198
[10]   Gated Context Aggregation Network for Image Dehazing and Deraining [J].
Chen, Dongdong ;
He, Mingming ;
Fan, Qingnan ;
Liao, Jing ;
Zhang, Liheng ;
Hou, Dongdong ;
Yuan, Lu ;
Hua, Gang .
2019 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2019, :1375-1383