Haze Relevant Feature Attention Network for Single Image Dehazing

被引:8
作者
Jiang, Xin [1 ,2 ]
Lu, Lu [1 ]
Zhu, Ming [1 ,2 ]
Hao, Zhicheng [1 ]
Gao, Wen [1 ]
机构
[1] Chinese Acad Sci, Changchun Inst Opt Fine Mech & Phys, Changchun 130033, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
关键词
Atmospheric modeling; Image color analysis; Generators; Scattering; Generative adversarial networks; Feature extraction; Propagation losses; Single image dehazing; cycle generative adversarial networks; haze relevant feature; attention module; dense block; REMOVAL; VISIBILITY;
D O I
10.1109/ACCESS.2021.3100604
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Single image dehazing methods based on deep learning technique have made great achievements in recent years. However, some methods recover haze-free images by estimating the so-called transmission map and global atmospheric light, which are strictly limited to the simplified atmospheric scattering model and do not give full play to the advantages of deep learning to fit complex functions. Other methods require pairs of training data, whereas in practice pairs of hazy and corresponding haze-free images are difficult to obtain. To address these problems, inspired by cycle generative adversarial model, we have developed an end-to-end haze relevant feature attention network for single image dehazing, which does not require paired training images. Specifically, we make explicit use of haze relevant feature by embedding an attention module into a novel dehazing generator that combines an encoder-decoder structure with dense blocks. The constructed network adopts a novel strategy which derives attention maps from several hand-designed priors, such as dark channel, color attenuation, maximum contrast and so on. Since haze is usually unevenly distributed across an image, the attention maps could serve as a guidance of the amount of haze at image pixels. Meanwhile, dense blocks can maximize information flow along features from different levels. Furthermore, color loss is proposed to avoid color distortion and generate visually better haze-free images. Extensive experiments demonstrate that the proposed method achieves significant improvements over the state-of-the-art methods.
引用
收藏
页码:106476 / 106488
页数:13
相关论文
共 32 条
[1]   NH-HAZE: An Image Dehazing Benchmark with Non-Homogeneous Hazy and Haze-Free Images [J].
Ancuti, Codruta O. ;
Ancuti, Cosmin ;
Timofte, Radu .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, :1798-1805
[2]   NTIRE 2020 Challenge on NonHomogeneous Dehazing [J].
Ancuti, Codruta O. ;
Ancuti, Cosmin ;
Vasluianu, Florin-Alexandru ;
Timofte, Radu ;
Liu, Jing ;
Wu, Haiyan ;
Xie, Yuan ;
Qu, Yanyun ;
Ma, Lizhuang ;
Huang, Ziling ;
Deng, Qili ;
Chao, Ju-Chin ;
Yang, Tsung-Shan ;
Chen, Peng-Wen ;
Hsu, Po-Min ;
Liao, Tzu-Yi ;
Sun, Chung-En ;
Wu, Pei-Yuan ;
Do, Jeonghyeok ;
Park, Jongmin ;
Kim, Munchurl ;
Metwaly, Kareem ;
Li, Xuelu ;
Guo, Tiantong ;
Monga, Vishal ;
Yu, Mingzhao ;
Cherukuri, Venkateswararao ;
Chuang, Shiue-Yuan ;
Lin, Tsung-Nan ;
Lee, David ;
Chang, Jerome ;
Wang, Zhan-Han ;
Chang, Yu-Bang ;
Lin, Chang-Hong ;
Dong, Yu ;
Zhou, Hongyu ;
Kong, Xiangzhen ;
Das, Sourya Dipta ;
Dutta, Saikat ;
Zhao, Xuan ;
Ouyang, Bing ;
Estrada, Dennis ;
Wang, Meiqi ;
Su, Tianqi ;
Chen, Siyi ;
Sun, Bangyong ;
de Dravo, Vincent Whannou ;
Yu, Zhe ;
Narang, Pratik ;
Mehra, Aryan .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, :2029-2044
[3]  
Ancuti CO, 2011, LECT NOTES COMPUT SC, V6493, P501
[4]   Non-Local Image Dehazing [J].
Berman, Dana ;
Treibitz, Tali ;
Avidan, Shai .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1674-1682
[5]   DehazeNet: An End-to-End System for Single Image Haze Removal [J].
Cai, Bolun ;
Xu, Xiangmin ;
Jia, Kui ;
Qing, Chunmei ;
Tao, Dacheng .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (11) :5187-5198
[6]   Haze Removal Using Radial Basis Function Networks for Visibility Restoration Applications [J].
Chen, Bo-Hao ;
Huang, Shih-Chia ;
Li, Chian-Ying ;
Kuo, Sy-Yen .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (08) :3828-3838
[7]   Gated Context Aggregation Network for Image Dehazing and Deraining [J].
Chen, Dongdong ;
He, Mingming ;
Fan, Qingnan ;
Liao, Jing ;
Zhang, Liheng ;
Hou, Dongdong ;
Yuan, Lu ;
Hua, Gang .
2019 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2019, :1375-1383
[8]   Referenceless Prediction of Perceptual Fog Density and Perceptual Image Defogging [J].
Choi, Lark Kwon ;
You, Jaehee ;
Bovik, Alan Conrad .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (11) :3888-3901
[9]   Effective Removal of User-Selected Foreground Object From Facial Images Using a Novel GAN-Based Network [J].
Din, Nizam Ud ;
Javed, Kamran ;
Bae, Seho ;
Yi, Juneho .
IEEE ACCESS, 2020, 8 :109648-109661
[10]   Cycle-Dehaze: Enhanced CycleGAN for Single Image Dehazing [J].
Engin, Deniz ;
Genc, Anil ;
Ekenel, Hazim Kemal .
PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, :938-946