Visual Haze Removal by a Unified Generative Adversarial Network

被引:57
作者
Pang, Yanwei [1 ]
Xie, Jin [1 ]
Li, Xuelong [2 ,3 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] Northwestern Polytech Univ, Sch Comp Sci, Xian 710072, Shaanxi, Peoples R China
[3] Northwestern Polytech Univ, Ctr Opt Imagery Anal & Learning, Xian 710072, Shaanxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Atmospheric modeling; Generators; Generative adversarial networks; Feature extraction; Visualization; Image restoration; Scattering; Dehazing; visual quality improvement; generative adversarial network; convolutional neural network; IMAGE QUALITY ASSESSMENT; VISIBILITY; FRAMEWORK; FEATURES; FUSION;
D O I
10.1109/TCSVT.2018.2880223
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Existence of haze significantly degrades visual quality and hence negatively affects the performance of visual surveillance, video analysis, and human-machine interaction. To remove haze from a visual signal, in this paper, we propose a generative adversarial network for visual haze removal called HRGAN. HRGAN consists of a generator network and a discriminator network. A unified network jointly estimating transmission maps, atmospheric light, and haze-free images (called UNTA) is proposed as the generator network of HRGAN. Instead of being optimized by minimizing the pixel-wise loss, HRGAN is optimized by minimizing a novel loss function consisting of pixel-wise loss, perceptual loss, and adversarial loss produced by a discriminator network. Classical model-based image dehazing algorithms consist of three separate stages: 1) estimating transmission map; 2) estimating atmospheric light; and 3) restoring haze-free image by using an atmospheric scattering model to process the transmission map and atmospheric light. Such a separate scheme is not guaranteed to achieve optimal results. On the contrary, UNTA performs transmission map estimation and atmospheric light estimation simultaneously to obtain joint optimal solutions. The experimental results on both synthetic and real-world image databases demonstrate that HRGAN outperforms the state-of-the-art algorithms in terms of both effectiveness and efficiency.
引用
收藏
页码:3211 / 3221
页数:11
相关论文
共 56 条
[1]  
Ancuti Codruta O., 2010, Computer Vision - ACCV 2010. 10th Asian Conference on Computer Vision. Revised Selected Papers, P501, DOI 10.1007/978-3-642-19309-5_39
[2]  
[Anonymous], IEEE T CIRCUITS SYST
[3]  
[Anonymous], 2015, ARXIV PREPRINT ARXIV
[4]  
[Anonymous], IEEE T PATTERN ANAL
[5]  
[Anonymous], 2017, PROC CVPR IEEE, DOI DOI 10.1109/CVPR.2017.632
[6]  
[Anonymous], P INT C LEARN REPR
[7]  
[Anonymous], 2016, DEEPLAB SEMANTIC IMA
[8]  
[Anonymous], 2014, ARXIV PREPRINT ARXIV
[9]  
[Anonymous], 2017, Benchmarking Single Image Dehazing and beyond
[10]   A database and evaluation methodology for optical flow [J].
Baker, Simon ;
Scharstein, Daniel ;
Lewis, J. P. ;
Roth, Stefan ;
Black, Michael J. ;
Szeliski, Richard .
2007 IEEE 11TH INTERNATIONAL CONFERENCE ON COMPUTER VISION, VOLS 1-6, 2007, :588-595