Deep Dehazing Network With Latent Ensembling Architecture and Adversarial Learning

被引:34
作者
Li, Yuenan [1 ]
Liu, Yuhang [1 ]
Yan, Qixin [1 ]
Zhang, Kuangshi [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
基金
中国国家自然科学基金;
关键词
Atmospheric modeling; Imaging; Training; Task analysis; Cameras; Neural networks; Estimation; Dehazing; haze removal; image enhancement; adversarial learning; object detection; IMAGE HAZE REMOVAL; QUALITY ASSESSMENT; VISIBILITY; FRAMEWORK; WEATHER; VISION;
D O I
10.1109/TIP.2020.3044208
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Most existing dehazing algorithms recover haze-free image by solving the hazy imaging model using estimated transmission map and global atmospheric light. However, inaccurate estimation of these variables and the strong assumptions of imaging model result in unrealistic dehazing results. In this paper, we use the adversarial game between a pair of neural networks to accomplish end-to-end photo-realistic dehazing. To avoid uniform contrast enhancement, the generator learns to simultaneously restore haze-free image and capture the non-uniformity of haze. The modules for the two tasks are assembled in sequential and parallel manners to enable information sharing at different levels, and the architecture of the generator implicitly forms an ensemble of dehazing models that allows for feature selection. A multi-scale discriminator competes with the generator by learning to detect dehazing artifacts and the inconsistency between dehazed image and the spatial variation of haze. Unlike existing works that penalize dehazing artifacts via hand-crafted loss, the proposed algorithm uses the identity mapping in the space of clear-scene images to regularize data-driven dehazing. The proposed work also addresses the adaptability of data-driven dehazing to high-level computer vision task. We propose a task-driven training strategy that can optimize the object detection performance on dehazed images without updating the parameters of object detector. Performance of the proposed algorithm is assessed on the RESIDE, I-Haze, and O-Haze benchmarks. The comparison with ten state-of-the-art algorithms shows that the proposed work is the best performer in most competitions.
引用
收藏
页码:1354 / 1368
页数:15
相关论文
共 57 条
[1]   O-HAZE: a dehazing benchmark with real hazy and haze-free outdoor images [J].
Ancuti, Codruta O. ;
Ancuti, Cosmin ;
Timofte, Radu ;
De Vleeschouwer, Christophe .
PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, :867-875
[2]   Single Image Dehazing by Multi-Scale Fusion [J].
Ancuti, Codruta Orniana ;
Ancuti, Cosmin .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2013, 22 (08) :3271-3282
[3]   I-HAZE: A Dehazing Benchmark with Real Hazy and Haze-Free Indoor Images [J].
Ancuti, Cosmin ;
Ancuti, Codruta O. ;
Timofte, Radu ;
De Vleeschouwer, Christophe .
ADVANCED CONCEPTS FOR INTELLIGENT VISION SYSTEMS, ACIVS 2018, 2018, 11182 :620-631
[4]  
[Anonymous], 2015, PROC ADVNEURAL INF P
[5]  
[Anonymous], 2018, P IEEE C COMP VIS PA
[6]  
[Anonymous], 2015, INT CONF ACOUST SPEE
[7]  
[Anonymous], 2006, IEEE COMP SOC C COMP, DOI DOI 10.1109/CVPR.2006.71
[8]   Single Image Dehazing Using Haze-Lines [J].
Berman, Dana ;
Treibitz, Tali ;
Avidan, Shai .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2020, 42 (03) :720-734
[9]   Non-Local Image Dehazing [J].
Berman, Dana ;
Treibitz, Tali ;
Avidan, Shai .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1674-1682
[10]   DehazeNet: An End-to-End System for Single Image Haze Removal [J].
Cai, Bolun ;
Xu, Xiangmin ;
Jia, Kui ;
Qing, Chunmei ;
Tao, Dacheng .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (11) :5187-5198