U2D2Net: Unsupervised Unified Image Dehazing and Denoising Network for Single Hazy Image Enhancement

被引:52
作者
Ding, Bosheng [1 ]
Zhang, Ruiheng [1 ]
Xu, Lixin [1 ]
Liu, Guanyu [1 ]
Yang, Shuo [3 ]
Liu, Yumeng [2 ]
Zhang, Qi [4 ]
机构
[1] Beijing Inst Technol, Sch Mechatron Engn, State Key Lab Electromech Dynam Control, Beijing 100081, Peoples R China
[2] Chinese Acad Sci, Inst Software, Beijing Key Lab Human Comp Interact, Beijing 100190, Peoples R China
[3] Univ Technol Sydney, Fac Engn & Informat, Sydney 2007, Australia
[4] Tech Univ Munich, Sch Engn & Design, D-80333 Munich, Germany
关键词
Haze removal; noise suppression; unsupervised learning;
D O I
10.1109/TMM.2023.3263078
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Hazy images captured under ill-posed scenarios with scattering medium (i.e. haze, fog, or smoke) are contaminated in visibility. Inevitably, these images are further degraded by noises owing to real-world imaging. Most existing hazy image enhancement methods perform image dehazing and denoising stage by stage, with the undesirable result that the estimation error of the former stage has to be propagated and amplified in the latter stage, e.g., noise amplification after dehazing. To address this inconsistent degradation, we present an Unsupervised Unified Image Dehazing and Denoising Network, U(2)D(2)Net, to remove the haze and suppress the noise simultaneously for a single hazy image. U(2)D(2)Net is mainly comprised of an unsupervised dehazing module, an unsupervised denoising module, and a region-similarity fusion strategy. Specifically, we propose an unsupervised transmission-aware dehazing module to restore visibility and suppress depth-dependent noise propagation in the dehazing module. Besides, we design an unsupervised network with a Mean/Max Sub-Sampler in the denoising module. To exploit the correlation and complementary between the previous outputs, a region-similarity fusion strategy is developed to compute the final qualified result. Extensive experiments on both synthetic and real-world datasets illustrate that U(2)D(2)Net outperforms other state-of-the-art dehazing and denoising methods in terms of PSNR, SSIM, and subjective visual effects.
引用
收藏
页码:202 / 217
页数:16
相关论文
共 58 条
[1]  
Batson J, 2019, PR MACH LEARN RES, V97
[2]   DehazeNet: An End-to-End System for Single Image Haze Removal [J].
Cai, Bolun ;
Xu, Xiangmin ;
Jia, Kui ;
Qing, Chunmei ;
Tao, Dacheng .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (11) :5187-5198
[3]   MSDN: Mutually Semantic Distillation Network for Zero-Shot Learning [J].
Chen, Shiming ;
Hong, Ziming ;
Xie, Guo-Sen ;
Yang, Wenhan ;
Peng, Qinmu ;
Wang, Kai ;
Zhao, Jian ;
You, Xinge .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, :7602-7611
[4]  
Cho W, 2014, INT CONF BIG DATA, P139, DOI 10.1109/BIGCOMP.2014.6741424
[5]   Image denoising by sparse 3-D transform-domain collaborative filtering [J].
Dabov, Kostadin ;
Foi, Alessandro ;
Katkovnik, Vladimir ;
Egiazarian, Karen .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2007, 16 (08) :2080-2095
[6]   Cycle-Dehaze: Enhanced CycleGAN for Single Image Dehazing [J].
Engin, Deniz ;
Genc, Anil ;
Ekenel, Hazim Kemal .
PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, :938-946
[7]   Self-Guided Network for Fast Image Denoising [J].
Gu, Shuhang ;
Li, Yawei ;
Van Gool, Luc ;
Timofte, Radu .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :2511-2520
[8]   Toward Convolutional Blind Denoising of Real Photographs [J].
Guo, Shi ;
Yan, Zifei ;
Zhang, Kai ;
Zuo, Wangmeng ;
Zhang, Lei .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :1712-1722
[9]   Single Image Haze Removal Using Dark Channel Prior [J].
He, Kaiming ;
Sun, Jian ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (12) :2341-2353
[10]   Neighbor2Neighbor: Self-Supervised Denoising from Single Noisy Images [J].
Huang, Tao ;
Li, Songjiang ;
Jia, Xu ;
Lu, Huchuan ;
Liu, Jianzhuang .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :14776-14785