USID-Net: Unsupervised Single Image Dehazing Network via Disentangled Representations

被引:62
作者
Li, Jiafeng [1 ]
Li, Yaopeng [1 ]
Zhuo, Li [1 ]
Kuang, Lingyan [1 ]
Yu, Tianjian [2 ]
机构
[1] Beijing Univ Technol, Beijing Key Lab Computat Intelligence & Intelligen, Beijing 100124, Peoples R China
[2] Cent South Univ, Sch Traff & Transportat Engn, Changsha 410075, Hunan, Peoples R China
基金
北京市自然科学基金; 中国国家自然科学基金;
关键词
Disentangled representations; end-to-end; single image dehazing; unsupervised learning;
D O I
10.1109/TMM.2022.3163554
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Captured images of outdoor scenes usually exhibit low visibility in cases of severe haze, which interferes with optical imaging and degrades image quality. Most of the existing methods solve the single-image dehazing problem by applying supervised training on paired images; however, in practice, the pairing of real-world images is not viable. Additionally, the processing speed of individual dehazing models is important in practical applications. In this study, a novel unsupervised single image dehazing network (USID-Net) based on disentangled representations without paired training images is explored. Furthermore, considering the trade-off between performance and memory storage, a compact multi-scale feature attention (MFA) module is developed, integrating multi-scale feature representation and attention mechanism to facilitate feature representation. To effectively extract haze information, a mechanism referred to as OctEncoder is designed to include multi-frequency representations that can capture more global information. Extensive experiments show that USID-Net achieves competitive dehazing results and a relatively high processing speed compared to state-of-the-art methods. The source code is available at https://github.com/dehazing/USID-Net.
引用
收藏
页码:3587 / 3601
页数:15
相关论文
共 44 条
[1]  
[Anonymous], 1976, Optics of the Atmosphere: Scattering by Molecules and Particles
[2]   Non-Local Image Dehazing [J].
Berman, Dana ;
Treibitz, Tali ;
Avidan, Shai .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1674-1682
[3]   DehazeNet: An End-to-End System for Single Image Haze Removal [J].
Cai, Bolun ;
Xu, Xiangmin ;
Jia, Kui ;
Qing, Chunmei ;
Tao, Dacheng .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (11) :5187-5198
[4]   Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convolution [J].
Chen, Yunpeng ;
Fan, Haoqi ;
Xu, Bing ;
Yan, Zhicheng ;
Kalantidis, Yannis ;
Rohrbach, Marcus ;
Yan, Shuicheng ;
Feng, Jiashi .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :3434-3443
[5]   Multi-Scale Boosted Dehazing Network with Dense Feature Fusion [J].
Dong, Hang ;
Pan, Jinshan ;
Xiang, Lei ;
Hu, Zhe ;
Zhang, Xinyi ;
Wang, Fei ;
Yang, Ming-Hsuan .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :2154-2164
[6]  
Du WC, 2020, PROC CVPR IEEE, P14471, DOI 10.1109/CVPR42600.2020.01449
[7]   Varicolored Image De-hazing [J].
Dudhane, Akshay ;
Biradar, Kuldeep M. ;
Patil, Prashant W. ;
Hambarde, Praful ;
Murala, Subrahmanyam .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :4563-4572
[8]   Cycle-Dehaze: Enhanced CycleGAN for Single Image Dehazing [J].
Engin, Deniz ;
Genc, Anil ;
Ekenel, Hazim Kemal .
PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, :938-946
[9]   Dehazing Using Color-Lines [J].
Fattal, Raanan .
ACM TRANSACTIONS ON GRAPHICS, 2014, 34 (01)
[10]   Res2Net: A New Multi-Scale Backbone Architecture [J].
Gao, Shang-Hua ;
Cheng, Ming-Ming ;
Zhao, Kai ;
Zhang, Xin-Yu ;
Yang, Ming-Hsuan ;
Torr, Philip .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (02) :652-662