DedustGAN: Unpaired learning for image dedusting based on Retinex with GANs

被引:14
作者
Meng, Xianglong [1 ]
Huang, Jiayan [2 ]
Li, Zuoyong [3 ]
Wang, Chuansheng [4 ]
Teng, Shenghua [1 ]
Grau, Antoni [4 ]
机构
[1] Shandong Univ Sci & Technol, Coll Elect & Informat Engn, Qingdao 266590, Peoples R China
[2] Putian Univ, New Engn Ind Coll, Putian 351100, Peoples R China
[3] Minjiang Univ, Coll Comp & Control Engn, Fujian Prov Key Lab Informat Proc & Intelligent C, Fuzhou 350121, Peoples R China
[4] Univ Politecn Cataluna, Dept Automat Control, Barcelona 08034, Spain
关键词
Image dedusting; Unpaired learning; Retinex; GANs; QUALITY ASSESSMENT; ENHANCEMENT; ALGORITHM; NETWORK;
D O I
10.1016/j.eswa.2023.122844
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image dedusting has gained increasing attention as a preprocessing step for computer vision tasks. Current traditional image dedusting methods rely on a variety of constraints or priors, which are easy to be limited in real complex dusty scenes. Recently, some paired learning CNN methods have been proposed. However, they usually imitate the idea of image dehazing and fail to consider the inherent natural characteristics of dusty images. To bridge this gap, we propose an unpaired learning algorithm for image dedusting based on Retinex with GANs (DedustGAN). Specifically, we first design the DedustGAN with two branches, one branch uses Retinex to obtain one preliminary dedusted image in a physical way, and the other branch uses GANs to obtain another preliminary dedusted image in a learning way. Then, we design a no-reference image fusion strategy to fuse the two preliminary dedusted images for outputting the final dedusted image. The proposed DedustGAN breaks the restriction of existing paired learning methods that require paired images for network training and provide an effective physical dedusting model. Qualitative and quantitative experimental comparisons demonstrate the powerful dedusting ability of the Retinex model and the superiority of DedustGAN over the existing methods. In addition, to validate the strong generalization of the proposed DedustGAN, we further performed experiments on underwater image enhancement and low-light image enhancement tasks. We found that the effectiveness of DedustGAN even outperforms the existing methods in their domains. The code of the proposed DedustGAN is available at https://github.com/MXL696/DedustGAN.
引用
收藏
页数:16
相关论文
共 70 条
[1]  
Alsaeedi AH, 2023, Arxiv, DOI arXiv:2307.15230
[2]  
Ancuti C, 2012, PROC CVPR IEEE, P81, DOI 10.1109/CVPR.2012.6247661
[3]   Tiny Object Detection via Regional Cross Self-Attention Network [J].
Cheng, Keyang ;
Cui, Honggang ;
Ghafoor, Humaira Abdul ;
Wan, Hao ;
Mao, Qirong ;
Zhan, Yongzhao .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (10) :8984-8996
[4]   A Fast Sand-Dust Image Enhancement Algorithm by Blue Channel Compensation and Guided Image Filtering [J].
Cheng, Yaqiao ;
Jia, Zhenhong ;
Lai, Huicheng ;
Yang, Jie ;
Kasabov, Nikola K. .
IEEE ACCESS, 2020, 8 :196690-196699
[5]   Color image denoising via sparse 3d collaborative filtering with grouping constraint in luminance-chrominance space [J].
Dabov, Kostadin ;
Foi, Alessandro ;
Katkovnik, Vladimir ;
Egiazarian, Karen .
2007 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-7, 2007, :313-316
[6]   HardGAN: A Haze-Aware Representation Distillation GAN for Single Image Dehazing [J].
Deng, Qili ;
Huang, Ziling ;
Tsai, Chung-Chi ;
Lin, Chia-Wen .
COMPUTER VISION - ECCV 2020, PT VI, 2020, 12351 :722-738
[7]   Restoration of Single Sand-Dust Image Based on Style Transformation and Unsupervised Adversarial Learning [J].
Ding, Bosheng ;
Chen, Huimin ;
Xu, Lixin ;
Zhang, Ruiheng .
IEEE ACCESS, 2022, 10 :90092-90100
[8]   Underwater Depth Estimation and Image Restoration Based on Single Images [J].
Drews, Paulo L. J., Jr. ;
Nascimento, Erickson R. ;
Botelho, Silvia S. C. ;
Montenegro Campos, Mario Fernando .
IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2016, 36 (02) :24-35
[9]   Cycle-Dehaze: Enhanced CycleGAN for Single Image Dehazing [J].
Engin, Deniz ;
Genc, Anil ;
Ekenel, Hazim Kemal .
PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, :938-946
[10]   Multiscale Low-Light Image Enhancement Network With Illumination Constraint [J].
Fan, Guo-Dong ;
Fan, Bi ;
Gan, Min ;
Chen, Guang-Yong ;
Chen, C. L. Philip .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (11) :7403-7417