Real-World Image Deblurring via Unsupervised Domain Adaptation

被引:1
作者
Liu, Hanzhou [1 ]
Li, Binghan [1 ]
Lu, Mi [1 ]
Wu, Yucheng [2 ]
机构
[1] Texas A&M Univ, College Stn, TX 77843 USA
[2] Columbia Univ, New York, NY USA
来源
ADVANCES IN VISUAL COMPUTING, ISVC 2023, PT II | 2023年 / 14362卷
关键词
Image deblurring; Unsupervised domain adaptation; Deep learning;
D O I
10.1007/978-3-031-47966-3_12
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Most deep learning models for image deblurring are trained on pairs of clean images and their blurry counterparts, where the blurry inputs are artificially generated. However, it is impossible for these synthesized blurry images to cover all the real-world blur. Even in two synthetic datasets, the blur type, illumination, and other important image parameters could be different. Consequently, the performance of most existing deblurring models decreases when applied to real-world images and artificial blurry images from a different synthetic dataset. Very few previous deblurring works consider the gap among blurry images from different domains. Inspired by the current success of unsupervised domain adaptation (UDA) on image classification tasks, we develop, UDA-Deblur, a novel deblurring framework that utilizes domain alignment to attenuate effects of the aforementioned gap. In our work, channel attention modules are adopted to exploit the inter-channel relationship for features; multi-scale feature classifiers are designed to discriminate domain difference. UDA-Deblur is trained adversarially to align the feature distributions of the source domain and the target domain. We provide adequate quantitative and qualitative analysis to show the state-ofthe-art performance of UDA-Deblur. Firstly, we evaluate the proposed UDA-Deblur on synthesized datasets related to real-life scenarios, which achieves satisfying deblurring results. We further demonstrate that our approach also outperforms prior models on real-world blurry images. For a persuasive comparison, we carefully design experiments on GoPro, HIDE and ReaBlur datasets. More importantly, this is the first work considering real-world image deblurring from a feature-level domain adaptation perspective.
引用
收藏
页码:148 / 159
页数:12
相关论文
共 43 条
[1]  
Binghan Li, 2018, 2018 5th International Conference on Computational Science and Computational Intelligence (CSCI), P307, DOI 10.1109/CSCI46756.2018.00066
[2]   A Neural Approach to Blind Motion Deblurring [J].
Chakrabarti, Ayan .
COMPUTER VISION - ECCV 2016, PT III, 2016, 9907 :221-235
[3]  
CHARBONNIER P, 1994, IEEE IMAGE PROC, P168
[4]  
Cho TS, 2011, PROC CVPR IEEE, P241, DOI 10.1109/CVPR.2011.5995479
[5]  
Ganin Y, 2016, J MACH LEARN RES, V17
[6]  
Ganin Y, 2015, PR MACH LEARN RES, V37, P1180
[7]   Deep Reconstruction-Classification Networks for Unsupervised Domain Adaptation [J].
Ghifary, Muhammad ;
Kleijn, W. Bastiaan ;
Zhang, Mengjie ;
Balduzzi, David ;
Li, Wen .
COMPUTER VISION - ECCV 2016, PT IV, 2016, 9908 :597-613
[8]  
HRADIS M, 2015, P BMVC, V10
[9]   Deblurring Low-light Images with Light Streaks [J].
Hu, Zhe ;
Cho, Sunghyun ;
Wang, Jue ;
Yang, Ming-Hsuan .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :3382-3389
[10]   Dilated Fully Convolutional Neural Network for Depth Estimation from a Single Image [J].
Hua, Yindong ;
Liu, Yifeng ;
Li, Binghan ;
Lu, Mi .
2019 6TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND COMPUTATIONAL INTELLIGENCE (CSCI 2019), 2019, :612-616