Uncertainty-Aware Variate Decomposition for Self-supervised Blind Image Deblurring

被引:2
作者
Jiang, Runhua [1 ]
Han, Yahong [1 ]
机构
[1] Tianjin Univ, Coll Intelligence & Comp, Tianjin, Peoples R China
来源
PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023 | 2023年
基金
中国国家自然科学基金;
关键词
Self-supervised image deblirrung; residual image; multi-variate decomposition;
D O I
10.1145/3581783.3612535
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Blind image deblurring remains challenging due to the ill-posed nature of the traditional blurring function. Although previous supervised methods have achieved great breakthrough with synthetic blurry-sharp image pairs, their generalization ability to real-world blurs is limited by the discrepancy between synthetic and real blurs. To overcome this limitation, unsupervised deblurring methods have been proposed by using natural priors or generative adversarial networks. However, natural priors are vulnerable to random blur artifacts, while generators of generative adversarial networks always produce inaccurate details and unrealistic colors. Consequently, previous methods easily suffer from slow convergence and poor performance. In this work, we propose to formulate the traditional blurring function as the composition of multiple variates, thus allowing us explicitly define characteristics of residual images between blurry and sharp images. We also propose a multi-step self-supervised deblurring framework to address the slow convergence issue. Our framework continuously decomposes and composes input images, thus utilizing the uncertainty of blur artifacts to obtain diverse pseudo blurry-sharp image pairs for self-supervised learning. This framework is more efficient than previous methods, as it does not rely on natural priors or GANs. Extensive comparisons demonstrate that the proposed framework outperforms state-of-the-art unsupervised methods on both dynamic scene, human-aware centric motion, real-world and out-of-focus deblurring datasets. The codes are available at https://github.com/ddghjikle/MM-2023-USDF.
引用
收藏
页码:252 / 260
页数:9
相关论文
共 43 条
[1]   Learning to Reduce Defocus Blur by Realistically Modeling Dual-Pixel Data [J].
Abuolaim, Abdullah ;
Delbracio, Mauricio ;
Kelly, Damien ;
Brown, Michael S. ;
Milanfar, Peyman .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :2269-2278
[2]   Defocus Deblurring Using Dual-Pixel Data [J].
Abuolaim, Abdullah ;
Brown, Michael S. .
COMPUTER VISION - ECCV 2020, PT X, 2020, 12355 :111-126
[3]  
Carbajal G, 2021, Arxiv, DOI [arXiv:2102.01026, DOI 10.48550/ARXIV.2102.01026]
[4]  
Chen HJ, 2018, IEEE INT CONF COMPUT
[5]   Learning Spatially-Variant MAP Models for Non-blind Image Deblurring [J].
Dong, Jiangxin ;
Roth, Stefan ;
Schiele, Bernt .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :4884-4893
[6]   Blind Image Decomposition [J].
Han, Junlin ;
Li, Weihao ;
Fang, Pengfei ;
Sun, Chunyi ;
Hong, Jie ;
Armin, Mohammad Ali ;
Petersson, Lars ;
Li, Hongdong .
COMPUTER VISION - ECCV 2022, PT XVIII, 2022, 13678 :218-237
[7]   Dual Contrastive Learning for Unsupervised Image-to-Image Translation [J].
Han, Junlin ;
Shoeiby, Mehrdad ;
Petersson, Lars ;
Armin, Mohammad Ali .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, :746-755
[8]   Noise-Blind Image Deblurring [J].
Jin, Meiguang ;
Roth, Stefan ;
Favaro, Paolo .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :3834-3842
[9]   Edge-Based Defocus Blur Estimation With Adaptive Scale Selection [J].
Karaali, Ali ;
Jung, Claudio Rosito .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (03) :1126-1137
[10]  
King DB, 2015, ACS SYM SER, V1214, P1, DOI 10.1021/bk-2015-1214.ch001