Image Deblurring With Image Blurring

被引:7
作者
Li, Ziyao [1 ]
Gao, Zhi [1 ]
Yi, Han [2 ]
Fu, Yu [3 ]
Chen, Boan [1 ]
机构
[1] Wuhan Univ, Sch Remote Sensing & Informat Engn, Wuhan 430079, Peoples R China
[2] Natl Univ Singapore, Sch Comp, Singapore 117417, Singapore
[3] Univ Calif Los Angeles, Henry Samueli Sch Engn & Appl Sci, Los Angeles, CA 90095 USA
基金
中国国家自然科学基金;
关键词
Deep learning; disentanglement representation; image deblurring; image blurring; scale-recurrent;
D O I
10.1109/TIP.2023.3321515
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning (DL) based methods for motion deblurring, taking advantage of large-scale datasets and sophisticated network structures, have reported promising results. However, two challenges still remain: existing methods usually perform well on synthetic datasets but cannot deal with complex real-world blur, and in addition, over- and under-estimation of the blur will result in restored images that remain blurred and even introduce unwanted distortion. We propose a motion deblurring framework that includes a Blur Space Disentangled Network (BSDNet) and a Hierarchical Scale-recurrent Deblurring Network (HSDNet) to address these issues. Specifically, we train an image blurring model to facilitate learning a better image deblurring model. Firstly, BSDNet learns how to separate the blur features from blurry images, which is adaptable for blur transferring, dataset augmentation, and ultimately directing the deblurring model. Secondly, to gradually recover sharp information in a coarse-to-fine manner, HSDNet makes full use of the blur features acquired by BSDNet as a priori and breaks down the non-uniform deblurring task into various subtasks. Moreover, the motion blur dataset created by BSDNet also bridges the gap between training images and actual blur. Extensive experiments on real-world blur datasets demonstrate that our method works effectively on complex scenarios, resulting in the best performance that significantly outperforms many state-of-the-art approaches.
引用
收藏
页码:5595 / 5609
页数:15
相关论文
共 72 条
[1]   Towards Open-Set Identity Preserving Face Synthesis [J].
Bao, Jianmin ;
Chen, Dong ;
Wen, Fang ;
Li, Houqiang ;
Hua, Gang .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :6713-6722
[2]  
Bell S, 2015, Arxiv, DOI arXiv:1512.04143
[3]  
Bengio Y, 2009, P 26 ANN INT C MACH, P41, DOI [10.1145/1553374.1553380, DOI 10.1145/1553374.1553380]
[4]  
Boyu Lu, 2019, IEEE Transactions on Biometrics, Behavior, and Identity Science, V1, P42, DOI 10.1109/TBIOM.2018.2890577
[5]   Learning to Synthesize Motion Blur [J].
Brooks, Tim ;
Barron, Jonathan T. .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :6833-6841
[6]   Dark and Bright Channel Prior Embedded Network for Dynamic Scene Deblurring [J].
Cai, Jianrui ;
Zuo, Wangmeng ;
Zhang, Lei .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :6885-6897
[7]   A Neural Approach to Blind Motion Deblurring [J].
Chakrabarti, Ayan .
COMPUTER VISION - ECCV 2016, PT III, 2016, 9907 :221-235
[8]   Total variation blind deconvolution [J].
Chan, TF ;
Wong, CK .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 1998, 7 (03) :370-375
[9]   Attention-adaptive and deformable convolutional modules for dynamic scene deblurring [J].
Chen, Lei ;
Sun, Quansen ;
Wang, Fanhai .
INFORMATION SCIENCES, 2021, 546 :368-377
[10]   Simple Baselines for Image Restoration [J].
Chen, Liangyu ;
Chu, Xiaojie ;
Zhang, Xiangyu ;
Sun, Jian .
COMPUTER VISION, ECCV 2022, PT VII, 2022, 13667 :17-33