Dark and Bright Channel Prior Embedded Network for Dynamic Scene Deblurring

被引:77
作者
Cai, Jianrui [1 ]
Zuo, Wangmeng [2 ,3 ]
Zhang, Lei [1 ,4 ]
机构
[1] Hong Kong Polytech Univ, Dept Comp, Hong Kong, Peoples R China
[2] Harbin Inst Technol, Sch Comp Sci & Technol, Harbin 150001, Peoples R China
[3] Peng Cheng Lab, Shenzhen 518066, Peoples R China
[4] DAMO Acad, Alibaba Grp, Hangzhou 311121, Peoples R China
关键词
Image restoration; Kernel; Network architecture; Optimization; Machine learning; Training; Convolutional neural networks; Dynamic scene deblurring; convolutional neural network; dark and bright channel priors; multi-scale strategy; BLIND; DECONVOLUTION;
D O I
10.1109/TIP.2020.2995048
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recent years have witnessed the significant progress on convolutional neural networks (CNNs) in dynamic scene deblurring. While most of the CNN models are generally learned by the reconstruction loss defined on training data, incorporating suitable image priors as well as regularization terms into the network architecture could boost the deblurring performance. In this work, we propose a Dark and Bright Channel Priors embedded Network (DBCPeNet) to plug the channel priors into a neural network for effective dynamic scene deblurring. A novel trainable dark and bright channel priors embedded layer (DBCPeL) is developed to aggregate both channel priors and blurry image representations, and a sparse regularization is introduced to regularize the DBCPeNet model learning. Furthermore, we present an effective multi-scale network architecture, namely image full scale exploitation (IFSE), which works in both coarse-to-fine and fine-to-coarse manners for better exploiting information flow across scales. Experimental results on the GoPro and Kohler datasets show that our proposed DBCPeNet performs favorably against state-of-the-art deep image deblurring methods in terms of both quantitative metrics and visual quality.
引用
收藏
页码:6885 / 6897
页数:13
相关论文
共 49 条
[1]  
[Anonymous], 2014, Comput. Sci.
[2]  
[Anonymous], PROC CVPR IEEE
[3]  
[Anonymous], In NIPS
[4]  
[Anonymous], 2017, P ICCV OCT
[5]  
[Anonymous], 2017, P INT C LEARN REPR
[6]  
[Anonymous], 2017, PROC CVPR IEEE, DOI DOI 10.1109/CVPR.2017.405
[7]  
[Anonymous], 2010, JMLR WORKSH C P
[8]   Learning a Deep Single Image Contrast Enhancer from Multi-Exposure Images [J].
Cai, Jianrui ;
Gu, Shuhang ;
Zhang, Lei .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (04) :2049-2062
[9]   A Neural Approach to Blind Motion Deblurring [J].
Chakrabarti, Ayan .
COMPUTER VISION - ECCV 2016, PT III, 2016, 9907 :221-235
[10]   Total variation blind deconvolution [J].
Chan, TF ;
Wong, CK .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 1998, 7 (03) :370-375