Dark and Bright Channel Prior Embedded Network for Dynamic Scene Deblurring

被引:67
作者
Cai, Jianrui [1 ]
Zuo, Wangmeng [2 ,3 ]
Zhang, Lei [1 ,4 ]
机构
[1] Hong Kong Polytech Univ, Dept Comp, Hong Kong, Peoples R China
[2] Harbin Inst Technol, Sch Comp Sci & Technol, Harbin 150001, Peoples R China
[3] Peng Cheng Lab, Shenzhen 518066, Peoples R China
[4] DAMO Acad, Alibaba Grp, Hangzhou 311121, Peoples R China
关键词
Image restoration; Kernel; Network architecture; Optimization; Machine learning; Training; Convolutional neural networks; Dynamic scene deblurring; convolutional neural network; dark and bright channel priors; multi-scale strategy; BLIND; DECONVOLUTION;
D O I
10.1109/TIP.2020.2995048
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recent years have witnessed the significant progress on convolutional neural networks (CNNs) in dynamic scene deblurring. While most of the CNN models are generally learned by the reconstruction loss defined on training data, incorporating suitable image priors as well as regularization terms into the network architecture could boost the deblurring performance. In this work, we propose a Dark and Bright Channel Priors embedded Network (DBCPeNet) to plug the channel priors into a neural network for effective dynamic scene deblurring. A novel trainable dark and bright channel priors embedded layer (DBCPeL) is developed to aggregate both channel priors and blurry image representations, and a sparse regularization is introduced to regularize the DBCPeNet model learning. Furthermore, we present an effective multi-scale network architecture, namely image full scale exploitation (IFSE), which works in both coarse-to-fine and fine-to-coarse manners for better exploiting information flow across scales. Experimental results on the GoPro and Kohler datasets show that our proposed DBCPeNet performs favorably against state-of-the-art deep image deblurring methods in terms of both quantitative metrics and visual quality.
引用
收藏
页码:6885 / 6897
页数:13
相关论文
共 49 条
  • [1] [Anonymous], PROC CVPR IEEE
  • [2] [Anonymous], 2015, NIPS 15 P 28 INT C N
  • [3] [Anonymous], 2017, ACM, DOI [DOI 10.1145/3065386, DOI 10.2165/00129785-200404040-00005]
  • [4] [Anonymous], 2017, PROC CVPR IEEE, DOI DOI 10.1109/CVPR.2017.405
  • [5] Arjovsky M., 2017, ARXIV170107875
  • [6] BAHAT Y, 2017, P IEEE C COMP VIS PA, P3286
  • [7] Learning a Deep Single Image Contrast Enhancer from Multi-Exposure Images
    Cai, Jianrui
    Gu, Shuhang
    Zhang, Lei
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (04) : 2049 - 2062
  • [8] A Neural Approach to Blind Motion Deblurring
    Chakrabarti, Ayan
    [J]. COMPUTER VISION - ECCV 2016, PT III, 2016, 9907 : 221 - 235
  • [9] Total variation blind deconvolution
    Chan, TF
    Wong, CK
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 1998, 7 (03) : 370 - 375
  • [10] Fast Motion Deblurring
    Cho, Sunghyun
    Lee, Seungyong
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2009, 28 (05): : 1 - 8