Learning deep edge prior for image denoising

被引:33
作者
Fang, Yingying [1 ]
Zeng, Tieyong [2 ]
机构
[1] Hong Kong Baptist Univ, Dept Math, Kowloon, Hong Kong, Peoples R China
[2] Chinese Univ Hong Kong, Dept Math, Hong Kong, Peoples R China
基金
美国国家科学基金会;
关键词
Denoising; Variational model; Total variation; Edge prior; CNN; Interpretability; RESTORATION; ALGORITHM; RECOVERY;
D O I
10.1016/j.cviu.2020.103044
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image restoration is an important technique to deal with the degradation of the image. This paper presents an efficient and trusty denoising scheme, which combines the convolutional neural network (CNN) technique with the traditional variational model, to offer interpretable and high quality reconstructions. In this scheme, CNN, which has proven effectiveness in feature extraction tasks, is adopted to obtain the designed edge features from the noisy images, to be the prior of the reconstruction through an edge regularization. In the proposed denoising model, the total variation (TV) regularization is also adopted for its superior performance in allowing the sharp edges. The solution of the proposed model is obtained by using the Bregman splitting method, with the existence and the uniqueness of the solution also analyzed in this paper. Extensive experiments show that the two regularizations combined in the proposed model are able to fix the staircasing defects effectively and retrieve the fine textures in the recovered images as well, which outperforms the state-of-the-art interpretable denoising methods. Moreover, the proposed edge regularization can be easily extended into other kinds of noise or other restoration tasks, which implies the strong adaptivity of the proposed scheme.
引用
收藏
页数:13
相关论文
共 49 条
[1]   A Total Variation-Based JPEG Decompression Model [J].
Bredies, K. ;
Holler, M. .
SIAM JOURNAL ON IMAGING SCIENCES, 2012, 5 (01) :366-393
[2]   Total Generalized Variation [J].
Bredies, Kristian ;
Kunisch, Karl ;
Pock, Thomas .
SIAM JOURNAL ON IMAGING SCIENCES, 2010, 3 (03) :492-526
[3]   A non-local algorithm for image denoising [J].
Buades, A ;
Coll, B ;
Morel, JM .
2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 2, PROCEEDINGS, 2005, :60-65
[4]  
Burger M., 2015, IFIP C SYST MOD OPT, P169, DOI [10.1007/978-3-319-55795-315, DOI 10.1007/978-3-319-55795-315]
[5]   Data-driven tight frame construction and image denoising [J].
Cai, Jian-Feng ;
Ji, Hui ;
Shen, Zuowei ;
Ye, Gui-Bo .
APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS, 2014, 37 (01) :89-105
[7]   Image recovery via total variation minimization and related problems [J].
Chambolle, A ;
Lions, PL .
NUMERISCHE MATHEMATIK, 1997, 76 (02) :167-188
[8]   A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging [J].
Chambolle, Antonin ;
Pock, Thomas .
JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2011, 40 (01) :120-145
[9]   High-order total variation-based image restoration [J].
Chan, T ;
Marquina, A ;
Mulet, P .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2000, 22 (02) :503-516
[10]   A Compound Algorithm of Denoising Using Second-Order and Fourth-Order Partial Differential Equations [J].
Chang, Qianshun ;
Tai, Xuecheng ;
Xing, Lily .
NUMERICAL MATHEMATICS-THEORY METHODS AND APPLICATIONS, 2009, 2 (04) :353-376