On Plug-and-Play Regularization Using Linear Denoisers

被引:27
作者
Gavaskar, Ruturaj G. [1 ]
Athalye, Chirayu D. [1 ]
Chaudhury, Kunal N. [1 ]
机构
[1] Indian Inst Sci, Dept Elect Engn, Bengaluru 560012, India
关键词
Image reconstruction; plug-and-play regularization; linear denoiser; proximal map; convergence; CONVERGENCE; ALGORITHM; FILTERS; PRIORS;
D O I
10.1109/TIP.2021.3075092
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In plug-and-play (PnP) regularization, the knowledge of the forward model is combined with a powerful denoiser to obtain state-of-the-art image reconstructions. This is typically done by taking a proximal algorithm such as FISTA or ADMM, and formally replacing the proximal map associated with a regularizer by nonlocal means, BM3D or a CNN denoiser. Each iterate of the resulting PnP algorithm involves some kind of inversion of the forward model followed by denoiser-induced regularization. A natural question in this regard is that of optimality, namely, do the PnP iterations minimize some f + g, where f is a loss function associated with the forward model and g is a regularizer? This has a straightforward solution if the denoiser can be expressed as a proximal map, as was shown to be the case for a class of linear symmetric denoisers. However, this result excludes kernel denoisers such as nonlocal means that are inherently nonsymmetric. In this paper, we prove that a broader class of linear denoisers (including symmetric denoisers and kernel denoisers) can be expressed as a proximal map of some convex regularizer g. An algorithmic implication of this result for non-symmetric denoisers is that it necessitates appropriate modifications in the PnP updates to ensure convergence to a minimum of f + g. Apart from the convergence guarantee, the modified PnP algorithms are shown to produce good restorations.
引用
收藏
页码:4802 / 4813
页数:12
相关论文
共 56 条
[1]   Convex Optimization: Algorithms and Complexity [J].
不详 .
FOUNDATIONS AND TRENDS IN MACHINE LEARNING, 2015, 8 (3-4) :232-+
[2]  
[Anonymous], 2013, INVERSE ACOUSTIC ELE, DOI DOI 10.1007/978-1-4614-4942-3
[3]  
Bauschke HH, 2011, CMS BOOKS MATH, P1, DOI 10.1007/978-1-4419-9467-7
[4]   A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems [J].
Beck, Amir ;
Teboulle, Marc .
SIAM JOURNAL ON IMAGING SCIENCES, 2009, 2 (01) :183-202
[5]   Modern regularization methods for inverse problems [J].
Benning, Martin ;
Burger, Martin .
ACTA NUMERICA, 2018, 27 :1-111
[6]   Distributed optimization and statistical learning via the alternating direction method of multipliers [J].
Boyd S. ;
Parikh N. ;
Chu E. ;
Peleato B. ;
Eckstein J. .
Foundations and Trends in Machine Learning, 2010, 3 (01) :1-122
[7]   A non-local algorithm for image denoising [J].
Buades, A ;
Coll, B ;
Morel, JM .
2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 2, PROCEEDINGS, 2005, :60-65
[8]   On the Convergence of the Iterates of the "Fast Iterative Shrinkage/Thresholding Algorithm" [J].
Chambolle, A. ;
Dossal, Ch. .
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2015, 166 (03) :968-982
[9]  
Chambolle A., 2010, An Introduction to Total Variation for Image Analysis, V9, P227
[10]   Plug-and-Play ADMM for Image Restoration: Fixed-Point Convergence and Applications [J].
Chan, Stanley H. ;
Wang, Xiran ;
Elgendy, Omar A. .
IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2017, 3 (01) :84-98