Extrapolated Plug-and-Play Three-Operator Splitting Methods for Nonconvex Optimization with Applications to Image Restoration

被引:1
作者
Wu, Zhongming [1 ]
Huang, Chaoyan [2 ]
Zeng, Tieyong [2 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Management Sci & Engn, Nanjing 210044, Peoples R China
[2] Chinese Univ Hong Kong, Dept Math, Shatin, Hong Kong, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
plug-and-play; three-operator splitting method; nonconvex optimization; denoising prior; conver-gence guarantee; ALTERNATING LINEARIZED MINIMIZATION; FORWARD-BACKWARD ALGORITHM; CONVERGENCE ANALYSIS; PROXIMAL ALGORITHMS; REGULARIZATION; ENVELOPE; MODEL; ADMM; SUM;
D O I
10.1137/23M1611166
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper investigates the convergence properties and applications of the three-operator splitting method, also known as the Davis--Yin splitting (DYS) method, integrated with extrapolation and plug-and-play (PnP) denoiser within a nonconvex framework. We first propose an extrapolated DYS method to effectively solve a class of structural nonconvex optimization problems that involve minimizing the sum of three possibly nonconvex functions. Our approach provides an algorithmic framework that encompasses both extrapolated forward-backward splitting and extrapolated Douglas-Rachford splitting methods. To establish the convergence of the proposed method, we rigorously analyze its behavior based on the Kurdyka--\Lojasiewicz property, subject to some tight parameter conditions. Moreover, we introduce two extrapolated PnP-DYS methods with convergence guarantee, where the traditional regularization step is replaced by a gradient step--based denoiser. This denoiser is designed using a differentiable neural network and can be reformulated as the proximal operator of a specific nonconvex functional. We conduct extensive experiments on image deblurring and image superresolution problems, where our numerical results showcase the advantage of the extrapolation strategy and the superior performance of the learning-based model that incorporates the PnP denoiser in terms of achieving high-quality recovery images.
引用
收藏
页码:1145 / 1181
页数:37
相关论文
共 80 条
[1]   A BREGMAN FORWARD-BACKWARD LINESEARCH ALGORITHM FOR NONCONVEX COMPOSITE OPTIMIZATION: SUPERLINEAR CONVERGENCE TO NONISOLATED LOCAL MINIMA [J].
Ahookhosh, Masoud ;
Themelis, Andreas ;
Patrinos, Panagiotis .
SIAM JOURNAL ON OPTIMIZATION, 2021, 31 (01) :653-685
[2]   A DYNAMICAL APPROACH TO AN INERTIAL FORWARD-BACKWARD ALGORITHM FOR CONVEX MINIMIZATION [J].
Attouch, Hedy ;
Peypouquet, Juan ;
Redont, Patrick .
SIAM JOURNAL ON OPTIMIZATION, 2014, 24 (01) :232-256
[3]   Convergence of descent methods for semi-algebraic and tame problems: proximal algorithms, forward-backward splitting, and regularized Gauss-Seidel methods [J].
Attouch, Hedy ;
Bolte, Jerome ;
Svaiter, Benar Fux .
MATHEMATICAL PROGRAMMING, 2013, 137 (1-2) :91-129
[4]   Proximal Alternating Minimization and Projection Methods for Nonconvex Problems: An Approach Based on the Kurdyka-Lojasiewicz Inequality [J].
Attouch, Hedy ;
Bolte, Jerome ;
Redont, Patrick ;
Soubeyran, Antoine .
MATHEMATICS OF OPERATIONS RESEARCH, 2010, 35 (02) :438-457
[5]  
Barakat A, 2020, PR MACH LEARN RES, V129, P225
[6]   A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems [J].
Beck, Amir ;
Teboulle, Marc .
SIAM JOURNAL ON IMAGING SCIENCES, 2009, 2 (01) :183-202
[7]   A THREE-OPERATOR SPLITTING ALGORITHM FOR NONCONVEX SPARSITY REGULARIZATION [J].
Bian, Fengmiao ;
Zhang, Xiaoqun .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2021, 43 (04) :A2809-A2839
[8]   Proximal alternating linearized minimization for nonconvex and nonsmooth problems [J].
Bolte, Jerome ;
Sabach, Shoham ;
Teboulle, Marc .
MATHEMATICAL PROGRAMMING, 2014, 146 (1-2) :459-494
[9]   An inertial forward-backward algorithm for the minimization of the sum of two nonconvex functions [J].
Bot, Radu Ioan ;
Csetnek, Erno Robert ;
Laszlo, Szilard Csaba .
EURO JOURNAL ON COMPUTATIONAL OPTIMIZATION, 2016, 4 (01) :3-25
[10]   Plug-and-Play Unplugged: Optimization-Free Reconstruction Using Consensus Equilibrium [J].
Buzzard, Gregery T. ;
Chan, Stanley H. ;
Sreehari, Suhas ;
Bouman, Charles A. .
SIAM JOURNAL ON IMAGING SCIENCES, 2018, 11 (03) :2001-2020