NEWTON-LIKE INERTIAL DYNAMICS AND PROXIMAL ALGORITHMS GOVERNED BY MAXIMALLY MONOTONE OPERATORS

被引:29
作者
Attouch, Hedy [1 ]
Laszlo, Szilard Csaba [2 ]
机构
[1] Univ Montpellier, IMAG, CNRS, Pl Eugene Bataillon, F-34095 Montpellier 5, France
[2] Tech Univ Cluj Napoca, Dept Math, Cluj Napoca, Romania
关键词
damped inertial dynamics; Hessian damping; large step proximal method; Lyapunov analysis; maximally monotone operators; Newton method; time-dependent viscosity; vanishing viscosity; Yosida regularization; CONVERGENCE; OPTIMIZATION; INCLUSIONS; SYSTEM;
D O I
10.1137/20M1333316
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
The introduction of the Hessian damping in the continuous version of Nesterov's accelerated gradient method provides, by temporal discretization, fast proximal gradient algorithms where the oscillations are significantly attenuated. We will extend these results to the maximally monotone case. We rely on the technique introduced by Attouch and Peypouquet [Math. Program., 174 (2019), pp. 391-432], where the maximally monotone operator is replaced by its Yosida approximation with an appropriate adjustment of the regularization parameter. In a general Hilbert framework, we obtain the weak convergence of the iterates to equilibria, and the rapid convergence of the discrete velocities to zero. By specializing these algorithms to convex minimization, we obtain the convergence rate o (1/k(2)) of the values, and the rapid convergence of the gradients toward zero.
引用
收藏
页码:3252 / 3283
页数:32
相关论文
共 41 条
[1]   Newton-Like Dynamics and Forward-Backward Methods for Structured Monotone Inclusions in Hilbert Spaces [J].
Abbas, B. ;
Attouch, H. ;
Svaiter, Benar F. .
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2014, 161 (02) :331-360
[2]   A second-order gradient-like dissipative dynamical system with Hessian-driven damping. Application to optimization and mechanics [J].
Alvarez, F ;
Attouch, H ;
Bolte, J ;
Redont, P .
JOURNAL DE MATHEMATIQUES PURES ET APPLIQUEES, 2002, 81 (08) :747-779
[3]   An inertial proximal method for maximal monotone operators via discretization of a nonlinear oscillator with damping [J].
Alvarez, F ;
Attouch, H .
SET-VALUED ANALYSIS, 2001, 9 (1-2) :3-11
[4]   Convergence rate of inertial Forward-Backward algorithm beyond Nesterov's rule [J].
Apidopoulos, Vassilis ;
Aujol, Jean-Francois ;
Dossal, Charles .
MATHEMATICAL PROGRAMMING, 2020, 180 (1-2) :137-156
[5]   Global Convergence of a Closed-Loop Regularized Newton Method for Solving Monotone Inclusions in Hilbert Spaces [J].
Attouch, H. ;
Redont, P. ;
Svaiter, B. F. .
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2013, 157 (03) :624-650
[6]   A CONTINUOUS DYNAMICAL NEWTON-LIKE APPROACH TO SOLVING MONOTONE INCLUSIONS [J].
Attouch, H. ;
Svaiter, B. F. .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2011, 49 (02) :574-598
[7]   First-order optimization algorithms via inertial systems with Hessian driven damping [J].
Attouch, Hedy ;
Chbani, Zaki ;
Fadili, Jalal ;
Riahi, Hassan .
MATHEMATICAL PROGRAMMING, 2022, 193 (01) :113-155
[8]   Convergence of a relaxed inertial proximal algorithm for maximally monotone operators [J].
Attouch, Hedy ;
Cabot, Alexandre .
MATHEMATICAL PROGRAMMING, 2020, 184 (1-2) :243-287
[9]   Convergence of a Relaxed Inertial Forward-Backward Algorithm for Structured Monotone Inclusions [J].
Attouch, Hedy ;
Cabot, Alexandre .
APPLIED MATHEMATICS AND OPTIMIZATION, 2019, 80 (03) :547-598
[10]  
Attouch H, 2019, ESAIM CONTR OPTIM CA, V25, DOI 10.1051/cocv/2017083