Newton-Like Dynamics and Forward-Backward Methods for Structured Monotone Inclusions in Hilbert Spaces

被引:80
作者
Abbas, B. [1 ]
Attouch, H. [1 ]
Svaiter, Benar F. [2 ]
机构
[1] Univ Montpellier 2, UMR CNRS 5149 I3M, F-34095 Montpellier, France
[2] IMPA, BR-22460320 Rio De Janeiro, Brazil
关键词
Monotone inclusions; Newton method; Levenberg-Marquardt regularization; Dissipative dynamical systems; Lyapunov analysis; Weak asymptotic convergence; Forward-backward algorithms; Gradient-projection methods; CONVERGENCE; EQUATIONS; OPERATORS;
D O I
10.1007/s10957-013-0414-5
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
In a Hilbert space setting we introduce dynamical systems, which are linked to Newton and Levenberg-Marquardt methods. They are intended to solve, by splitting methods, inclusions governed by structured monotone operators M=A+B, where A is a general maximal monotone operator, and B is monotone and locally Lipschitz continuous. Based on the Minty representation of A as a Lipschitz manifold, we show that these dynamics can be formulated as differential systems, which are relevant to the Cauchy-Lipschitz theorem, and involve separately B and the resolvents of A. In the convex subdifferential case, by using Lyapunov asymptotic analysis, we prove a descent minimizing property and weak convergence to equilibria of the trajectories. Time discretization of these dynamics gives algorithms combining Newton's method and forward-backward methods for solving structured monotone inclusions.
引用
收藏
页码:331 / 360
页数:30
相关论文
共 22 条
[1]   A second-order gradient-like dissipative dynamical system with Hessian-driven damping. Application to optimization and mechanics [J].
Alvarez, F ;
Attouch, H ;
Bolte, J ;
Redont, P .
JOURNAL DE MATHEMATIQUES PURES ET APPLIQUEES, 2002, 81 (08) :747-779
[2]  
[Anonymous], 1973, Operateurs maximaux monotones et semi-groupes de contractions dans les espaces de Hilbert
[3]  
ANTIPIN AS, 1994, DIFF EQUAT+, V30, P1365
[4]   Global Convergence of a Closed-Loop Regularized Newton Method for Solving Monotone Inclusions in Hilbert Spaces [J].
Attouch, H. ;
Redont, P. ;
Svaiter, B. F. .
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2013, 157 (03) :624-650
[5]   A CONTINUOUS DYNAMICAL NEWTON-LIKE APPROACH TO SOLVING MONOTONE INCLUSIONS [J].
Attouch, H. ;
Svaiter, B. F. .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2011, 49 (02) :574-598
[6]  
Attouch H, 2012, DIFFER EQUAT APPL, V4, P27
[7]   A PARALLEL SPLITTING METHOD FOR COUPLED MONOTONE INCLUSIONS [J].
Attouch, Hedy ;
Briceno-Arias, Luis M. ;
Combettes, Patrick L. .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2010, 48 (05) :3246-3270
[8]  
Bauschke HH, 2011, CMS BOOKS MATH, P1, DOI 10.1007/978-1-4419-9467-7
[9]  
Beck A., 2010, Convex Optimization in Signal Processing and Communications, P33
[10]   Continuous gradient projection method in Hilbert spaces [J].
Bolte, J .
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2003, 119 (02) :235-259