COUPLING FORWARD-BACKWARD WITH PENALTY SCHEMES AND PARALLEL SPLITTING FOR CONSTRAINED VARIATIONAL INEQUALITIES

被引:51
作者
Attouch, Hedy [1 ]
Czarnecki, Marc-Olivier [1 ]
Peypouquet, Juan [2 ]
机构
[1] Univ Montpellier 2, CNRS, UMR 5149, Inst Math & Modelisat Montpellier, F-34095 Montpellier 5, France
[2] Univ Tecn Federico Santa Maria, Dept Matemat, Valparaiso, Chile
关键词
cocoercive operators; compressive sensing; constrained convex optimization; coupled systems; forward-backward algorithms; hierarchical optimization; maximal monotone operators; parallel splitting methods; Passty's theorem; penalization methods; variational inequalities; MAXIMAL MONOTONE-OPERATORS; EVOLUTION-EQUATIONS; ASYMPTOTIC CONVERGENCE; SIGNAL RECOVERY; PENALIZATION;
D O I
10.1137/110820300
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We are concerned with the study of a class of forward-backward penalty schemes for solving variational inequalities 0 is an element of Ax + N-C(x) where H is a real Hilbert space, A : H paired right arrows H is a maximal monotone operator, and N-C is the outward normal cone to a closed convex set C subset of H. Let Psi : H -> R be a convex differentiable function whose gradient is Lipschitz continuous and which acts as a penalization function with respect to the constraint x is an element of C. Given a sequence (beta(n)) of penalization parameters which tends to infinity, and a sequence of positive time steps (lambda(n)) is an element of l(2)\l(1), we consider the diagonal forward-backward algorithm x(n+1) = (I + lambda(n)A)(-1)(x(n) - lambda(n)beta(n)del Psi(x(n))). Assuming that (beta(n)) satisfies the growth condition limsup(n ->infinity)lambda(n)beta(n) < 2/theta (where theta is the Lipschitz constant of del Psi), we obtain weak ergodic convergence of the sequence (x(n)) to an equilibrium for a general maximal monotone operator A. We also obtain weak convergence of the whole sequence (x(n)) when A is the subdifferential of a proper lower-semicontinuous convex function. As a key ingredient of our analysis, we use the cocoerciveness of the operator del Psi. When specializing our results to coupled systems, we bring new light to Passty's theorem and obtain convergence results of new parallel splitting algorithms for variational inequalities involving coupling in the constraint. We also establish robustness and stability results that account for numerical approximation errors. An illustration of compressive sensing is given.
引用
收藏
页码:1251 / 1274
页数:24
相关论文
共 31 条
[21]   Compressed sensing [J].
Donoho, DL .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2006, 52 (04) :1289-1306
[22]   Sparse nonnegative solution of underdetermined linear equations by linear programming [J].
Donoho, DL ;
Tanner, J .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2005, 102 (27) :9446-9451
[23]   EXACT REGULARIZATION OF CONVEX PROGRAMS [J].
Friedlander, Michael P. ;
Tseng, Paul .
SIAM JOURNAL ON OPTIMIZATION, 2008, 18 (04) :1326-1350
[24]  
Lehdili N., 1996, Optimization, V37, P239, DOI 10.1080/02331939608844217
[25]   ITERATIVE SOLUTION OF VARIATIONAL INEQUALITY [J].
LIONS, PL .
ISRAEL JOURNAL OF MATHEMATICS, 1978, 31 (02) :204-208
[27]   ERGODIC CONVERGENCE TO A ZERO OF THE SUM OF MONOTONE-OPERATORS IN HILBERT-SPACE [J].
PASSTY, GB .
JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS, 1979, 72 (02) :383-390
[28]  
PEYPOUQUET J, J OPTIM THE IN PRESS
[29]  
Peypouquet J, 2010, J CONVEX ANAL, V17, P1113
[30]  
Peypouquet J, 2009, J CONVEX ANAL, V16, P277