COUPLING FORWARD-BACKWARD WITH PENALTY SCHEMES AND PARALLEL SPLITTING FOR CONSTRAINED VARIATIONAL INEQUALITIES

被引:51
作者
Attouch, Hedy [1 ]
Czarnecki, Marc-Olivier [1 ]
Peypouquet, Juan [2 ]
机构
[1] Univ Montpellier 2, CNRS, UMR 5149, Inst Math & Modelisat Montpellier, F-34095 Montpellier 5, France
[2] Univ Tecn Federico Santa Maria, Dept Matemat, Valparaiso, Chile
关键词
cocoercive operators; compressive sensing; constrained convex optimization; coupled systems; forward-backward algorithms; hierarchical optimization; maximal monotone operators; parallel splitting methods; Passty's theorem; penalization methods; variational inequalities; MAXIMAL MONOTONE-OPERATORS; EVOLUTION-EQUATIONS; ASYMPTOTIC CONVERGENCE; SIGNAL RECOVERY; PENALIZATION;
D O I
10.1137/110820300
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We are concerned with the study of a class of forward-backward penalty schemes for solving variational inequalities 0 is an element of Ax + N-C(x) where H is a real Hilbert space, A : H paired right arrows H is a maximal monotone operator, and N-C is the outward normal cone to a closed convex set C subset of H. Let Psi : H -> R be a convex differentiable function whose gradient is Lipschitz continuous and which acts as a penalization function with respect to the constraint x is an element of C. Given a sequence (beta(n)) of penalization parameters which tends to infinity, and a sequence of positive time steps (lambda(n)) is an element of l(2)\l(1), we consider the diagonal forward-backward algorithm x(n+1) = (I + lambda(n)A)(-1)(x(n) - lambda(n)beta(n)del Psi(x(n))). Assuming that (beta(n)) satisfies the growth condition limsup(n ->infinity)lambda(n)beta(n) < 2/theta (where theta is the Lipschitz constant of del Psi), we obtain weak ergodic convergence of the sequence (x(n)) to an equilibrium for a general maximal monotone operator A. We also obtain weak convergence of the whole sequence (x(n)) when A is the subdifferential of a proper lower-semicontinuous convex function. As a key ingredient of our analysis, we use the cocoerciveness of the operator del Psi. When specializing our results to coupled systems, we bring new light to Passty's theorem and obtain convergence results of new parallel splitting algorithms for variational inequalities involving coupling in the constraint. We also establish robustness and stability results that account for numerical approximation errors. An illustration of compressive sensing is given.
引用
收藏
页码:1251 / 1274
页数:24
相关论文
共 31 条
[1]   PENALIZATION IN NONCLASSICAL CONVEX-PROGRAMMING VIA VARIATIONAL CONVERGENCE [J].
ALART, P ;
LEMAIRE, B .
MATHEMATICAL PROGRAMMING, 1991, 51 (03) :307-331
[2]   Asymptotic almost-equivalence of Lipschitz evolution systems in Banach spaces [J].
Alvarez, Felipe ;
Peypouquet, Juan .
NONLINEAR ANALYSIS-THEORY METHODS & APPLICATIONS, 2010, 73 (09) :3018-3033
[3]   ASYMPTOTIC EQUIVALENCE AND KOBAYASHI-TYPE ESTIMATES FOR NONAUTONOMOUS MONOTONE OPERATORS IN BANACH SPACES [J].
Alvarez, Felipe ;
Peypouquet, Juan .
DISCRETE AND CONTINUOUS DYNAMICAL SYSTEMS, 2009, 25 (04) :1109-1128
[4]  
[Anonymous], 1973, Operateurs maximaux monotones et semi-groupes de contractions dans les espaces de Hilbert
[5]  
Attouch H, 2008, J CONVEX ANAL, V15, P485
[6]   PROX-PENALIZATION AND SPLITTING METHODS FOR CONSTRAINED VARIATIONAL PROBLEMS [J].
Attouch, Hedy ;
Czarnecki, Marc-Olivier ;
Peypouquet, Juan .
SIAM JOURNAL ON OPTIMIZATION, 2011, 21 (01) :149-173
[7]   A PARALLEL SPLITTING METHOD FOR COUPLED MONOTONE INCLUSIONS [J].
Attouch, Hedy ;
Briceno-Arias, Luis M. ;
Combettes, Patrick L. .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2010, 48 (05) :3246-3270
[8]   Asymptotic behavior of coupled dynamical systems with multiscale aspects [J].
Attouch, Hedy ;
Czarnecki, Marc-Olivier .
JOURNAL OF DIFFERENTIAL EQUATIONS, 2010, 248 (06) :1315-1344
[9]  
Bahraoui M, 1994, Set-Valued Anal., V2, P49
[10]   A convergence result for nonautonomous subgradient evolution equations and its application to the steepest descent exponential penalty trajectory in linear programming [J].
Baillon, JB ;
Cominetti, R .
JOURNAL OF FUNCTIONAL ANALYSIS, 2001, 187 (02) :263-273