Backward-forward algorithms for structured monotone inclusions in Hilbert spaces

被引:45
作者
Attouch, Hedy [1 ]
Peypouquet, Juan [2 ]
Redont, Patrick [1 ]
机构
[1] Univ Montpellier 2, Inst Montpellierain Alexander Grothendieek, IMAG UMR CNRS 5149, Pl Eugene Bataillon, F-34095 Montpellier 5, France
[2] Univ Tecn Federico Santa Maria, Dept Matemat, Ave Espana 1680, Valparaiso, Chile
关键词
Monotone inclusion; Forward backward algorithm; Proximal-gradient method; PROXIMAL POINT ALGORITHM; ITERATION-COMPLEXITY; CONVEX MINIMIZATION; SPLITTING METHOD; EXTRAGRADIENT; CONVERGENCE; OPERATORS; SUM; NONCONVEX;
D O I
10.1016/j.jmaa.2016.06.025
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
In this paper, we study the backward forward algorithm as a splitting method to solve structured monotone inclusions, and convex minimization problems in Hilbert spaces. It has a natural link with the forward backward algorithm and has the same computational complexity, since it involves the same basic blocks, but organized differently. Surprisingly enough, this kind of iteration arises when studying the time discretization of the regularized Newton method for maximally monotone operators. First, we show that these two methods enjoy remarkable involutive relations, which go far beyond the evident inversion of the order in which the forward and backward steps are applied. Next, we establish several convergence properties for both methods, some of which were unknown even for the forward backward algorithm. This brings further insight into this well-known scheme. Finally, we specialize our results to structured convex minimization problems, the gradient projection algorithms, and give a numerical illustration of theoretical interest. (C) 2016 Elsevier Inc. All rights reserved.
引用
收藏
页码:1095 / 1117
页数:23
相关论文
共 41 条
  • [1] Newton-Like Dynamics and Forward-Backward Methods for Structured Monotone Inclusions in Hilbert Spaces
    Abbas, B.
    Attouch, H.
    Svaiter, Benar F.
    [J]. JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2014, 161 (02) : 331 - 360
  • [2] Dynamical systems and forward-backward algorithms associated with the sum of a convex subdifferential and a monotone cocoercive operator
    Abbas, Boushra
    Attouch, Hedy
    [J]. OPTIMIZATION, 2015, 64 (10) : 2223 - 2252
  • [3] Asymptotic almost-equivalence of Lipschitz evolution systems in Banach spaces
    Alvarez, Felipe
    Peypouquet, Juan
    [J]. NONLINEAR ANALYSIS-THEORY METHODS & APPLICATIONS, 2010, 73 (09) : 3018 - 3033
  • [4] [Anonymous], 2015, SpringerBriefs in Optimization
  • [5] [Anonymous], 1966, USSR Comput. Math. Math. Phys., DOI DOI 10.1016/0041-5553(66)90114-5
  • [6] A CONTINUOUS DYNAMICAL NEWTON-LIKE APPROACH TO SOLVING MONOTONE INCLUSIONS
    Attouch, H.
    Svaiter, B. F.
    [J]. SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2011, 49 (02) : 574 - 598
  • [7] A strongly convergent primal-dual method for nonoverlapping domain decomposition
    Attouch, Hedy
    Briceno-Arias, Luis M.
    Combettes, Patrick L.
    [J]. NUMERISCHE MATHEMATIK, 2016, 133 (03) : 443 - 470
  • [8] A DYNAMICAL APPROACH TO AN INERTIAL FORWARD-BACKWARD ALGORITHM FOR CONVEX MINIMIZATION
    Attouch, Hedy
    Peypouquet, Juan
    Redont, Patrick
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2014, 24 (01) : 232 - 256
  • [9] Attouch H, 2012, DIFFER EQUAT APPL, V4, P27
  • [10] Convergence of descent methods for semi-algebraic and tame problems: proximal algorithms, forward-backward splitting, and regularized Gauss-Seidel methods
    Attouch, Hedy
    Bolte, Jerome
    Svaiter, Benar Fux
    [J]. MATHEMATICAL PROGRAMMING, 2013, 137 (1-2) : 91 - 129