COMPLEXITY OF A QUADRATIC PENALTY ACCELERATED INEXACT PROXIMAL POINT METHOD FOR SOLVING LINEARLY CONSTRAINED NONCONVEX COMPOSITE PROGRAMS

被引:32
作者
Kong, Weiwei [1 ]
Melo, Jefferson G. [2 ]
Monteiro, Renato D. C. [1 ]
机构
[1] Georgia Inst Technol, Sch Ind & Syst Engn, Atlanta, GA 30332 USA
[2] Univ Fed Goias, Inst Math & Stat, Campus 2 Caixa Postal 131, BR-74001970 Goiania, Go, Brazil
关键词
quadratic penalty method; composite nonconvex program; iteration complexity; inexact proximal point method; first-order accelerated gradient method; EXTRAGRADIENT METHOD; SADDLE-POINT; CONVERGENCE; ALGORITHM;
D O I
10.1137/18M1171011
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
This paper analyzes the iteration complexity of a quadratic penalty accelerated inexact proximal point method for solving linearly constrained nonconvex composite programs. More specifically, the objective function is of the form f + h, where f is a differentiable function whose gradient is Lipschitz continuous and h is a closed convex function with possibly unbounded domain. The method, basically, consists of applying an accelerated inexact proximal point method for approximately solving a sequence of quadratic penalized subproblems associated with the linearly constrained problem. Each subproblem of the proximal point method is in turn approximately solved by an accelerated composite gradient (ACG) method. It is shown that the proposed scheme generates a rho-approximate stationary point in at most O(rho(-3)) ACG iterations. Finally, numerical results showing the efficiency of the proposed method are also given.
引用
收藏
页码:2566 / 2593
页数:28
相关论文
共 31 条
  • [1] [Anonymous], 2008, PREPRINT
  • [2] [Anonymous], PREPRINT
  • [3] [Anonymous], 1993, CONVEX ANAL MINIMIZA
  • [4] On the convergence of the proximal algorithm for nonsmooth functions involving analytic features
    Attouch, Hedy
    Bolte, Jerome
    [J]. MATHEMATICAL PROGRAMMING, 2009, 116 (1-2) : 5 - 16
  • [5] THE RATE OF CONVERGENCE OF NESTEROV'S ACCELERATED FORWARD-BACKWARD METHOD IS ACTUALLY FASTER THAN 1/k2
    Attouch, Hedy
    Peypouquet, Juan
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2016, 26 (03) : 1824 - 1834
  • [6] Convergence of descent methods for semi-algebraic and tame problems: proximal algorithms, forward-backward splitting, and regularized Gauss-Seidel methods
    Attouch, Hedy
    Bolte, Jerome
    Svaiter, Benar Fux
    [J]. MATHEMATICAL PROGRAMMING, 2013, 137 (1-2) : 91 - 129
  • [7] A FIRST-ORDER SMOOTHED PENALTY METHOD FOR COMPRESSED SENSING
    Aybat, N. S.
    Iyengar, G.
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2011, 21 (01) : 287 - 313
  • [8] CARMON Y., 2017, PREPRINT
  • [9] A block coordinate variable metric forward-backward algorithm
    Chouzenoux, Emilie
    Pesquet, Jean-Christophe
    Repetti, Audrey
    [J]. JOURNAL OF GLOBAL OPTIMIZATION, 2016, 66 (03) : 457 - 485
  • [10] Drusvyatskiy D., 2016, PREPRINT