CONVERGENCE ANALYSIS OF AN ALF-BASED NONCONVEX SPLITTING ALGORITHM WITH SQP STRUCTURE

被引:1
作者
Liu, Pengjie [1 ]
Shao, Hu [1 ]
Lei, Yi [1 ]
Wu, Xiaoyu [1 ]
机构
[1] China Univ Min & Technol, Sch Math, Xuzhou 221116, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
Nonconvex multi-block separable optimization; splitting method; sequential quadratic programming; convergence analysis; ALTERNATING DIRECTION METHOD; GAUSSIAN BACK SUBSTITUTION; MINIMIZATION;
D O I
10.3934/jimo.2022170
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
In this paper, by combining the splitting method of augmented Lagrange function (ALF) with the sequential quadratic programming (SQP) approximation, a novel ALF-based splitting algorithm with SQP structure is proposed for multi-block linear constrained nonconvex separable optimization. The new algorithm uses ALF-based splitting idea to decompose the original problem into several small-scale subproblems. Meanwhile, the SQP approximation and Armijo-type line search are used to solve some subproblems with smoothness concurrently. Under the conventional weak hypothesis, the decreasing property of ALF as merit function is obtained. Furthermore, the global convergence, strong convergence and convergence rate results of the new algorithm in general sense are given.
引用
收藏
页码:5230 / 5248
页数:19
相关论文
共 36 条
  • [1] On the convergence of the proximal algorithm for nonsmooth functions involving analytic features
    Attouch, Hedy
    Bolte, Jerome
    [J]. MATHEMATICAL PROGRAMMING, 2009, 116 (1-2) : 5 - 16
  • [2] Convergence of descent methods for semi-algebraic and tame problems: proximal algorithms, forward-backward splitting, and regularized Gauss-Seidel methods
    Attouch, Hedy
    Bolte, Jerome
    Svaiter, Benar Fux
    [J]. MATHEMATICAL PROGRAMMING, 2013, 137 (1-2) : 91 - 129
  • [3] Proximal Alternating Minimization and Projection Methods for Nonconvex Problems: An Approach Based on the Kurdyka-Lojasiewicz Inequality
    Attouch, Hedy
    Bolte, Jerome
    Redont, Patrick
    Soubeyran, Antoine
    [J]. MATHEMATICS OF OPERATIONS RESEARCH, 2010, 35 (02) : 438 - 457
  • [4] An inexact accelerated stochastic ADMM for separable convex optimization
    Bai, Jianchao
    Hager, William W.
    Zhang, Hongchao
    [J]. COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2022, 81 (02) : 479 - 518
  • [5] Generalized symmetric ADMM for separable convex optimization
    Bai, Jianchao
    Li, Jicheng
    Xu, Fengmin
    Zhang, Hongchao
    [J]. COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2018, 70 (01) : 129 - 170
  • [6] Proximal alternating linearized minimization for nonconvex and nonsmooth problems
    Bolte, Jerome
    Sabach, Shoham
    Teboulle, Marc
    [J]. MATHEMATICAL PROGRAMMING, 2014, 146 (1-2) : 459 - 494
  • [7] Distributed optimization and statistical learning via the alternating direction method of multipliers
    Boyd S.
    Parikh N.
    Chu E.
    Peleato B.
    Eckstein J.
    [J]. Foundations and Trends in Machine Learning, 2010, 3 (01): : 1 - 122
  • [8] Chen C. H., 2019, OPER RES T, V23, P135
  • [9] The direct extension of ADMM for multi-block convex minimization problems is not necessarily convergent
    Chen, Caihua
    He, Bingsheng
    Ye, Yinyu
    Yuan, Xiaoming
    [J]. MATHEMATICAL PROGRAMMING, 2016, 155 (1-2) : 57 - 79
  • [10] Convergence of ADMM for multi-block nonconvex separable optimization models
    Guo, Ke
    Han, Deren
    Wang, David Z. W.
    Wu, Tingting
    [J]. FRONTIERS OF MATHEMATICS IN CHINA, 2017, 12 (05) : 1139 - 1162