An Inexact Linearized Augmented Lagrangian Method for the Linearly Composite Convex Programming

被引:0
作者
Zhu, Ting-Ting [1 ]
He, Xin [2 ]
Fang, Ya-Ping [1 ]
机构
[1] Sichuan Univ, Dept Math, Chengdu 610064, Peoples R China
[2] Xihua Univ, Sch Sci, Chengdu 610039, Sichuan, Peoples R China
基金
中国国家自然科学基金;
关键词
Linear equality constrained composite convex programming; inexact linearized augmented Lagrangian method; customized linearized augmented Lagrangian method; convergence rate; MINIMIZATION;
D O I
10.1142/S0217595925500174
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
We propose an inexact linearized augmented Lagrangian method for the linear equality constrained convex programming, for which the objective function has a "nonsmooth + smooth" composite structure. We show that both the objective error and the constraint gap associated with the proposed algorithm enjoy an O(1/k) nonergodic convergence rate. By choosing a specific proximal matrix, we drive a customized linearized augmented Lagrangian method for the problem, where the subproblem can be solved by means of the proximal mapping of a convex function. Finally, we demonstrate the efficiency of the proposed algorithms by two numerical experiments.
引用
收藏
页数:19
相关论文
共 17 条
[1]  
[Anonymous], 1969, Optimization
[2]   Fast convergence of inertial dynamics and algorithms with asymptotic vanishing viscosity [J].
Attouch, Hedy ;
Chbani, Zaki ;
Peypouquet, Juan ;
Redont, Patrick .
MATHEMATICAL PROGRAMMING, 2018, 168 (1-2) :123-175
[3]   On the equivalence of inexact proximal ALM and ADMM for a class of convex composite programming [J].
Chen, Liang ;
Li, Xudong ;
Sun, Defeng ;
Toh, Kim-Chuan .
MATHEMATICAL PROGRAMMING, 2021, 185 (1-2) :111-161
[4]   Customized proximal point algorithms for linearly constrained convex minimization and saddle-point problems: a unified approach [J].
Gu, Guoyong ;
He, Bingsheng ;
Yuan, Xiaoming .
COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2014, 59 (1-2) :135-161
[5]   Optimal proximal augmented Lagrangian method and its application to full Jacobian splitting for multi-block separable convex minimization problems [J].
He, Bingsheng ;
Ma, Feng ;
Yuan, Xiaoming .
IMA JOURNAL OF NUMERICAL ANALYSIS, 2020, 40 (02) :1188-1216
[6]   A customized proximal point algorithm for convex minimization with linear constraints [J].
He, Bingsheng ;
Yuan, Xiaoming ;
Zhang, Wenxing .
COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2013, 56 (03) :559-572
[7]  
Hestenes M. R., 1969, Journal of Optimization Theory and Applications, V4, P303, DOI 10.1007/BF00927673
[8]   Iteration-complexity of first-order augmented Lagrangian methods for convex programming [J].
Lan, Guanghui ;
Monteiro, Renato D. C. .
MATHEMATICAL PROGRAMMING, 2016, 155 (1-2) :511-547
[9]   Accelerated Alternating Direction Method of Multipliers: An Optimal O(1/K) Nonergodic Analysis [J].
Li, Huan ;
Lin, Zhouchen .
JOURNAL OF SCIENTIFIC COMPUTING, 2019, 79 (02) :671-699
[10]   A MAJORIZED ADMM WITH INDEFINITE PROXIMAL TERMS FOR LINEARLY CONSTRAINED CONVEX COMPOSITE OPTIMIZATION [J].
Li, Min ;
Sun, Defeng ;
Toh, Kim-Chuan .
SIAM JOURNAL ON OPTIMIZATION, 2016, 26 (02) :922-950