A multi-parameter parallel ADMM for multi-block linearly constrained separable convex optimization

被引:10
作者
Shen, Yuan [1 ]
Gao, Qianming [1 ]
Yin, Xue [1 ]
机构
[1] Nanjing Univ Finance & Econ, Sch Appl Math, Nanjing 210023, Peoples R China
关键词
Multi-block; Convex optimization; Parallel computing; Proximal point algorithm; Alternating direction method of multipliers; JACOBIAN DECOMPOSITION; MINIMIZATION;
D O I
10.1016/j.apnum.2021.09.011
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
The alternating direction method of multipliers (ADMM) has been proved to be effective for solving two-block convex minimization model subject to linear constraints. However, the convergence of multiple-block convex minimization model with linear constraints may not be guaranteed without additional assumptions. Recently, some parallel multi-block ADMM algorithms which solve the subproblems in a parallel way have been proposed. This paper is a further study on this method with the purpose of improving the parallel multi-block ADMM algorithm by introducing more parameters. We propose two multi-parameter parallel ADMM algorithms with proximal point terms attached to all subproblems. Comparing with some popular parallel ADMM-based algorithms, the parameter conditions of the new algorithms are relaxed. Experiments on both real and synthetic problems are conducted to justify the effectiveness of the proposed algorithms compared to several efficient ADMM-based algorithms for multi-block problems. (C) 2021 IMACS. Published by Elsevier B.V. All rights reserved.
引用
收藏
页码:369 / 388
页数:20
相关论文
共 50 条
[41]   Optimal proximal augmented Lagrangian method and its application to full Jacobian splitting for multi-block separable convex minimization problems [J].
He, Bingsheng ;
Ma, Feng ;
Yuan, Xiaoming .
IMA JOURNAL OF NUMERICAL ANALYSIS, 2020, 40 (02) :1188-1216
[42]   Over-relaxed multi-block ADMM algorithms for doubly regularized support vector machines [J].
Dai, Yunwei ;
Zhang, Yuao ;
Wu, Qingbiao .
NEUROCOMPUTING, 2023, 530 :188-204
[43]   Multi-block Nonconvex Nonsmooth Proximal ADMM: Convergence and Rates Under Kurdyka-Lojasiewicz Property [J].
Yashtini, Maryam .
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2021, 190 (03) :966-998
[44]   A Proximal Dual Consensus ADMM Method for Multi-Agent Constrained Optimization [J].
Chang, Tsung-Hui .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2016, 64 (14) :3719-3734
[45]   A Block Successive Upper-Bound Minimization Method of Multipliers for Linearly Constrained Convex Optimization [J].
Hong, Mingyi ;
Chang, Tsung-Hui ;
Wang, Xiangfeng ;
Razaviyayn, Meisam ;
Ma, Shiqian ;
Luo, Zhi-Quan .
MATHEMATICS OF OPERATIONS RESEARCH, 2020, 45 (03) :833-861
[46]   A distributed Douglas-Rachford splitting method for multi-block convex minimization problems [J].
Hongjin He ;
Deren Han .
Advances in Computational Mathematics, 2016, 42 :27-53
[47]   Multi-block relaxed-dual linear inertial ADMM algorithm for nonconvex and nonsmooth problems with nonseparable structures [J].
Dang, Yazheng ;
Chen, Liyuan ;
Gao, Yan .
NUMERICAL ALGORITHMS, 2025, 98 (01) :251-285
[48]   CUDA-based Hierarchical Multi-Block Particle Swarm Optimization Algorithm [J].
Lan, Tian ;
Guo, Maoyun ;
Qu, Jianfeng ;
Chai, Yi ;
Liu, Zhenglei ;
Zhang, Xunjie .
2015 27TH CHINESE CONTROL AND DECISION CONFERENCE (CCDC), 2015, :4419-4423
[49]   Optimization strategies for multi-block structured CFD simulation based on Sunway TaihuLight [J].
Lv, Xiaojing ;
Leng, Wenhao ;
Liu, Zhao ;
Wu, Chengsheng ;
Li, Fang ;
Xu, Jiuxiu .
ENGINEERING REPORTS, 2025, 7 (01)
[50]   A massively parallel multi-block hybrid compact-WENO scheme for compressible flows [J].
Chao, J. ;
Haselbacher, A. ;
Balachandar, S. .
JOURNAL OF COMPUTATIONAL PHYSICS, 2009, 228 (19) :7473-7491