An inexact symmetric ADMM algorithm with indefinite proximal term for sparse signal recovery and image restoration problems

被引:9
作者
Jiang, Fan [1 ]
Wu, Zhongming [2 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Dept Informat & Comp Sci, Sch Math & Stat, Nanjing 210044, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Sch Management Sci & Engn, Nanjing 210044, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Alternating direction method of multipliers; Symmetric; Inexactness; Relative error criteria; Indefinite proximal term; ALTERNATING DIRECTION METHOD; RACHFORD SPLITTING METHOD; POINT ALGORITHM; LINEAR CONVERGENCE; LOW-RANK; MULTIPLIERS;
D O I
10.1016/j.cam.2022.114628
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Compared with the alternating direction method of multipliers (ADMM), the symmetric ADMM, which updates the Lagrange multiplier twice in each iteration, is a more efficient approach for solving linearly constrained convex optimization problems. However, the difficulty of solving subproblems has a central role in practical applications. In this paper, we develop an inexact symmetric ADMM with an indefinite proximal term for linearly constrained convex optimization problems. To the best of our knowledge, this is the first variant of the ADMM that unifies the relative error criteria and indefinite proximal term. Specifically, both subproblems in the proposed algorithm can be approximately solved by certain relative error criteria. Moreover, the proximal term in the second subproblem is allowed to be indefinite while still theoretically guaranteeing the convergence. We establish its global convergence and worst-case O(1/N) convergence rate in the ergodic sense. We apply the new method to solve l(1) regularized analysis sparse recovery and constrained TV-l(2) image restoration problems, and some numerical results are reported to verify the efficiency of the proposed algorithm. (c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页数:17
相关论文
共 49 条
[1]  
Adona VA, 2020, Arxiv, DOI arXiv:2006.02815
[2]   Convergence on a Symmetric Accelerated Stochastic ADMMwith Larger Stepsizes [J].
Bai, Jianchao ;
Han, Deren ;
Sun, Hao ;
Zhang, Hongchao .
CSIAM TRANSACTIONS ON APPLIED MATHEMATICS, 2022, 3 (03) :448-479
[3]   Generalized symmetric ADMM for separable convex optimization [J].
Bai, Jianchao ;
Li, Jicheng ;
Xu, Fengmin ;
Zhang, Hongchao .
COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2018, 70 (01) :129-170
[4]   A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems [J].
Beck, Amir ;
Teboulle, Marc .
SIAM JOURNAL ON IMAGING SCIENCES, 2009, 2 (01) :183-202
[5]   Distributed optimization and statistical learning via the alternating direction method of multipliers [J].
Boyd S. ;
Parikh N. ;
Chu E. ;
Peleato B. ;
Eckstein J. .
Foundations and Trends in Machine Learning, 2010, 3 (01) :1-122
[6]   The Developments of Proximal Point Algorithms [J].
Cai, Xing-Ju ;
Guo, Ke ;
Jiang, Fan ;
Wang, Kai ;
Wu, Zhong-Ming ;
Han, De-Ren .
JOURNAL OF THE OPERATIONS RESEARCH SOCIETY OF CHINA, 2022, 10 (02) :197-239
[7]   O(1/t) complexity analysis of the generalized alternating direction method of multipliers [J].
Cai, Xingju ;
Han, Deren .
SCIENCE CHINA-MATHEMATICS, 2019, 62 (04) :795-808
[8]   Exact Matrix Completion via Convex Optimization [J].
Candes, Emmanuel J. ;
Recht, Benjamin .
FOUNDATIONS OF COMPUTATIONAL MATHEMATICS, 2009, 9 (06) :717-772
[9]   Convergence analysis of positive-indefinite proximal ADMM with a Glowinski's relaxation factor [J].
Chen, Jiawei ;
Wang, Yiyun ;
He, Hongjin ;
Lv, Yibing .
NUMERICAL ALGORITHMS, 2020, 83 (04) :1415-1440
[10]   An efficient inexact symmetric Gauss-Seidel based majorized ADMM for high-dimensional convex composite conic programming [J].
Chen, Liang ;
Sun, Defeng ;
Toh, Kim-Chuan .
MATHEMATICAL PROGRAMMING, 2017, 161 (1-2) :237-270