Alternating direction method of multipliers with difference of convex functions

被引:21
|
作者
Sun, Tao [1 ]
Yin, Penghang [2 ]
Cheng, Lizhi [3 ,4 ]
Jiang, Hao [5 ]
机构
[1] Natl Univ Def Technol, Coll Sci, Changsha 410073, Hunan, Peoples R China
[2] Univ Calif Los Angeles, Dept Math, Los Angeles, CA 90095 USA
[3] Natl Univ Def Technol, Coll Sci, Changsha 410073, Hunan, Peoples R China
[4] Natl Univ Def Technol, State Key Lab High Performance Computat, Changsha 410073, Hunan, Peoples R China
[5] Natl Univ Def Technol, Coll Comp, Changsha 410073, Hunan, Peoples R China
基金
美国国家科学基金会;
关键词
Nonconvex; Alternating direction method of multipliers; Difference of convex functions; Kurdyka-Lojasiewicz property; MINIMIZATION; CONVERGENCE; NONCONVEX; ALGORITHM;
D O I
10.1007/s10444-017-9559-3
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
In this paper, we consider the minimization of a class of nonconvex composite functions with difference of convex structure under linear constraints. While this kind of problems in theory can be solved by the celebrated alternating direction method of multipliers (ADMM), a direct application of ADMM often leads to difficult nonconvex subproblems. To address this issue, we propose to convexify the subproblems through a linearization technique as done in the difference of convex functions algorithm (DCA). By assuming the Kurdyka-Aojasiewicz property, we prove that the resulting algorithm sequentially converges to a critical point. It turns out that in the applications of signal and image processing such as compressed sensing and image denoising, the proposed algorithm usually enjoys closed-form solutions of the subproblems and thus can be very efficient. We provide numerical experiments to demonstrate the effectiveness of our algorithm.
引用
收藏
页码:723 / 744
页数:22
相关论文
共 50 条
  • [21] Iteratively Linearized Reweighted Alternating Direction Method of Multipliers for a Class of Nonconvex Problems
    Sun, Tao
    Jiang, Hao
    Cheng, Lizhi
    Zhu, Wei
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2018, 66 (20) : 5380 - 5391
  • [22] An Accelerated Linearized Alternating Direction Method of Multipliers
    Ouyang, Yuyuan
    Chen, Yunmei
    Lan, Guanghui
    Pasiliao, Eduardo, Jr.
    SIAM JOURNAL ON IMAGING SCIENCES, 2015, 8 (01): : 644 - 681
  • [23] A Fast Symmetric Alternating Direction Method of Multipliers
    Luo, Gang
    Yang, Qingzhi
    NUMERICAL MATHEMATICS-THEORY METHODS AND APPLICATIONS, 2020, 13 (01): : 200 - 219
  • [24] Blind Ptychographic Phase Retrieval via Convergent Alternating Direction Method of Multipliers
    Chang, Huibin
    Enfedaque, Pablo
    Marchesin, Stefano
    SIAM JOURNAL ON IMAGING SCIENCES, 2019, 12 (01): : 153 - 185
  • [25] Alternating direction method of multipliers for nonconvex fused regression problems
    Xiu, Xianchao
    Liu, Wanquan
    Li, Ling
    Kong, Lingchen
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2019, 136 : 59 - 71
  • [26] An alternating direction method of multipliers with the BFGS update for structured convex quadratic optimization
    Yan Gu
    Nobuo Yamashita
    Computational and Applied Mathematics, 2021, 40
  • [27] Fully distributed convex hull pricing based on alternating direction method of multipliers
    Yang, Linfeng
    Qin, Qinghong
    Chen, Shifei
    Jian, Jinbao
    COMPUTERS & OPERATIONS RESEARCH, 2025, 173
  • [28] A HOMOTOPY-BASED ALTERNATING DIRECTION METHOD OF MULTIPLIERS FOR STRUCTURED CONVEX OPTIMIZATION
    Yiqing Dai
    Zheng Peng
    AnnalsofAppliedMathematics, 2015, 31 (03) : 262 - 273
  • [29] Distributed Linearized Alternating Direction Method of Multipliers for Composite Convex Consensus Optimization
    Aybat, N. S.
    Wang, Z.
    Lin, T.
    Ma, S.
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2018, 63 (01) : 5 - 20
  • [30] Linear Rate Convergence of the Alternating Direction Method of Multipliers for Convex Composite Programming
    Han, Deren
    Sun, Defeng
    Zhang, Liwei
    MATHEMATICS OF OPERATIONS RESEARCH, 2018, 43 (02) : 622 - 637