Alternating direction method of multipliers with difference of convex functions

被引:21
|
作者
Sun, Tao [1 ]
Yin, Penghang [2 ]
Cheng, Lizhi [3 ,4 ]
Jiang, Hao [5 ]
机构
[1] Natl Univ Def Technol, Coll Sci, Changsha 410073, Hunan, Peoples R China
[2] Univ Calif Los Angeles, Dept Math, Los Angeles, CA 90095 USA
[3] Natl Univ Def Technol, Coll Sci, Changsha 410073, Hunan, Peoples R China
[4] Natl Univ Def Technol, State Key Lab High Performance Computat, Changsha 410073, Hunan, Peoples R China
[5] Natl Univ Def Technol, Coll Comp, Changsha 410073, Hunan, Peoples R China
基金
美国国家科学基金会;
关键词
Nonconvex; Alternating direction method of multipliers; Difference of convex functions; Kurdyka-Lojasiewicz property; MINIMIZATION; CONVERGENCE; NONCONVEX; ALGORITHM;
D O I
10.1007/s10444-017-9559-3
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
In this paper, we consider the minimization of a class of nonconvex composite functions with difference of convex structure under linear constraints. While this kind of problems in theory can be solved by the celebrated alternating direction method of multipliers (ADMM), a direct application of ADMM often leads to difficult nonconvex subproblems. To address this issue, we propose to convexify the subproblems through a linearization technique as done in the difference of convex functions algorithm (DCA). By assuming the Kurdyka-Aojasiewicz property, we prove that the resulting algorithm sequentially converges to a critical point. It turns out that in the applications of signal and image processing such as compressed sensing and image denoising, the proposed algorithm usually enjoys closed-form solutions of the subproblems and thus can be very efficient. We provide numerical experiments to demonstrate the effectiveness of our algorithm.
引用
收藏
页码:723 / 744
页数:22
相关论文
共 50 条
  • [1] Alternating direction method of multipliers with difference of convex functions
    Tao Sun
    Penghang Yin
    Lizhi Cheng
    Hao Jiang
    Advances in Computational Mathematics, 2018, 44 : 723 - 744
  • [2] A convex combined symmetric alternating direction method of multipliers for separable optimization
    Wang, Xiaoquan
    Shao, Hu
    Wu, Ting
    COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2025, 90 (03) : 839 - 880
  • [3] A hybrid Bregman alternating direction method of multipliers for the linearly constrained difference-of-convex problems
    Tu, Kai
    Zhang, Haibin
    Gao, Huan
    Feng, Junkai
    JOURNAL OF GLOBAL OPTIMIZATION, 2020, 76 (04) : 665 - 693
  • [4] Optimally linearizing the alternating direction method of multipliers for convex programming
    He, Bingsheng
    Ma, Feng
    Yuan, Xiaoming
    COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2020, 75 (02) : 361 - 388
  • [5] An alternating direction method of multipliers with the BFGS update for structured convex quadratic optimization
    Gu, Yan
    Yamashita, Nobuo
    COMPUTATIONAL & APPLIED MATHEMATICS, 2021, 40 (03)
  • [6] Alternating Direction Method of Multipliers for Separable Convex Optimization of Real Functions in Complex Variables
    Li, Lu
    Wang, Xingyu
    Wang, Guoqiang
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2015, 2015
  • [7] A Proximal Alternating Direction Method of Multipliers for DC Programming with Structured Constraints
    Zhou, Yingxin
    He, Hongjin
    Zhang, Linan
    JOURNAL OF SCIENTIFIC COMPUTING, 2024, 99 (03)
  • [8] LINEARIZED BLOCK-WISE ALTERNATING DIRECTION METHOD OF MULTIPLIERS FOR MULTIPLE-BLOCK CONVEX PROGRAMMING
    Wu, Zhongming
    Cai, Xingju
    Han, Deren
    JOURNAL OF INDUSTRIAL AND MANAGEMENT OPTIMIZATION, 2018, 14 (03) : 833 - 855
  • [9] An Improvement of the Alternating Direction Method of Multipliers to Solve the Convex Optimization Problem
    Peng, Jingjing
    Wang, Zhijie
    Yu, Siting
    Tang, Zengao
    MATHEMATICS, 2025, 13 (05)
  • [10] A hybrid Bregman alternating direction method of multipliers for the linearly constrained difference-of-convex problems
    Kai Tu
    Haibin Zhang
    Huan Gao
    Junkai Feng
    Journal of Global Optimization, 2020, 76 : 665 - 693