Iteratively Linearized Reweighted Alternating Direction Method of Multipliers for a Class of Nonconvex Problems

被引:30
|
作者
Sun, Tao [1 ]
Jiang, Hao [2 ]
Cheng, Lizhi [1 ,3 ]
Zhu, Wei [4 ]
机构
[1] Natl Univ Def Technol, Dept Math, Changsha 410073, Hunan, Peoples R China
[2] Natl Univ Def Technol, Coll Comp, Changsha 410073, Hunan, Peoples R China
[3] Natl Univ Def Technol, State Key Lab High Performance Computat, Changsha 410073, Hunan, Peoples R China
[4] Xiangtan Univ, Sch Math & Computat Sci, Hunan Key Lab Computat & Simulat Sci & Engn, Xiangtan 411105, Peoples R China
基金
美国国家科学基金会;
关键词
Alternating direction method of multipliers; Iteratively reweighted algorithm; Nonconvex and nonsmooth minimization; Kurdyka-Lojasiewicz property; Semi-algebraic functions; GLOBAL CONVERGENCE; IMAGE-RESTORATION; MINIMIZATION; ALGORITHM; APPROXIMATION;
D O I
10.1109/TSP.2018.2868269
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, we consider solving a class of nonconvex and nonsmooth problems frequently appearing in signal processing andmachine learning research. The traditional alternating directionmethod of multipliers encounters troubles in both mathematics and computations in solving the nonconvex and nonsmooth subproblem. In view of this, we propose a reweighted alternating direction method of multipliers. In this algorithm, all subproblems are convex and easy to solve. We also provide several guarantees for the convergence and prove that the algorithm globally converges to a critical point of an auxiliary function with the help of the Kurdyka-Lojasiewicz property. Several numerical results are presented to demonstrate the efficiency of the proposed algorithm.
引用
收藏
页码:5380 / 5391
页数:12
相关论文
共 50 条
  • [31] An alternating linearization bundle method for a class of nonconvex nonsmooth optimization problems
    Tang, Chunming
    Lv, Jinman
    Jian, Jinbao
    JOURNAL OF INEQUALITIES AND APPLICATIONS, 2018,
  • [32] An inertial Bregman generalized alternating direction method of multipliers for nonconvex optimization
    Jiawei Xu
    Miantao Chao
    Journal of Applied Mathematics and Computing, 2022, 68 : 1 - 27
  • [33] An inertial stochastic Bregman generalized alternating direction method of multipliers for nonconvex and nonsmooth optimization
    Liu, Longhui
    Han, Congying
    Guo, Tiande
    Liao, Shichen
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 276
  • [34] On the Convergence of an Alternating Direction Penalty Method for Nonconvex Problems
    Magnusson, S.
    Weeraddana, P. C.
    Rabbat, M. G.
    Fischione, C.
    CONFERENCE RECORD OF THE 2014 FORTY-EIGHTH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS & COMPUTERS, 2014, : 793 - 797
  • [35] A Dynamic Alternating Direction of Multipliers for Nonconvex Minimization with Nonlinear Functional Equality Constraints
    Cohen, Eyal
    Hallak, Nadav
    Teboulle, Marc
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2022, 193 (1-3) : 324 - 353
  • [36] Linearized Alternating Direction Method of Multipliers for Constrained Linear Least-Squares Problem
    Chan, Raymond H.
    Tao, Min
    Yuan, Xiaoming
    EAST ASIAN JOURNAL ON APPLIED MATHEMATICS, 2012, 2 (04) : 326 - 341
  • [37] A Dynamic Alternating Direction of Multipliers for Nonconvex Minimization with Nonlinear Functional Equality Constraints
    Eyal Cohen
    Nadav Hallak
    Marc Teboulle
    Journal of Optimization Theory and Applications, 2022, 193 : 324 - 353
  • [38] Adaptive Linearized Alternating Direction Method of Multipliers for Non-Convex Compositely Regularized Optimization Problems
    Qiao, Linbo
    Zhang, Bofeng
    Lu, Xicheng
    Su, Jinshu
    TSINGHUA SCIENCE AND TECHNOLOGY, 2017, 22 (03) : 328 - 341
  • [39] Inertial Proximal Alternating Linearized Minimization (iPALM) for Nonconvex and Nonsmooth Problems
    Pock, Thomas
    Sabach, Shoham
    SIAM JOURNAL ON IMAGING SCIENCES, 2016, 9 (04): : 1756 - 1787
  • [40] ALTERNATING DIRECTION METHOD OF MULTIPLIERS FOR LINEAR INVERSE PROBLEMS
    Jiao, Yuling
    Jin, Qinian
    Lu, Xiliang
    Wang, Weijie
    SIAM JOURNAL ON NUMERICAL ANALYSIS, 2016, 54 (04) : 2114 - 2137