Iteratively Linearized Reweighted Alternating Direction Method of Multipliers for a Class of Nonconvex Problems

被引:30
|
作者
Sun, Tao [1 ]
Jiang, Hao [2 ]
Cheng, Lizhi [1 ,3 ]
Zhu, Wei [4 ]
机构
[1] Natl Univ Def Technol, Dept Math, Changsha 410073, Hunan, Peoples R China
[2] Natl Univ Def Technol, Coll Comp, Changsha 410073, Hunan, Peoples R China
[3] Natl Univ Def Technol, State Key Lab High Performance Computat, Changsha 410073, Hunan, Peoples R China
[4] Xiangtan Univ, Sch Math & Computat Sci, Hunan Key Lab Computat & Simulat Sci & Engn, Xiangtan 411105, Peoples R China
基金
美国国家科学基金会;
关键词
Alternating direction method of multipliers; Iteratively reweighted algorithm; Nonconvex and nonsmooth minimization; Kurdyka-Lojasiewicz property; Semi-algebraic functions; GLOBAL CONVERGENCE; IMAGE-RESTORATION; MINIMIZATION; ALGORITHM; APPROXIMATION;
D O I
10.1109/TSP.2018.2868269
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, we consider solving a class of nonconvex and nonsmooth problems frequently appearing in signal processing andmachine learning research. The traditional alternating directionmethod of multipliers encounters troubles in both mathematics and computations in solving the nonconvex and nonsmooth subproblem. In view of this, we propose a reweighted alternating direction method of multipliers. In this algorithm, all subproblems are convex and easy to solve. We also provide several guarantees for the convergence and prove that the algorithm globally converges to a critical point of an auxiliary function with the help of the Kurdyka-Lojasiewicz property. Several numerical results are presented to demonstrate the efficiency of the proposed algorithm.
引用
收藏
页码:5380 / 5391
页数:12
相关论文
共 50 条
  • [41] AN ALTERNATING DIRECTION METHOD OF MULTIPLIERS WITH THE CONDITIONAL GRADIENT TOTAL VARIATION METHOD FOR LINEAR INVERSE PROBLEMS
    Bentbib, A. H.
    Bouhamidi, A.
    Kreit, K.
    EURASIAN JOURNAL OF MATHEMATICAL AND COMPUTER APPLICATIONS, 2023, 11 (02): : 4 - 39
  • [42] A Bregman-style Partially Symmetric Alternating Direction Method of Multipliers for Nonconvex Multi-block Optimization
    Liu, Peng-jie
    Jian, Jin-bao
    Ma, Guo-dong
    ACTA MATHEMATICAE APPLICATAE SINICA-ENGLISH SERIES, 2023, 39 (02): : 354 - 380
  • [43] Accelerated Alternating Direction Method of Multipliers
    Kadkhodaie, Mojtaba
    Christakopoulou, Konstantina
    Sanjabi, Maziar
    Banerjee, Arindam
    KDD'15: PROCEEDINGS OF THE 21ST ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2015, : 497 - 506
  • [44] A Note on the Alternating Direction Method of Multipliers
    Deren Han
    Xiaoming Yuan
    Journal of Optimization Theory and Applications, 2012, 155 : 227 - 238
  • [45] PARTIAL CONVOLUTION FOR TOTAL VARIATION DEBLURRING AND DENOISING BY NEW LINEARIZED ALTERNATING DIRECTION METHOD OF MULTIPLIERS WITH EXTENSION STEP
    Shen, Yuan
    Ji, Lei
    JOURNAL OF INDUSTRIAL AND MANAGEMENT OPTIMIZATION, 2019, 15 (01) : 159 - 175
  • [46] Linearized Proximal Alternating Direction Method of Multipliers for Parallel Magnetic Resonance Imaging
    Zhang, Benxin
    Zhu, Zhibin
    IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2017, 4 (04) : 763 - 769
  • [47] Distributed Linearized Alternating Direction Method of Multipliers for Composite Convex Consensus Optimization
    Aybat, N. S.
    Wang, Z.
    Lin, T.
    Ma, S.
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2018, 63 (01) : 5 - 20
  • [48] Linearized alternating direction method of multipliers for sparse group and fused LASSO models
    Li, Xinxin
    Mo, Lili
    Yuan, Xiaoming
    Zhang, Jianzhong
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2014, 79 : 203 - 221
  • [49] A Dual Alternating Direction Method of Multipliers for the Constrained Lasso Problems
    Wang, Qingsong
    PROCEEDINGS OF THE 2018 2ND INTERNATIONAL CONFERENCE ON ALGORITHMS, COMPUTING AND SYSTEMS (ICACS 2018), 2018, : 42 - 47
  • [50] Preconditioned alternating direction method of multipliers for inverse problems with constraints
    Jiao, Yuling
    Jin, Qinian
    Lu, Xiliang
    Wang, Weijie
    INVERSE PROBLEMS, 2017, 33 (02)