An accelerated proximal alternating direction method of multipliers for robust fused Lasso

被引:1
|
作者
Fan, Yibao [1 ]
Shang, Youlin [1 ]
Jin, Zheng-Fen [1 ,2 ]
Liu, Jia [1 ]
Zhang, Roxin [3 ]
机构
[1] Henan Univ Sci & Technol, Sch Math & Stat, Luolong, Peoples R China
[2] Beihang Univ, Sch Math Sci, LMIB Minist Educ, Beijing, Peoples R China
[3] Northern Michigan Univ, Dept Math & Comp Sci, Marquette, MI USA
基金
中国国家自然科学基金;
关键词
Robust fused Lasso; accelerated proximal alternating direction method of multipliers; nonergodic convergence; extension factor; REGRESSION SHRINKAGE; ALGORITHM; ESTIMATOR; SELECTION;
D O I
10.1051/ro/2023065
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
In the era of big data, much of the data is susceptible to noise with heavy-tailed distribution. Fused Lasso can effectively handle high dimensional sparse data with strong correlation between two adjacent variables under known Gaussian noise. However, it has poor robustness to non-Gaussian noise with heavy-tailed distribution. Robust fused Lasso with l(1) norm loss function can overcome the drawback of fused Lasso when noise is heavy-tailed distribution. But the key challenge for solving this model is nonsmoothness and its nonseparability. Therefore, in this paper, we first deform the robust fused Lasso into an easily solvable form, which changes the three-block objective function to a two-block form. Then, we propose an accelerated proximal alternating direction method of multipliers (APADMM) with an additional update step, which is base on a new PADMM that changes the Lagrangian multiplier term update. Furthermore, we give the O(1/K) nonergodic convergence rate analysis of the proposed APADMM. Finally, numerical results show that the proposed new PADMM and APADMM have better performance than other existing ADMM solvers.
引用
收藏
页码:1219 / 1238
页数:20
相关论文
共 50 条
  • [1] Linearized alternating direction method of multipliers for sparse group and fused LASSO models
    Li, Xinxin
    Mo, Lili
    Yuan, Xiaoming
    Zhang, Jianzhong
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2014, 79 : 203 - 221
  • [2] Accelerated Alternating Direction Method of Multipliers
    Kadkhodaie, Mojtaba
    Christakopoulou, Konstantina
    Sanjabi, Maziar
    Banerjee, Arindam
    KDD'15: PROCEEDINGS OF THE 21ST ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2015, : 497 - 506
  • [3] AN EXTENDED LINEARIZED ALTERNATING DIRECTION METHOD OF MULTIPLIERS FOR FUSED-LASSO PENALIZED LINEAR REGRESSION
    Liu, Jia
    Shang, Youlin
    Jin, Zhengfen
    Zhang, R. O. X. I. N.
    JOURNAL OF INDUSTRIAL AND MANAGEMENT OPTIMIZATION, 2023, 19 (11) : 8074 - 8088
  • [4] An Accelerated Linearized Alternating Direction Method of Multipliers
    Ouyang, Yuyuan
    Chen, Yunmei
    Lan, Guanghui
    Pasiliao, Eduardo, Jr.
    SIAM JOURNAL ON IMAGING SCIENCES, 2015, 8 (01): : 644 - 681
  • [5] An Accelerated Proximal Alternating Direction Method of Multipliers for Optimal Decentralized Control of Uncertain Systems
    Yang, Bo
    Zhao, Xinyuan
    Li, Xudong
    Sun, Defeng
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2025, 204 (01)
  • [6] A Dual Alternating Direction Method of Multipliers for the Constrained Lasso Problems
    Wang, Qingsong
    PROCEEDINGS OF THE 2018 2ND INTERNATIONAL CONFERENCE ON ALGORITHMS, COMPUTING AND SYSTEMS (ICACS 2018), 2018, : 42 - 47
  • [7] The linearized alternating direction method of multipliers for low-rank and fused LASSO matrix regression model
    Li, M.
    Guo, Q.
    Zhai, W. J.
    Chen, B. Z.
    JOURNAL OF APPLIED STATISTICS, 2020, 47 (13-15) : 2623 - 2640
  • [8] An inexact proximal generalized alternating direction method of multipliers
    Adona, V. A.
    Goncalves, M. L. N.
    Melo, J. G.
    COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2020, 76 (03) : 621 - 647
  • [9] A Proximal Alternating Direction Method of Multipliers with a Substitution Procedure
    Chao, Miantao
    Zhao, Yongxin
    Liang, Dongying
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2020, 2020
  • [10] An inexact proximal generalized alternating direction method of multipliers
    V. A. Adona
    M. L. N. Gonçalves
    J. G. Melo
    Computational Optimization and Applications, 2020, 76 : 621 - 647