Proximal ADMM for nonconvex and nonsmooth optimization

被引:11
|
作者
Yang, Yu [1 ]
Jia, Qing-Shan [2 ]
Xu, Zhanbo [1 ]
Guan, Xiaohong [1 ,2 ]
Spanos, Costas J. [3 ]
机构
[1] Xi An Jiao Tong Univ, Sch Automat Sci & Engn, Xian, Shaanxi, Peoples R China
[2] Tsinghua Univ, Dept Automat, CFINS, BNRist, Beijing, Peoples R China
[3] Univ Calif Berkeley, Elect Engn & Comp Sci, Berkeley, CA USA
基金
中国国家自然科学基金; 新加坡国家研究基金会;
关键词
Distributed nonconvex and nonsmooth  optimization; Proximal ADMM; Bounded Lagrangian multipliers; Global convergence; Smart buildings; MULTIAGENT DISTRIBUTED OPTIMIZATION; ALTERNATING DIRECTION METHOD; LINEAR CONVERGENCE; ALLOCATION; ALGORITHM;
D O I
10.1016/j.automatica.2022.110551
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
By enabling the nodes or agents to solve small-sized subproblems to achieve coordination, distributed algorithms are favored by many networked systems for efficient and scalable computation. While for convex problems, substantial distributed algorithms are available, the results for the more broad nonconvex counterparts are extremely lacking. This paper develops a distributed algorithm for a class of nonconvex and nonsmooth problems featured by (i) a nonconvex objective formed by both separate and composite components regarding the decision variables of interconnected agents, (ii) local bounded convex constraints, and (iii) coupled linear constraints. This problem is directly originated from smart buildings and is also broad in other domains. To provide a distributed algorithm with convergence guarantee, we revise the powerful alternating direction method of multiplier (ADMM) method and proposed a proximal ADMM. Specifically, noting that the main difficulty to establish the convergence for the nonconvex and nonsmooth optimization with ADMM is to assume the boundness of dual updates, we propose to update the dual variables in a discounted manner. This leads to the establishment of a so-called sufficiently decreasing and lower bounded Lyapunov function, which is critical to establish the convergence. We prove that the method converges to some approximate stationary points. We besides showcase the efficacy and performance of the method by a numerical example and the concrete application to multi-zone heating, ventilation, and air-conditioning (HVAC) control in smart buildings.(c) 2022 Elsevier Ltd. All rights reserved.
引用
收藏
页数:13
相关论文
共 50 条
  • [31] Proximal Linearized Iteratively Reweighted Algorithms for Nonconvex and Nonsmooth Optimization Problem
    Yeo, Juyeb
    Kang, Myeongmin
    AXIOMS, 2022, 11 (05)
  • [32] Perturbed proximal primal-dual algorithm for nonconvex nonsmooth optimization
    Hajinezhad, Davood
    Hong, Mingyi
    MATHEMATICAL PROGRAMMING, 2019, 176 (1-2) : 207 - 245
  • [33] A new infeasible proximal bundle algorithm for nonsmooth nonconvex constrained optimization
    Najmeh Hoseini Monjezi
    S. Nobakhtian
    Computational Optimization and Applications, 2019, 74 : 443 - 480
  • [34] An Accelerated Block Proximal Framework with Adaptive Momentum for Nonconvex and Nonsmooth Optimization
    Yang, Weifeng
    Min, Wenwen
    arXiv, 2023,
  • [35] Proximal stochastic recursive momentum algorithm for nonsmooth nonconvex optimization problems
    Wang, Zhaoxin
    Wen, Bo
    OPTIMIZATION, 2024, 73 (02) : 481 - 495
  • [36] A proximal bundle method for a class of nonconvex nonsmooth composite optimization problems
    Pang, Liping
    Wang, Xiaoliang
    Meng, Fanyun
    JOURNAL OF GLOBAL OPTIMIZATION, 2023, 86 (03) : 589 - 620
  • [37] Proximal Stochastic Methods for Nonsmooth Nonconvex Finite-Sum Optimization
    Reddi, Sashank J.
    Sra, Suvrit
    Poczos, Barnabas
    Smola, Alexander J.
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 29 (NIPS 2016), 2016, 29
  • [38] A proximal bundle method for a class of nonconvex nonsmooth composite optimization problems
    Liping Pang
    Xiaoliang Wang
    Fanyun Meng
    Journal of Global Optimization, 2023, 86 : 589 - 620
  • [39] A new infeasible proximal bundle algorithm for nonsmooth nonconvex constrained optimization
    Monjezi, Najmeh Hoseini
    Nobakhtian, S.
    COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2019, 74 (02) : 443 - 480
  • [40] An extended proximal ADMM algorithm for three-block nonconvex optimization problems
    Zhang, Chun
    Song, Yongzhong
    Cai, Xingju
    Han, Deren
    JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2021, 398 (398)