Proximal ADMM for nonconvex and nonsmooth optimization

被引:11
|
作者
Yang, Yu [1 ]
Jia, Qing-Shan [2 ]
Xu, Zhanbo [1 ]
Guan, Xiaohong [1 ,2 ]
Spanos, Costas J. [3 ]
机构
[1] Xi An Jiao Tong Univ, Sch Automat Sci & Engn, Xian, Shaanxi, Peoples R China
[2] Tsinghua Univ, Dept Automat, CFINS, BNRist, Beijing, Peoples R China
[3] Univ Calif Berkeley, Elect Engn & Comp Sci, Berkeley, CA USA
基金
中国国家自然科学基金; 新加坡国家研究基金会;
关键词
Distributed nonconvex and nonsmooth  optimization; Proximal ADMM; Bounded Lagrangian multipliers; Global convergence; Smart buildings; MULTIAGENT DISTRIBUTED OPTIMIZATION; ALTERNATING DIRECTION METHOD; LINEAR CONVERGENCE; ALLOCATION; ALGORITHM;
D O I
10.1016/j.automatica.2022.110551
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
By enabling the nodes or agents to solve small-sized subproblems to achieve coordination, distributed algorithms are favored by many networked systems for efficient and scalable computation. While for convex problems, substantial distributed algorithms are available, the results for the more broad nonconvex counterparts are extremely lacking. This paper develops a distributed algorithm for a class of nonconvex and nonsmooth problems featured by (i) a nonconvex objective formed by both separate and composite components regarding the decision variables of interconnected agents, (ii) local bounded convex constraints, and (iii) coupled linear constraints. This problem is directly originated from smart buildings and is also broad in other domains. To provide a distributed algorithm with convergence guarantee, we revise the powerful alternating direction method of multiplier (ADMM) method and proposed a proximal ADMM. Specifically, noting that the main difficulty to establish the convergence for the nonconvex and nonsmooth optimization with ADMM is to assume the boundness of dual updates, we propose to update the dual variables in a discounted manner. This leads to the establishment of a so-called sufficiently decreasing and lower bounded Lyapunov function, which is critical to establish the convergence. We prove that the method converges to some approximate stationary points. We besides showcase the efficacy and performance of the method by a numerical example and the concrete application to multi-zone heating, ventilation, and air-conditioning (HVAC) control in smart buildings.(c) 2022 Elsevier Ltd. All rights reserved.
引用
收藏
页数:13
相关论文
共 50 条
  • [41] Two-step inertial ADMM for the solution of nonconvex nonsmooth optimization problems with nonseparable structure
    Dang, Yazheng
    Kun, Xu
    Lu, Jinglei
    PHYSICA SCRIPTA, 2025, 100 (02)
  • [42] Two-step inertial ADMM for the solution of nonconvex nonsmooth optimization problems with nonseparable structure
    Dang, Yazheng
    Kun, Xu
    Lu, Jinglei
    Physica Scripta, 100 (02):
  • [43] An ADMM Approach of a Nonconvex and Nonsmooth Optimization Model for Low-Light or Inhomogeneous Image Segmentation
    Xing, Zheyuan
    Wu, Tingting
    Yue, Junhong
    ASIA-PACIFIC JOURNAL OF OPERATIONAL RESEARCH, 2024, 41 (03)
  • [44] Multi-block Nonconvex Nonsmooth Proximal ADMM: Convergence and Rates Under Kurdyka-Lojasiewicz Property
    Yashtini, Maryam
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2021, 190 (03) : 966 - 998
  • [45] Deterministic Nonsmooth Nonconvex Optimization
    Jordan, Michael I.
    Kornowski, Guy
    Lin, Tianyi
    Shamir, Ohad
    Zampetakis, Manolis
    THIRTY SIXTH ANNUAL CONFERENCE ON LEARNING THEORY, VOL 195, 2023, 195
  • [46] General inertial proximal stochastic variance reduction gradient for nonconvex nonsmooth optimization
    Sun, Shuya
    He, Lulu
    JOURNAL OF INEQUALITIES AND APPLICATIONS, 2023, 2023 (01)
  • [47] A proximal bundle method for nonsmooth DC optimization utilizing nonconvex cutting planes
    Joki, Kaisa
    Bagirov, Adil M.
    Karmitsa, Napsu
    Makela, Marko M.
    JOURNAL OF GLOBAL OPTIMIZATION, 2017, 68 (03) : 501 - 535
  • [48] An inexact proximal gradient algorithm with extrapolation for a class of nonconvex nonsmooth optimization problems
    Jia, Zehui
    Wu, Zhongming
    Dong, Xiaomei
    JOURNAL OF INEQUALITIES AND APPLICATIONS, 2019, 2019 (1)
  • [49] An inexact multiple proximal bundle algorithm for nonsmooth nonconvex multiobjective optimization problems
    Hoseini Monjezi, N.
    Nobakhtian, S.
    ANNALS OF OPERATIONS RESEARCH, 2022, 311 (02) : 1123 - 1154
  • [50] Two inertial proximal coordinate algorithms for a family of nonsmooth and nonconvex optimization problems
    Dang, Ya Zheng
    Sun, Jie
    Teo, Kok Lay
    AUTOMATICA, 2025, 171