Penalty Function-Based Distributed Primal-Dual Algorithm for Nonconvex Optimization Problem

被引:0
|
作者
Xiasheng Shi [1 ,2 ,3 ,4 ,5 ]
Changyin Sun [1 ,2 ,3 ,4 ]
机构
[1] IEEE
[2] the Engineering Research Center of Autonomous Unmanned System Technology, Ministry of Education, Anhui University
[3] the School of Artificial Intelligence, Anhui University
[4] Anhui Provincial Engineering Research Center for Unmanned System and Intelligent Technology, Anhui University
[5] the Anhui Key Laboratory Industrial Energy-Saving and Safety, Anhui
关键词
D O I
暂无
中图分类号
O224 [最优化的数学理论];
学科分类号
摘要
This paper addresses the distributed nonconvex optimization problem, where both the global cost function and local inequality constraint function are nonconvex. To tackle this issue, the p-power transformation and penalty function techniques are introduced to reframe the nonconvex optimization problem. This ensures that the Hessian matrix of the augmented Lagrangian function becomes local positive definite by choosing appropriate control parameters. A multi-timescale primal-dual method is then devised based on the Karush-Kuhn-Tucker(KKT) point of the reformulated nonconvex problem to attain convergence. The Lyapunov theory guarantees the model's stability in the presence of an undirected and connected communication network. Finally, two nonconvex optimization problems are presented to demonstrate the efficacy of the previously developed method.
引用
收藏
页码:394 / 402
页数:9
相关论文
共 50 条
  • [1] Penalty Function-Based Distributed Primal-Dual Algorithm for Nonconvex Optimization Problem
    Shi, Xiasheng
    Sun, Changyin
    IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2025, 12 (02) : 394 - 402
  • [2] A Primal-Dual SGD Algorithm for Distributed Nonconvex Optimization
    Yi, Xinlei
    Zhang, Shengjun
    Yang, Tao
    Chai, Tianyou
    Johansson, Karl Henrik
    IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2022, 9 (05) : 812 - 833
  • [3] A Primal-Dual SGD Algorithm for Distributed Nonconvex Optimization
    Xinlei Yi
    Shengjun Zhang
    Tao Yang
    Tianyou Chai
    Karl Henrik Johansson
    IEEE/CAAJournalofAutomaticaSinica, 2022, 9 (05) : 812 - 833
  • [4] Communication Efficient Primal-Dual Algorithm for Nonconvex Nonsmooth Distributed Optimization
    Chen, Congliang
    Zhang, Jiawei
    Shen, Li
    Zhao, Peilin
    Luo, Zhi-Quan
    24TH INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS (AISTATS), 2021, 130
  • [5] A Primal-Dual Algorithm for Distributed Optimization
    Bianchi, P.
    Hachem, W.
    2014 IEEE 53RD ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2014, : 4240 - 4245
  • [6] A PRIMAL-DUAL EXTERIOR POINT METHOD WITH A PRIMAL-DUAL QUADRATIC PENALTY FUNCTION FOR NONLINEAR OPTIMIZATION
    Igarashi, Yu
    Yabe, Hiroshi
    PACIFIC JOURNAL OF OPTIMIZATION, 2015, 11 (04): : 721 - 736
  • [7] Primal-dual algorithm for distributed constrained optimization
    Lei, Jinlong
    Chen, Han-Fu
    Fang, Hai-Tao
    SYSTEMS & CONTROL LETTERS, 2016, 96 : 110 - 117
  • [8] Perturbed proximal primal-dual algorithm for nonconvex nonsmooth optimization
    Hajinezhad, Davood
    Hong, Mingyi
    MATHEMATICAL PROGRAMMING, 2019, 176 (1-2) : 207 - 245
  • [9] NESTT: A Nonconvex Primal-Dual Splitting Method for Distributed and Stochastic Optimization
    Hajinezhad, Davood
    Hong, Mingyi
    Zhao, Tuo
    Wang, Zhaoran
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 29 (NIPS 2016), 2016, 29
  • [10] Primal-Dual Algorithm for Distributed Optimization with Coupled Constraints
    Gong, Kai
    Zhang, Liwei
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2024, 201 (01) : 252 - 279