Performing linear convergence for distributed constrained optimisation over time-varying directed unbalanced networks

被引:19
|
作者
Lu, Qingguo [1 ]
Li, Huaqing [1 ]
Wang, Zheng [1 ]
Han, Qi [2 ]
Ge, Wei [3 ]
机构
[1] Southwest Univ, Coll Elect & Informat Engn, Chongqing Key Lab Nonlinear Circuits & Intelligen, Chongqing 400715, Peoples R China
[2] Chongqing Univ Sci & Technol, Coll Elect & Informat Engn, Chongqing 401331, Peoples R China
[3] Nanjing Univ, Coll Chem & Chem Engn, Nanjing 210046, Jiangsu, Peoples R China
来源
IET CONTROL THEORY AND APPLICATIONS | 2019年 / 13卷 / 17期
基金
中国国家自然科学基金;
关键词
stochastic processes; matrix algebra; convergence of numerical methods; convex programming; optimisation; convergence; gradient methods; minimisation; iterative methods; integrated push-sum strategy; distributed inexact gradient tracking method; uncoordinated step-sizes; constrained optimisation problems; time-varying; unbalanced networks; DPD-PD converges; performing linear convergence; distributed constrained optimisation; local convex objective functions; private local convex objective function; coupling equality constraint; local inequality constraint; optimisation problem; primal-dual push-DIGing; MULTIAGENT SYSTEMS; GLOBAL CONSENSUS; ALGORITHMS;
D O I
10.1049/iet-cta.2018.6026
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The problem of distributed constrained optimisation over a network of agents, where the goal is to cooperatively minimise the sum of all local convex objective functions is studied. Each agent in the network possesses only its private local convex objective function and is constrained to a coupling equality constraint and its local inequality constraint. Moreover, the authors particularly focus on the scenario where each agent is only allowed to interact with their in-neighbours over a series of time-varying directed unbalanced networks. To collectively address the optimisation problem, a novel distributed primal-dual push-DIGing (integrated push-sum strategy with distributed inexact gradient tracking method) algorithm (termed as DPD-PD) in which agents employ uncoordinated step-sizes is proposed. Unlike other methods, DPD-PD allows not only the mixing matrices are column-stochastic, but also the step-sizes are uncoordinated. An important feature of DPD-PD is handling distributed constrained optimisation problems in the case of time-varying directed unbalanced networks. When objective functions are strongly convex and smooth, the authors demonstrate that DPD-PD converges linearly to the optimal solution given that the uncoordinated step-sizes are smaller than an upper bound. Explicit convergence rate is also conducted. Preliminary results on some numerical experiments validate the theoretical findings.
引用
收藏
页码:2800 / 2810
页数:11
相关论文
共 50 条
  • [1] Convergence of an accelerated distributed optimisation algorithm over time-varying directed networks
    Hu, Jinhui
    Yan, Yu
    Li, Huaqing
    Wang, Zheng
    Xia, Dawen
    Guo, Jing
    IET CONTROL THEORY AND APPLICATIONS, 2021, 15 (01): : 24 - 39
  • [2] Distributed constrained optimization algorithms with linear convergence rate over time-varying unbalanced graphs☆
    Liu, Hongzhe
    Yu, Wenwu
    Zheng, Wei Xing
    Nedic, Angelia
    Zhu, Yanan
    AUTOMATICA, 2024, 159
  • [3] Differentially Private Distributed Optimization Over Time-Varying Unbalanced Networks With Linear Convergence Rates
    Yang, Zhen
    He, Wangli
    Yang, Shaofu
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2025, 73 : 1138 - 1152
  • [4] Distributed algorithms with linear convergence for aggregative games over time-varying networks
    Zhu, Rui
    Wang, Fuyong
    Liu, Zhongxin
    Chen, Zengqiang
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 273
  • [5] Constrained Distributed Nonconvex Optimization over Time-varying Directed Graphs
    He, Zhiyu
    He, Jianping
    Chen, Cailian
    Guan, Xinping
    2020 59TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2020, : 378 - 383
  • [6] Privacy Distributed Constrained Optimization Over Time-Varying Unbalanced Networks and Its Application in Federated Learning
    Wei, Mengli
    Yu, Wenwu
    Chen, Duxin
    Kang, Mingyu
    Cheng, Guang
    IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2025, 12 (02) : 335 - 346
  • [7] Privacy Distributed Constrained Optimization Over Time-Varying Unbalanced Networks and Its Application in Federated Learning
    Mengli Wei
    Wenwu Yu
    Duxin Chen
    Mingyu Kang
    Guang Cheng
    IEEE/CAA Journal of Automatica Sinica, 2025, 12 (02) : 335 - 346
  • [8] Distributed nonlinear estimation over time-varying directed networks
    Wang, Qianyao
    Meng, Min
    INFORMATION SCIENCES, 2023, 620 : 47 - 66
  • [9] Distributed Projection Subgradient Algorithm Over Time-Varying General Unbalanced Directed Graphs
    Li, Huaqing
    Lu, Qingguo
    Huang, Tingwen
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2019, 64 (03) : 1309 - 1316
  • [10] Convergence of Distributed Accelerated Algorithm Over Unbalanced Directed Networks
    Li, Huaqing
    Lu, Qingguo
    Chen, Guo
    Huang, Tingwen
    Dong, Zhaoyang
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2021, 51 (08): : 5153 - 5164