Linearly Convergent Second-Order Distributed Optimization Algorithms

被引:1
作者
Qu, Zhihai [1 ,2 ]
Li, Xiuxian [1 ,2 ]
Li, Li [1 ,2 ]
Hong, Yiguang [1 ,2 ]
机构
[1] Tongji Univ, Shanghai Res Inst Intelligent Autonomous Syst, Coll Elect & Informat Engn, Dept Control Sci & Engn, Shanghai 200070, Peoples R China
[2] Tongji Univ, Shanghai Inst Intelligent Sci & Technol, Shanghai 200070, Peoples R China
基金
中国国家自然科学基金;
关键词
Convergence; Optimization; Costs; Three-dimensional displays; Taylor series; Linear programming; Lagrangian functions; Adapt-then-combine (ATC) diffusion; distributed optimization; primal-dual method; second-order method; NEWTON METHOD; CONSENSUS;
D O I
10.1109/TAC.2024.3360287
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article studies distributed optimization problems whose goal is to minimize the sum of cost functions located among agents in a network, where communications are described by a connected and undirected graph. Two novel second-order methods with adapt-then-combine strategy are developed. For the algorithms, explicit convergence rates are established under strongly convex and the Lipschitz gradient assumptions. Finally, numerical examples demonstrate the efficiency of algorithms and are in line with theoretical results.
引用
收藏
页码:5431 / 5438
页数:8
相关论文
共 42 条
[1]  
Alghunaim S. A., 2021, Ph.D. dissertation
[2]   Decentralized Proximal Gradient Algorithms With Linear Convergence Rates [J].
Alghunaim, Sulaiman A. ;
Ryu, Ernest K. ;
Yuan, Kun ;
Sayed, Ali H. .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2021, 66 (06) :2787-2794
[3]   NEWTON-LIKE METHOD WITH DIAGONAL CORRECTION FOR DISTRIBUTED OPTIMIZATION [J].
Bajovic, Dragana ;
Jakovetic, Dusan ;
Krejic, Natasa ;
Jerinkic, Natasa Krklec .
SIAM JOURNAL ON OPTIMIZATION, 2017, 27 (02) :1171-1203
[4]   Asynchronous Distributed ADMM for Large-Scale Optimization-Part I: Algorithm and Convergence Analysis [J].
Chang, Tsung-Hui ;
Hong, Mingyi ;
Liao, Wei-Cheng ;
Wang, Xiangfeng .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2016, 64 (12) :3118-3130
[5]   A Primal-Dual Quasi-Newton Method for Exact Consensus Optimization [J].
Eisen, Mark ;
Mokhtari, Aryan ;
Ribeiro, Alejandro .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2019, 67 (23) :5983-5997
[6]   Decentralized Quasi-Newton Methods [J].
Eisen, Mark ;
Mokhtari, Aryan ;
Ribeiro, Alejandro .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2017, 65 (10) :2613-2628
[7]  
Grant S., 2020, CVX MATLAB SOFTWARE
[8]   A Unification and Generalization of Exact Distributed First-Order Methods [J].
Jakovetic, Dusan .
IEEE TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING OVER NETWORKS, 2019, 5 (01) :31-46
[9]  
Li BY, 2020, J MACH LEARN RES, V21
[10]   Distributed Nesterov Gradient and Heavy-Ball Double Accelerated Asynchronous Optimization [J].
Li, Huaqing ;
Cheng, Huqiang ;
Wang, Zheng ;
Wu, Guo-Cheng .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (12) :5723-5737