Cooperative Distributed Optimization in Multiagent Networks With Delays

被引:131
作者
Wang, Huiwei [1 ]
Liao, Xiaofeng [1 ]
Huang, Tingwen [2 ]
Li, Chaojie [3 ]
机构
[1] Southwest Univ, Coll Elect & Informat Engn, Chongqing 400715, Peoples R China
[2] Texas A&M Univ Qatar, Doha, Qatar
[3] RMIT Univ, Platform Technol Res Inst, Melbourne, Vic 3001, Australia
来源
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS | 2015年 / 45卷 / 02期
基金
中国国家自然科学基金;
关键词
Delayed subgradient; distributed optimization; multiagent networks; spectral gap; SUBGRADIENT METHOD; CONSENSUS; TIME;
D O I
10.1109/TSMC.2014.2332306
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this technical correspondence, we consider a distributed cooperative optimization problem encountered in a computational multiagent network with delay, where each agent has local access to its convex cost function, and jointly minimizes the cost function over the whole network. To solve this problem, we develop an algorithm that is based on dual averaging updates and delayed subgradient information, and analyze its convergence properties for a diminishing step-size by utilizing Bregman-distance functions. Moreover, we provide sharp bounds on the convergence rates as a function of the network size and topology embodied in the inverse spectral gap. Finally, we present a numerical example to evaluate our algorithm and compare its performance with several similar algorithms.
引用
收藏
页码:363 / 369
页数:7
相关论文
共 24 条
  • [1] Agarwal A., 2011, DISTRIBUTED DELAYED
  • [2] [Anonymous], 2010, Convex Optimization in Signal Processing and Communications
  • [3] BREGMAN L. M., 1967, USSR Computational Mathematics and Mathematical Physics, V7, P200, DOI 10.1016/0041-5553(67)90040-7
  • [4] A Delayed Projection Neural Network for Solving Linear Variational Inequalities
    Cheng, Long
    Hou, Zeng-Guang
    Tan, Min
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2009, 20 (06): : 915 - 925
  • [5] Dual Averaging for Distributed Optimization: Convergence Analysis and Network Scaling
    Duchi, John C.
    Agarwal, Alekh
    Wainwright, Martin J.
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2012, 57 (03) : 592 - 606
  • [6] Solving the Assignment Problem Using Continuous-Time and Discrete-Time Improved Dual Networks
    Hu, Xiaolin
    Wang, Jun
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2012, 23 (05) : 821 - 827
  • [7] A RANDOMIZED INCREMENTAL SUBGRADIENT METHOD FOR DISTRIBUTED OPTIMIZATION IN NETWORKED SYSTEMS
    Johansson, Bjorn
    Rabi, Maben
    Johansson, Mikael
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2009, 20 (03) : 1157 - 1170
  • [8] Consensus of Multiagent Systems and Synchronization of Complex Networks: A Unified Viewpoint
    Li, Zhongkui
    Duan, Zhisheng
    Chen, Guanrong
    Huang, Lin
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2010, 57 (01) : 213 - 224
  • [9] Consensus in Networks of Multiagents With Cooperation and Competition Via Stochastically Switching Topologies
    Liu, Bo
    Chen, Tianping
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2008, 19 (11): : 1967 - 1973
  • [10] Constrained Consensus and Optimization in Multi-Agent Networks
    Nedic, Angelia
    Ozdaglar, Asuman
    Parrilo, Pablo A.
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2010, 55 (04) : 922 - 938