Finite Rate Quantized Distributed Optimization with Geometric Convergence

被引:0
作者
Lee, Chang-Shen [1 ]
Michelusi, Nicolo [1 ]
Scutari, Gesualdo [2 ]
机构
[1] Purdue Univ, Sch Elect & Comp Engn, W Lafayette, IN 47907 USA
[2] Purdue Univ, Sch Ind Engn, W Lafayette, IN 47907 USA
来源
2018 CONFERENCE RECORD OF 52ND ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS, AND COMPUTERS | 2018年
基金
美国国家科学基金会;
关键词
CONSENSUS;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper studies distributed (strongly convex) optimization over multi-agent networks, subject to finite rate communications. We propose the first distributed algorithm achieving geometric convergence to the exact solution of the problem, matching thus the rate of the centralized gradient algorithm (although with different constants). The algorithm combines gradient tracking with a quantized perturbed consensus scheme. The impact on the convergence (rate) of design and network parameters, such as number of bits, algorithm step-size, and network connectivity, is also investigated. Finally, numerical results validate our theoretical findings. They demonstrate the existence of an interesting trade-off among solution accuracy, convergence time and communication cost, defined as the total number of bits transmitted on one link to achieve a target solution error.
引用
收藏
页码:1876 / 1880
页数:5
相关论文
共 21 条
[1]  
[Anonymous], 1984, Technical report
[2]   Distributed Spectrum Sensing for Cognitive Radio Networks by Exploiting Sparsity [J].
Bazerque, Juan Andres ;
Giannakis, Georgios B. .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2010, 58 (03) :1847-1862
[3]   NEXT: In-Network Nonconvex Optimization [J].
Di Lorenzo, Paolo ;
Scutari, Gesualdo .
IEEE TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING OVER NETWORKS, 2016, 2 (02) :120-136
[4]  
Forero PA, 2010, J MACH LEARN RES, V11, P1663
[5]   A RANDOMIZED INCREMENTAL SUBGRADIENT METHOD FOR DISTRIBUTED OPTIMIZATION IN NETWORKED SYSTEMS [J].
Johansson, Bjorn ;
Rabi, Maben ;
Johansson, Mikael .
SIAM JOURNAL ON OPTIMIZATION, 2009, 20 (03) :1157-1170
[6]  
Lee C.-S., 2018, TECH REP
[7]  
Lee C.-S., 2017, P AS C SIGN SYST COM
[8]  
Lee C.-S., 2018, P 57 IEEE C DEC CONT
[9]  
Li J., MATH METHODS APPL SC, V40, P1201
[10]   Distributed Consensus With Limited Communication Data Rate [J].
Li, Tao ;
Fu, Minyue ;
Xie, Lihua ;
Zhang, Ji-Feng .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2011, 56 (02) :279-292