Gradient-free distributed online optimization in networks

被引:0
作者
Liu, Yuhang [1 ]
Zhao, Wenxiao [2 ,3 ]
Zhang, Nan [1 ]
Lv, Dongdong [1 ]
Zhang, Shuai [1 ]
机构
[1] State Grid Informat & Telecommun Grp Co Ltd, Acad Informat & Commun Res, Beijing 102211, Peoples R China
[2] Chinese Acad Sci, Acad Math & Syst Sci, Key Lab Syst & Control, Beijing 100190, Peoples R China
[3] Univ Chinese Acad Sci, Sch Math Sci, Beijing 100049, Peoples R China
关键词
Distributed optimization; Online convex optimization; Gradient-free algorithm; Projection-free algorithm; CONVEX-OPTIMIZATION; CONSTRAINED OPTIMIZATION; ALGORITHM;
D O I
10.1007/s11768-025-00242-0
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we consider the distributed online optimization problem on a time-varying network, where each agent on the network has its own time-varying objective function and the goal is to minimize the overall loss accumulated. Moreover, we focus on distributed algorithms which do not use gradient information and projection operators to improve the applicability and computational efficiency. By introducing the deterministic differences and the randomized differences to substitute the gradient information of the objective functions and removing the projection operator in the traditional algorithms, we design two kinds of gradient-free distributed online optimization algorithms without projection step, which can economize considerable computational resources as well as has less limitations on the applicability. We prove that both of two algorithms achieves consensus of the estimates and regrets of Olog(T)\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$O\left( \log (T)\right) $$\end{document} for local strongly convex objective, respectively. Finally, a simulation example is provided to verify the theoretical results.
引用
收藏
页码:207 / 220
页数:14
相关论文
共 46 条
[1]   Opinion Dynamics and Learning in Social Networks [J].
Acemoglu, Daron ;
Ozdaglar, Asuman .
DYNAMIC GAMES AND APPLICATIONS, 2011, 1 (01) :3-49
[2]   Efficient sensor management policies for distributed target tracking in multihop sensor networks [J].
Aeron, Shuchin ;
Saligrama, Venkatesh ;
Castanon, David A. .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2008, 56 (06) :2562-2574
[3]   Distributed Online Convex Optimization on Time-Varying Directed Graphs [J].
Akbari, Mohammad ;
Gharesifard, Bahman ;
Linder, Tamas .
IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS, 2017, 4 (03) :417-428
[4]  
Cesa-Bianchi N., 2006, PREDICTION LEARNING, DOI DOI 10.1017/CBO9780511546921
[5]   Distributed Constrained Optimization by Consensus-Based Primal-Dual Perturbation Method [J].
Chang, Tsung-Hui ;
Nedic, Angelia ;
Scaglione, Anna .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2014, 59 (06) :1524-1538
[6]   Nonsmooth Coordination and Geometric Optimization via Distributed Dynamical Systems [J].
Cortes, Jorge ;
Bullo, Francesco .
SIAM REVIEW, 2009, 51 (01) :163-189
[7]   Emergent behavior in flocks [J].
Cucker, Felipe ;
Smale, Steve .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2007, 52 (05) :852-862
[8]   Distributed Continuous-Time Convex Optimization on Weight-Balanced Digraphs [J].
Gharesifard, Bahman ;
Cortes, Jorge .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2014, 59 (03) :781-786
[9]  
Hazan E., 2016, Optimization, V2, P157, DOI 10.1561/2400000013
[10]  
Hosseini S, 2013, IEEE DECIS CONTR P, P1484, DOI 10.1109/CDC.2013.6760092