Gradient-free distributed online optimization in networks

被引:0
作者
Liu, Yuhang [1 ]
Zhao, Wenxiao [2 ,3 ]
Zhang, Nan [1 ]
Lv, Dongdong [1 ]
Zhang, Shuai [1 ]
机构
[1] State Grid Informat & Telecommun Grp Co Ltd, Acad Informat & Commun Res, Beijing 102211, Peoples R China
[2] Chinese Acad Sci, Acad Math & Syst Sci, Key Lab Syst & Control, Beijing 100190, Peoples R China
[3] Univ Chinese Acad Sci, Sch Math Sci, Beijing 100049, Peoples R China
来源
CONTROL THEORY AND TECHNOLOGY | 2025年
关键词
Distributed optimization; Online convex optimization; Gradient-free algorithm; Projection-free algorithm; CONVEX-OPTIMIZATION; CONSTRAINED OPTIMIZATION; ALGORITHM;
D O I
10.1007/s11768-025-00242-0
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we consider the distributed online optimization problem on a time-varying network, where each agent on the network has its own time-varying objective function and the goal is to minimize the overall loss accumulated. Moreover, we focus on distributed algorithms which do not use gradient information and projection operators to improve the applicability and computational efficiency. By introducing the deterministic differences and the randomized differences to substitute the gradient information of the objective functions and removing the projection operator in the traditional algorithms, we design two kinds of gradient-free distributed online optimization algorithms without projection step, which can economize considerable computational resources as well as has less limitations on the applicability. We prove that both of two algorithms achieves consensus of the estimates and regrets of Olog(T)\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$O\left( \log (T)\right) $$\end{document} for local strongly convex objective, respectively. Finally, a simulation example is provided to verify the theoretical results.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] A conditional gradient algorithm for distributed online optimization in networks
    Shen, Xiuyu
    Li, Dequan
    Fang, Runyue
    Dong, Qiao
    [J]. IET CONTROL THEORY AND APPLICATIONS, 2021, 15 (04) : 570 - 579
  • [22] Gradient-free method for distributed multi-agent optimization via push-sum algorithms
    Yuan, Deming
    Xu, Shengyuan
    Lu, Junwei
    [J]. INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2015, 25 (10) : 1569 - 1580
  • [23] Reactive Power Optimization for Distribution Network Based on Distributed Random Gradient-Free Algorithm
    Xie, Jun
    Liang, Chunxiang
    Xiao, Yichen
    [J]. ENERGIES, 2018, 11 (03):
  • [24] Distributed Event-Triggered Random Gradient-Free Optimization Algorithm For Multiagent Systems
    Hu, Xiaojing
    Zhang, Huifeng
    Zhuo, Qingze
    [J]. 2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 4972 - 4977
  • [25] Gradient-free strategies to robust well control optimization
    Pinto, Jefferson Wellano Oliveira
    Tueros, Juan Alberto Rojas
    Horowitz, Bernardo
    da Silva, Silvana Maria Bastos Afonso
    Willmersdorf, Ramiro Brito
    de Oliveira, Diego Felipe Barbosa
    [J]. COMPUTATIONAL GEOSCIENCES, 2020, 24 (06) : 1959 - 1978
  • [26] An adaptive Bayesian approach to gradient-free global optimization
    Yu, Jianneng
    Morozov, Alexandre, V
    [J]. NEW JOURNAL OF PHYSICS, 2024, 26 (02):
  • [27] Gradient-free strategies to robust well control optimization
    Jefferson Wellano Oliveira Pinto
    Juan Alberto Rojas Tueros
    Bernardo Horowitz
    Silvana Maria Bastos Afonso da Silva
    Ramiro Brito Willmersdorf
    Diego Felipe Barbosa de Oliveira
    [J]. Computational Geosciences, 2020, 24 : 1959 - 1978
  • [28] A stochastic subspace approach to gradient-free optimization in high dimensions
    Kozak, David
    Becker, Stephen
    Doostan, Alireza
    Tenorio, Luis
    [J]. COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2021, 79 (02) : 339 - 368
  • [29] Distributed Randomized Gradient-Free Optimization Protocol of Multiagent Systems Over Weight-Unbalanced Digraphs
    Wang, Dong
    Yin, Jianjie
    Wang, Wei
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2021, 51 (01) : 473 - 482
  • [30] Push-Pull Gradient Methods for Distributed Optimization in Networks
    Pu, Shi
    Shi, Wei
    Xu, Jinming
    Nedic, Angelia
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2021, 66 (01) : 1 - 16