Gradient-free distributed online optimization in networks

被引:0
|
作者
Liu, Yuhang [1 ]
Zhao, Wenxiao [2 ,3 ]
Zhang, Nan [1 ]
Lv, Dongdong [1 ]
Zhang, Shuai [1 ]
机构
[1] State Grid Informat & Telecommun Grp Co Ltd, Acad Informat & Commun Res, Beijing 102211, Peoples R China
[2] Chinese Acad Sci, Acad Math & Syst Sci, Key Lab Syst & Control, Beijing 100190, Peoples R China
[3] Univ Chinese Acad Sci, Sch Math Sci, Beijing 100049, Peoples R China
来源
CONTROL THEORY AND TECHNOLOGY | 2025年
关键词
Distributed optimization; Online convex optimization; Gradient-free algorithm; Projection-free algorithm; CONVEX-OPTIMIZATION; CONSTRAINED OPTIMIZATION; ALGORITHM;
D O I
10.1007/s11768-025-00242-0
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we consider the distributed online optimization problem on a time-varying network, where each agent on the network has its own time-varying objective function and the goal is to minimize the overall loss accumulated. Moreover, we focus on distributed algorithms which do not use gradient information and projection operators to improve the applicability and computational efficiency. By introducing the deterministic differences and the randomized differences to substitute the gradient information of the objective functions and removing the projection operator in the traditional algorithms, we design two kinds of gradient-free distributed online optimization algorithms without projection step, which can economize considerable computational resources as well as has less limitations on the applicability. We prove that both of two algorithms achieves consensus of the estimates and regrets of Olog(T)\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$O\left( \log (T)\right) $$\end{document} for local strongly convex objective, respectively. Finally, a simulation example is provided to verify the theoretical results.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Gradient-free algorithms for distributed online convex optimization
    Liu, Yuhang
    Zhao, Wenxiao
    Dong, Daoyi
    ASIAN JOURNAL OF CONTROL, 2023, 25 (04) : 2451 - 2468
  • [2] Gradient-free distributed online optimization in networksGradient-free distributed online optimization in networksY. Liu et al.
    Yuhang Liu
    Wenxiao Zhao
    Nan Zhang
    Dongdong Lv
    Shuai Zhang
    Control Theory and Technology, 2025, 23 (2) : 207 - 220
  • [3] Distributed Online Optimization With Gradient-free Design
    Wang, Lingfei
    Wang, Yinghui
    Hong, Yiguang
    PROCEEDINGS OF THE 38TH CHINESE CONTROL CONFERENCE (CCC), 2019, : 5677 - 5682
  • [4] Randomized Gradient-Free Distributed Online Optimization via a Dynamic Regret Analysis
    Pang, Yipeng
    Hu, Guoqiang
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2023, 68 (11) : 6781 - 6788
  • [5] Randomized Gradient-Free Distributed Online Optimization with Time-Varying Cost Functions
    Pang, Yipeng
    Hu, Guoqiang
    2019 IEEE 58TH CONFERENCE ON DECISION AND CONTROL (CDC), 2019, : 4910 - 4915
  • [6] Gradient-free method for nonsmooth distributed optimization
    Li, Jueyou
    Wu, Changzhi
    Wu, Zhiyou
    Long, Qiang
    JOURNAL OF GLOBAL OPTIMIZATION, 2015, 61 (02) : 325 - 340
  • [7] Gradient-free distributed optimization with exact convergence
    Pang, Yipeng
    Hu, Guoqiang
    AUTOMATICA, 2022, 144
  • [8] Gradient-free method for nonsmooth distributed optimization
    Jueyou Li
    Changzhi Wu
    Zhiyou Wu
    Qiang Long
    Journal of Global Optimization, 2015, 61 : 325 - 340
  • [9] Distributed Nonconvex Optimization via Bounded Gradient-Free Inputs
    Du, Yong
    Chen, Fei
    Xiang, Linying
    Feng, Gang
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2025,
  • [10] Strong consistency of random gradient-free algorithms for distributed optimization
    Chen, Xing-Min
    Gao, Chao
    OPTIMAL CONTROL APPLICATIONS & METHODS, 2017, 38 (02) : 247 - 265