Decentralized Randomized Block-Coordinate Frank-Wolfe Algorithms for Submodular Maximization Over Networks

被引:3
|
作者
Zhang, Mingchuan [1 ]
Zhou, Yangfan [1 ]
Ge, Quanbo [2 ]
Zheng, Ruijuan [1 ]
Wu, Qingtao [1 ]
机构
[1] Henan Univ Sci & Technol, Sch Informat Engn, Luoyang 471023, Peoples R China
[2] Tongji Univ, Sch Elect & Informat Engn, Shanghai 200092, Peoples R China
来源
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS | 2022年 / 52卷 / 08期
基金
中国国家自然科学基金;
关键词
Optimization; Approximation algorithms; Heuristic algorithms; Convergence; Greedy algorithms; Linear programming; Germanium; Conditional gradient methods; decentralized optimization; randomized block-coordinate descent; submodular maximization; DISTRIBUTED OPTIMIZATION; CONSENSUS; CONVERGENCE; CONVEX;
D O I
10.1109/TSMC.2021.3112691
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We consider decentralized large-scale continuous submodular constrained optimization problems over networks, where the goal is to maximize a sum of nonconvex functions with diminishing returns property. However, the computations of the projection step and the whole gradient can become prohibitive in high-dimensional constrained optimization problems. For this reason, a decentralized randomized block-coordinate Frank-Wolfe algorithm is proposed for submoduar maximization over networks by local communication and computation, which adopts the randomized block-coordinate descent and the Frank-Wolfe technique. We also show that the proposed algorithm converges to an approximation fact (1-e(-pmax)/(pmin)) of the global maximal points at a rate of O(1/T) by choosing a suitable stepsize, where T is the number of iterations. In addition, we confirm the theoretical results by experiments.
引用
收藏
页码:5081 / 5091
页数:11
相关论文
共 9 条
  • [1] Parallel and Distributed Block-Coordinate Frank-Wolfe Algorithms
    Wang, Yu-Xiang
    Sadhanala, Veeranjaneyulu
    Dai, Wei
    Neiswanger, Willie
    Sra, Suvrit
    Xing, Eric P.
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 48, 2016, 48
  • [2] Stochastic Block-Coordinate Gradient Projection Algorithms for Submodular Maximization
    Li, Zhigang
    Zhang, Mingchuan
    Zhu, Junlong
    Zheng, Ruijuan
    Zhang, Qikun
    Wu, Qingtao
    COMPLEXITY, 2018,
  • [3] A privacy-preserving decentralized randomized block-coordinate subgradient algorithm over time-varying networks
    Wang, Lin
    Zhang, Mingchuan
    Zhu, Junlong
    Xing, Ling
    Wu, Qingtao
    EXPERT SYSTEMS WITH APPLICATIONS, 2022, 208
  • [4] A distributed gradient algorithm based on randomized block-coordinate and projection-free over networks
    Zhu, Junlong
    Wang, Xin
    Zhang, Mingchuan
    Liu, Muhua
    Wu, Qingtao
    COMPLEX & INTELLIGENT SYSTEMS, 2023, 9 (01) : 267 - 283
  • [5] Decentralized Zeroth-Order Constrained Stochastic Optimization Algorithms: Frank-Wolfe and Variants With Applications to Black-Box Adversarial Attacks
    Sahu, Anit Kumar
    Kar, Soummya
    PROCEEDINGS OF THE IEEE, 2020, 108 (11) : 1890 - 1905
  • [6] Approximate Frank-Wolfe Algorithms over Graph-structured Support Sets
    Zhou, Baojian
    Sun, Yifan
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [7] Randomized Block-Coordinate Optimistic Gradient Algorithms for Root-Finding Problems
    Tran-Dinh, Quoc
    Luo, Yang
    MATHEMATICS OF OPERATIONS RESEARCH, 2025,
  • [8] Projection-free Decentralized Online Learning for Submodular Maximization over Time-Varying Networks
    Zhu, Junlong
    Wu, Qingtao
    Zhang, Mingchuan
    Zheng, Ruijuan
    Li, Keqin
    JOURNAL OF MACHINE LEARNING RESEARCH, 2021, 22
  • [9] DP-RBADABOUND: A differentially private randomized block-coordinate adaptive gradient algorithm for training deep neural networks
    Wu, Qingtao
    Li, Meiwen
    Zhu, Junlong
    Zheng, Ruijuan
    Xing, Ling
    Zhang, Mingchuan
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 211