Decentralized Statistical Inference with Unrolled Graph Neural Networks

被引:1
|
作者
Wang, He [1 ,2 ,3 ]
Shen, Yifei [4 ]
Wang, Ziyuan [1 ]
Li, Dongsheng [5 ]
Zhang, Jun [6 ]
Letaief, Khaled B. [4 ]
Lu, Jie [1 ]
机构
[1] ShanghaiTech Univ, Sch Informat Sci & Technol, Shanghai 201210, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] Chinese Acad Sci, Shanghai Inst Microsyst & Informat Technol, Shanghai 200050, Peoples R China
[4] Hong Kong Univ Sci & Technol, Dept Elect & Comp Engn, Hong Kong, Peoples R China
[5] Microsoft Res Asia, Shanghai, Peoples R China
[6] Hong Kong Polytech Univ, Dept Elect & Informat Engn, Hong Kong, Peoples R China
来源
2021 60TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC) | 2021年
基金
中国国家自然科学基金;
关键词
Decentralized optimization; graph neural networks; algorithm unrolling; interpretable deep learning; PROXIMAL GRADIENT ALGORITHM;
D O I
10.1109/CDC45484.2021.9682857
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we investigate the decentralized statistical inference problem, where a network of agents cooperatively recover a (structured) vector from private noisy samples without centralized coordination. Existing optimization-based algorithms suffer from issues of model mismatches and poor convergence speed, and thus their performance would be degraded provided that the number of communication rounds is limited. This motivates us to propose a learning-based framework, which unrolls well-noted decentralized optimization algorithms (e.g., Prox-DGD and PG-EXTRA) into graph neural networks (GNNs). By minimizing the recovery error via end-to-end training, this learning-based framework resolves the model mismatch issue. Our convergence analysis (with PG-EXTRA as the base algorithm) reveals that the learned model parameters may accelerate the convergence and reduce the recovery error to a large extent. The simulation results demonstrate that the proposed GNN-based learning methods prominently outperform several state-of-the-art optimization-based algorithms in convergence speed and recovery error.
引用
收藏
页码:2634 / 2640
页数:7
相关论文
共 50 条
  • [21] COVID-19 infection inference with graph neural networks
    Kyungwoo Song
    Hojun Park
    Junggu Lee
    Arim Kim
    Jaehun Jung
    Scientific Reports, 13
  • [22] COVID-19 infection inference with graph neural networks
    Song, Kyungwoo
    Park, Hojun
    Lee, Junggu
    Kim, Arim
    Jung, Jaehun
    SCIENTIFIC REPORTS, 2023, 13 (01)
  • [23] RoadTagger: Robust Road Attribute Inference with Graph Neural Networks
    He, Songtao
    Bastani, Favyen
    Jagwani, Satvat
    Park, Edward
    Abbar, Sofiane
    Alizadeh, Mohammad
    Balakrishnan, Hari
    Chawla, Sanjay
    Madden, Samuel
    Sadeghi, Mohammad Amin
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 10965 - 10972
  • [24] A graph neural network framework for causal inference in brain networks
    S. Wein
    W. M. Malloni
    A. M. Tomé
    S. M. Frank
    G. -I. Henze
    S. Wüst
    M. W. Greenlee
    E. W. Lang
    Scientific Reports, 11
  • [25] A graph neural network framework for causal inference in brain networks
    Wein, S.
    Malloni, W. M.
    Tome, A. M.
    Frank, S. M.
    Henze, G-, I
    Wuest, S.
    Greenlee, M. W.
    Lang, E. W.
    SCIENTIFIC REPORTS, 2021, 11 (01)
  • [26] Knowledge-Driven Resource Allocation for Wireless Networks: A WMMSE Unrolled Graph Neural Network Approach
    Yang, Hao
    Cheng, Nan
    Sun, Ruijin
    Quan, Wei
    Chai, Rong
    Aldubaikhy, Khalid
    Alqasir, Abdullah
    Shen, Xuemin
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (10): : 18902 - 18916
  • [27] Unboxing the graph: Towards interpretable graph neural networks for transport prediction through neural relational inference
    Tygesen, Mathias Niemann
    Pereira, Francisco Camara
    Rodrigues, Filipe
    TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2023, 146
  • [28] Spatial Temporal Graph Neural Networks for Decentralized Control of Robot Swarms
    Chen, Siji
    Sun, Yanshen
    Li, Peihan
    Zhou, Lifeng
    Lu, Chang-Tien
    31ST ACM SIGSPATIAL INTERNATIONAL CONFERENCE ON ADVANCES IN GEOGRAPHIC INFORMATION SYSTEMS, ACM SIGSPATIAL GIS 2023, 2023, : 450 - 453
  • [29] Graph Neural Networks for Decentralized Multi-Robot Path Planning
    Li, Qingbiao
    Gama, Fernando
    Ribeiro, Alejandro
    Prorok, Amanda
    2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 11785 - 11792
  • [30] Decentralized Training of Graph Neural Networks in Mobile Systems for Power Control
    Zhao, Jianyu
    Ling, Hao
    Yang, Chenyang
    Liu, Tingting
    2024 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC 2024, 2024,