Decentralized Statistical Inference with Unrolled Graph Neural Networks

被引:1
|
作者
Wang, He [1 ,2 ,3 ]
Shen, Yifei [4 ]
Wang, Ziyuan [1 ]
Li, Dongsheng [5 ]
Zhang, Jun [6 ]
Letaief, Khaled B. [4 ]
Lu, Jie [1 ]
机构
[1] ShanghaiTech Univ, Sch Informat Sci & Technol, Shanghai 201210, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] Chinese Acad Sci, Shanghai Inst Microsyst & Informat Technol, Shanghai 200050, Peoples R China
[4] Hong Kong Univ Sci & Technol, Dept Elect & Comp Engn, Hong Kong, Peoples R China
[5] Microsoft Res Asia, Shanghai, Peoples R China
[6] Hong Kong Polytech Univ, Dept Elect & Informat Engn, Hong Kong, Peoples R China
来源
2021 60TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC) | 2021年
基金
中国国家自然科学基金;
关键词
Decentralized optimization; graph neural networks; algorithm unrolling; interpretable deep learning; PROXIMAL GRADIENT ALGORITHM;
D O I
10.1109/CDC45484.2021.9682857
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we investigate the decentralized statistical inference problem, where a network of agents cooperatively recover a (structured) vector from private noisy samples without centralized coordination. Existing optimization-based algorithms suffer from issues of model mismatches and poor convergence speed, and thus their performance would be degraded provided that the number of communication rounds is limited. This motivates us to propose a learning-based framework, which unrolls well-noted decentralized optimization algorithms (e.g., Prox-DGD and PG-EXTRA) into graph neural networks (GNNs). By minimizing the recovery error via end-to-end training, this learning-based framework resolves the model mismatch issue. Our convergence analysis (with PG-EXTRA as the base algorithm) reveals that the learned model parameters may accelerate the convergence and reduce the recovery error to a large extent. The simulation results demonstrate that the proposed GNN-based learning methods prominently outperform several state-of-the-art optimization-based algorithms in convergence speed and recovery error.
引用
收藏
页码:2634 / 2640
页数:7
相关论文
共 50 条
  • [41] Graph-based neural networks for explainable image privacy inference
    Yang, Guang
    Cao, Juan
    Chen, Zhineng
    Guo, Junbo
    Li, Jintao
    PATTERN RECOGNITION, 2020, 105
  • [42] Efficient Inference of Graph Neural Networks Using Local Sensitive Hash
    Liu, Tao
    Li, Peng
    Su, Zhou
    Dong, Mianxiong
    IEEE Transactions on Sustainable Computing, 9 (03): : 548 - 558
  • [43] PIAFGNN: Property Inference Attacks against Federated Graph Neural Networks
    Liu, Jiewen
    Chen, Bing
    Xue, Baolu
    Guo, Mengya
    Xu, Yuntao
    CMC-COMPUTERS MATERIALS & CONTINUA, 2025, 82 (02): : 1857 - 1877
  • [44] Morpho-Statistical Description of Networks Through Graph Modelling and Bayesian Inference
    Laporte-Chabasse, Quentin
    Stoica, Radu S.
    Clausel, Marianne
    Charoy, Francois
    Oster, Gerald
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2022, 9 (04): : 2123 - 2138
  • [45] Learning Decentralized Controllers for Segregation of Heterogeneous Robot Swarms with Graph Neural Networks
    Omotuyi, Oyindamola
    Kumar, Manish
    PROCEEDINGS OF THE 5TH INTERNATIONAL CONFERENCE ON MANIPULATION, AUTOMATION, AND ROBOTICS AT SMALL SCALES (MARSS 2022), 2022,
  • [46] Learning Scalable Decentralized Controllers for Heterogeneous Robot Swarms With Graph Neural Networks
    Omotuyi, Oyindamola
    Kumar, Manish
    JOURNAL OF DYNAMIC SYSTEMS MEASUREMENT AND CONTROL-TRANSACTIONS OF THE ASME, 2024, 146 (06):
  • [47] From statistical inference to a differential learning rule for stochastic neural networks
    Saglietti, Luca
    Gerace, Federica
    Ingrosso, Alessandro
    Baldassi, Carlo
    Zecchina, Riccardo
    INTERFACE FOCUS, 2018, 8 (06)
  • [48] Architectural Implications for Inference of Graph Neural Networks on CGRA-based Accelerators
    Zulberti, Luca
    Monopoli, Matteo
    Nannipieri, Pietro
    Fanucci, Luca
    PRIME 2022: 17TH INTERNATIONAL CONFERENCE ON PHD RESEARCH IN MICROELECTRONICS AND ELECTRONICS, 2022, : 305 - 308
  • [49] Dynamic Multi-View Graph Neural Networks for Citywide Traffic Inference
    Dai, Shaojie
    Wang, Jinshuai
    Huang, Chao
    Yu, Yanwei
    Dong, Junyu
    ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2023, 17 (04)
  • [50] Adverse Drug Reaction Prediction: Graph Neural Networks and Causal Inference Techniques
    Patel, Jay
    Patel, Rudra
    4TH INTERDISCIPLINARY CONFERENCE ON ELECTRICS AND COMPUTER, INTCEC 2024, 2024,