FedGCN: Federated Learning-Based Graph Convolutional Networks for Non-Euclidean Spatial Data

被引:32
作者
Hu, Kai [1 ,2 ]
Wu, Jiasheng [1 ,3 ]
Li, Yaogen [1 ,2 ]
Lu, Meixia [1 ,2 ]
Weng, Liguo [1 ,2 ]
Xia, Min [1 ,2 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Automat, Nanjing 210044, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Jiangsu Collaborat Innovat Ctr Atmospher Environm, Nanjing 210044, Peoples R China
[3] Nanjing Univ Sci & Technol, Sch Econ & Business Management, Nanjing 210094, Peoples R China
基金
加拿大自然科学与工程研究理事会; 加拿大创新基金会;
关键词
federated learning; graph convolutional neural network; non-Euclidean spatial data; attention mechanism;
D O I
10.3390/math10061000
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Federated Learning (FL) can combine multiple clients for training and keep client data local, which is a good way to protect data privacy. There are many excellent FL algorithms. However, most of these can only process data with regular structures, such as images and videos. They cannot process non-Euclidean spatial data, that is, irregular data. To address this problem, we propose a Federated Learning-Based Graph Convolutional Network (FedGCN). First, we propose a Graph Convolutional Network (GCN) as a local model of FL. Based on the classical graph convolutional neural network, TopK pooling layers and full connection layers are added to this model to improve the feature extraction ability. Furthermore, to prevent pooling layers from losing information, cross-layer fusion is used in the GCN, giving FL an excellent ability to process non-Euclidean spatial data. Second, in this paper, a federated aggregation algorithm based on an online adjustable attention mechanism is proposed. The trainable parameter rho is introduced into the attention mechanism. The aggregation method assigns the corresponding attention coefficient to each local model, which reduces the damage caused by the inefficient local model parameters to the global model and improves the fault tolerance and accuracy of the FL algorithm. Finally, we conduct experiments on six non-Euclidean spatial datasets to verify that the proposed algorithm not only has good accuracy but also has a certain degree of generality. The proposed algorithm can also perform well in different graph neural networks.
引用
收藏
页数:24
相关论文
共 38 条
[1]  
Abadi M., 2001, ARXIV160304467
[2]  
Bonawitz K., 2019, Proc. Mach. Learn. Syst., V1, P374
[3]   Bike Flow Prediction with Multi-Graph Convolutional Networks [J].
Chai, Di ;
Wang, Leye ;
Yang, Qiang .
26TH ACM SIGSPATIAL INTERNATIONAL CONFERENCE ON ADVANCES IN GEOGRAPHIC INFORMATION SYSTEMS (ACM SIGSPATIAL GIS 2018), 2018, :397-400
[4]  
Chen C., 2021, IEEE T IND INFORM
[5]  
Chen F., 2018, ARXIV180207876
[6]   SecureBoost: A Lossless Federated Learning Framework [J].
Cheng, Kewei ;
Fan, Tao ;
Jin, Yilun ;
Liu, Yang ;
Chen, Tianjian ;
Papadopoulos, Dimitrios ;
Yang, Qiang .
IEEE INTELLIGENT SYSTEMS, 2021, 36 (06) :87-98
[7]   AttEF: Convolutional LSTM Encoder-Forecaster with Attention Module for Precipitation Nowcasting [J].
Fang, Wei ;
Pang, Lin ;
Yi, Weinan ;
Sheng, Victor S. .
INTELLIGENT AUTOMATION AND SOFT COMPUTING, 2021, 30 (02) :453-466
[8]   Survey on the Application of Deep Learning in Extreme Weather Prediction [J].
Fang, Wei ;
Xue, Qiongying ;
Shen, Liang ;
Sheng, Victor S. .
ATMOSPHERE, 2021, 12 (06)
[9]   DOG: A new background removal for object recognition from images [J].
Fang, Wei ;
Ding, Yewen ;
Zhang, Feihong ;
Sheng, Victor S. .
NEUROCOMPUTING, 2019, 361 :85-91
[10]  
Hamilton WL, 2017, ADV NEUR IN, V30