Distributed Hierarchical Temporal Graph Learning for Communication-Efficient High-Dimensional Industrial IoT Modeling

被引:2
作者
Li, Fangyu [1 ,2 ]
Lin, Junnuo [1 ,2 ]
Wang, Yu [3 ]
Du, Yongping [1 ,2 ]
Han, Honggui [1 ,2 ]
机构
[1] Beijing Univ Technol, Fac Informat Technol, Beijing Key Lab Computat Intelligence & Intelligen, Engn Res Ctr Digital Community,Minist Educ, Beijing 100124, Peoples R China
[2] Beijing Univ Technol, Beijing Artificial Intelligence Inst, Beijing 100124, Peoples R China
[3] Temple Univ, Dept Comp & Informat Sci, Philadelphia, PA 19122 USA
基金
北京市自然科学基金; 美国国家科学基金会;
关键词
Industrial Internet of Things; Feature extraction; Distance learning; Data models; Computer aided instruction; Costs; Computational modeling; Distributed learning; graph convolutional network (GCN); industrial Internet of Things (IIoT);
D O I
10.1109/JIOT.2024.3402250
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Distributed learning-based high-dimensional temporal modeling for the industrial Internet of Things (IIoT) has become a prevailing trend. However, traditional distributed learning inefficiently extracts information by straightforward architects, resulting in low modeling accuracy and high communication costs. We propose a distributed hierarchical temporal graph learning (DHTGL) approach. In terminal equipment, we construct an adaptive hierarchical dilation convolutional network to dynamically capture spatiotemporal features by adjusting the dilation factor at each layer. Next, we construct the adaptive graphs according to the connection similarity between dimensions to capture implicit connections. In the edge device, we design a node-edge graph distance calculation based on the Gromov-Wasserstein distance to group feature graphs and construct representative cluster feature graphs. Edge devices upload cluster feature graphs to reduce communication costs while minimizing information loss. In the central server, we incorporate graph attention networks into the graph neural networks for edge updating in training models on clustered feature graphs. Experiments using the public IIoT data sets and the self-built IIoT platform demonstrate the effectiveness of DHTGL in comparison with common distributed learning approaches. The results confirm that DHTGL consumes fewer communications while achieving higher accuracies.
引用
收藏
页码:28578 / 28590
页数:13
相关论文
共 36 条
[1]   Cloud-IIoT-Based Electronic Health Record Privacy-Preserving by CNN and Blockchain-Enabled Federated Learning [J].
Alzubi, Jafar A. ;
Alzubi, Omar A. ;
Singh, Ashish ;
Ramachandran, Manikandan .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (01) :1080-1087
[2]   Differentially Private Secure Multi-Party Computation for Federated Learning in Financial Applications [J].
Byrd, David ;
Polychroniadou, Antigoni .
FIRST ACM INTERNATIONAL CONFERENCE ON AI IN FINANCE, ICAIF 2020, 2020,
[3]   Federated Learning Over Wireless IoT Networks With Optimized Communication and Resources [J].
Chen, Hao ;
Huang, Shaocheng ;
Zhang, Deyou ;
Xiao, Ming ;
Skoglund, Mikael ;
Poor, H. Vincent .
IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (17) :16592-16605
[4]   Temporal Autoregressive Matrix Factorization for High-Dimensional Time Series Prediction of OSS [J].
Chen, Liang ;
Yang, Yun ;
Wang, Wei .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (10) :13741-13752
[5]  
Chung J., 2024, IEEE Internet Things J., V11, P19188
[6]   FASTEN IIoT: An Open Real-Time Platform for Vertical, Horizontal and End-To-End Integration [J].
Costa, Felipe S. ;
Nassar, Silvia M. ;
Gusmeroli, Sergio ;
Schultz, Ralph ;
Conceicao, Andre G. S. ;
Xavier, Miguel ;
Hessel, Fabiano ;
Dantas, Mario A. R. .
SENSORS, 2020, 20 (19) :1-25
[7]   Edge-IIoTset: A New Comprehensive Realistic Cyber Security Dataset of IoT and IIoT Applications for Centralized and Federated Learning [J].
Ferrag, Mohamed Amine ;
Friha, Othmane ;
Hamouda, Djallel ;
Maglaras, Leandros ;
Janicke, Helge .
IEEE ACCESS, 2022, 10 :40281-40306
[8]  
GPoirot M, 2019, Arxiv, DOI arXiv:1912.12115
[9]   Graph based k-means clustering [J].
Galluccio, Laurent ;
Michel, Olivier ;
Comon, Pierre ;
Hero, Alfred O., III .
SIGNAL PROCESSING, 2012, 92 (09) :1970-1984
[10]  
Goutte C, 2005, LECT NOTES COMPUT SC, V3408, P345