QTT-DLSTM: A Cloud-Edge-Aided Distributed LSTM for Cyber-Physical-Social Big Data

被引:25
作者
Wang, Xiaokang [1 ]
Ren, Lei [2 ]
Yuan, Ruixue [3 ]
Yang, Laurence T. [1 ]
Deen, M. Jamal [4 ]
机构
[1] St Francis Xavier Univ, Dept Comp Sci, Antigonish, NS B2G 2W5, Canada
[2] Beihang Univ, Sch Automat Sci & Elect Engn, Beijing 100191, Peoples R China
[3] Univ Elect Sci & Technol China, Sch Informat & Commun Engn, Chengdu 611731, Peoples R China
[4] McMaster Univ, Dept Elect & Comp Engn, Hamilton, ON L8S 4K1, Canada
基金
美国国家科学基金会;
关键词
Big Data; Tensors; Distributed databases; Training; Production; Cloud computing; Industrial Internet of Things; Big data; cloud-edge computing; cyber-physical-social system (CPSS); long short-term memory (LSTM); tensor; HEALTH-CARE; MODEL; CONTEXT;
D O I
10.1109/TNNLS.2022.3140238
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Cyber-physical-social systems (CPSS), an emerging cross-disciplinary research area, combines cyber-physical systems (CPS) with social networking for the purpose of providing personalized services for humans. CPSS big data, recording various aspects of human lives, should be processed to mine valuable information for CPSS services. To efficiently deal with CPSS big data, artificial intelligence (AI), an increasingly important technology, is used for CPSS data processing and analysis. Meanwhile, the rapid development of edge devices with fast processors and large memories allows local edge computing to be a powerful real-time complement to global cloud computing. Therefore, to facilitate the processing and analysis of CPSS big data from the perspective of multi-attributes, a cloud-edge-aided quantized tensor-train distributed long short-term memory (QTT-DLSTM) method is presented in this article. First, a tensor is used to represent the multi-attributes CPSS big data, which will be decomposed into the QTT form to facilitate distributed training and computing. Second, a distributed cloud-edge computing model is used to systematically process the CPSS data, including global large-scale data processing in the cloud, and local small-scale data processed at the edge. Third, a distributed computing strategy is used to improve the efficiency of training via partitioning the weight matrix and large amounts of input data in the QTT form. Finally, the performance of the proposed QTT-DLSTM method is evaluated using experiments on a public discrete manufacturing process dataset, the Li-ion battery dataset, and a public social dataset.
引用
收藏
页码:7286 / 7298
页数:13
相关论文
共 30 条
  • [1] Context-Sensitive Access in Industrial Internet of Things (IIoT) Healthcare Applications
    Al-Turjman, Fadi
    Alturjman, Sinem
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2018, 14 (06) : 2736 - 2744
  • [2] Information and communications technologies for elderly ubiquitous healthcare in a smart home
    Deen, M. Jamal
    [J]. PERSONAL AND UBIQUITOUS COMPUTING, 2015, 19 (3-4) : 573 - 599
  • [3] Finite-Time Consensus Tracking Neural Network FTC of Multi-Agent Systems
    Dong, Guowei
    Li, Hongyi
    Ma, Hui
    Lu, Renquan
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (02) : 653 - 662
  • [4] Hochreiter S, 1997, NEURAL COMPUT, V9, P1735, DOI [10.1162/neco.1997.9.1.1, 10.1007/978-3-642-24797-2]
  • [5] On manifolds of tensors of fixed TT-rank
    Holtz, Sebastian
    Rohwedder, Thorsten
    Schneider, Reinhold
    [J]. NUMERISCHE MATHEMATIK, 2012, 120 (04) : 701 - 731
  • [6] Kingma DP, 2014, ADV NEUR IN, V27
  • [7] Tensor Decompositions and Applications
    Kolda, Tamara G.
    Bader, Brett W.
    [J]. SIAM REVIEW, 2009, 51 (03) : 455 - 500
  • [8] LSTM and Edge Computing for Big Data Feature Recognition of Industrial Electrical Equipment
    Lai, Chin-Feng
    Chien, Wei-Che
    Yang, Laurence T.
    Qiang, Weizhong
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2019, 15 (04) : 2469 - 2477
  • [9] Natural Language Statistical Features of LSTM-Generated Texts
    Lippi, Marco
    Montemurro, Marcelo A.
    Degli Esposti, Mirko
    Cristadoro, Giampaolo
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (11) : 3326 - 3337
  • [10] Wearable Sensors for Remote Health Monitoring
    Majumder, Sumit
    Mondal, Tapas
    Deen, M. Jamal
    [J]. SENSORS, 2017, 17 (01)