QTT-DLSTM: A Cloud-Edge-Aided Distributed LSTM for Cyber-Physical-Social Big Data

被引:25
作者
Wang, Xiaokang [1 ]
Ren, Lei [2 ]
Yuan, Ruixue [3 ]
Yang, Laurence T. [1 ]
Deen, M. Jamal [4 ]
机构
[1] St Francis Xavier Univ, Dept Comp Sci, Antigonish, NS B2G 2W5, Canada
[2] Beihang Univ, Sch Automat Sci & Elect Engn, Beijing 100191, Peoples R China
[3] Univ Elect Sci & Technol China, Sch Informat & Commun Engn, Chengdu 611731, Peoples R China
[4] McMaster Univ, Dept Elect & Comp Engn, Hamilton, ON L8S 4K1, Canada
基金
美国国家科学基金会;
关键词
Big Data; Tensors; Distributed databases; Training; Production; Cloud computing; Industrial Internet of Things; Big data; cloud-edge computing; cyber-physical-social system (CPSS); long short-term memory (LSTM); tensor; HEALTH-CARE; MODEL; CONTEXT;
D O I
10.1109/TNNLS.2022.3140238
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Cyber-physical-social systems (CPSS), an emerging cross-disciplinary research area, combines cyber-physical systems (CPS) with social networking for the purpose of providing personalized services for humans. CPSS big data, recording various aspects of human lives, should be processed to mine valuable information for CPSS services. To efficiently deal with CPSS big data, artificial intelligence (AI), an increasingly important technology, is used for CPSS data processing and analysis. Meanwhile, the rapid development of edge devices with fast processors and large memories allows local edge computing to be a powerful real-time complement to global cloud computing. Therefore, to facilitate the processing and analysis of CPSS big data from the perspective of multi-attributes, a cloud-edge-aided quantized tensor-train distributed long short-term memory (QTT-DLSTM) method is presented in this article. First, a tensor is used to represent the multi-attributes CPSS big data, which will be decomposed into the QTT form to facilitate distributed training and computing. Second, a distributed cloud-edge computing model is used to systematically process the CPSS data, including global large-scale data processing in the cloud, and local small-scale data processed at the edge. Third, a distributed computing strategy is used to improve the efficiency of training via partitioning the weight matrix and large amounts of input data in the QTT form. Finally, the performance of the proposed QTT-DLSTM method is evaluated using experiments on a public discrete manufacturing process dataset, the Li-ion battery dataset, and a public social dataset.
引用
收藏
页码:7286 / 7298
页数:13
相关论文
共 30 条
  • [11] TENSOR-TRAIN DECOMPOSITION
    Oseledets, I. V.
    [J]. SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2011, 33 (05) : 2295 - 2317
  • [12] A Data-Driven Auto-CNN-LSTM Prediction Model for Lithium-Ion Battery Remaining Useful Life
    Ren, Lei
    Dong, Jiabao
    Wang, Xiaokang
    Meng, Zihao
    Zhao, Li
    Deen, M. Jamal
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (05) : 3478 - 3487
  • [13] A Data-Driven Approach of Product Quality Prediction for Complex Production Systems
    Ren, Lei
    Meng, Zihao
    Wang, Xiaokang
    Zhang, Lin
    Yang, Laurence T.
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (09) : 6457 - 6465
  • [14] A Wide-Deep-Sequence Model-Based Quality Prediction Method in Industrial Process Analysis
    Ren, Lei
    Meng, Zihao
    Wang, Xiaokang
    Lu, Renquan
    Yang, Laurence T.
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (09) : 3721 - 3731
  • [15] Coding-Based Large-Scale Task Assignment for Industrial Edge Intelligence
    Ren, Lei
    Laili, Yuanjun
    Li, Xiang
    Wang, Xiaokang
    [J]. IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2020, 7 (04): : 2286 - 2297
  • [16] Industrial Internet of Things: Challenges, Opportunities, and Directions
    Sisinni, Emiliano
    Saifullah, Abusayeed
    Han, Song
    Jennehag, Ulf
    Gidlund, Mikael
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2018, 14 (11) : 4724 - 4734
  • [17] Wang X., 2021, IEEE T EMERG TOPICS
  • [18] ADTT: A Highly Efficient Distributed Tensor-Train Decomposition Method for IIoT Big Data
    Wang, Xiaokang
    Yang, Laurence T.
    Wang, Yihao
    Ren, Lei
    Deen, M. Jamal
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (03) : 1573 - 1582
  • [19] Improved Multi-Order Distributed HOSVD with Its Incremental Computing for Smart City Services
    Wang, Xiaokang
    Yang, Laurence T.
    Chen, Xingyu
    Deen, M. Jamal
    Jin, Jirong
    [J]. IEEE TRANSACTIONS ON SUSTAINABLE COMPUTING, 2021, 6 (03): : 456 - 468
  • [20] A Cloud-Edge Computing Framework for Cyber-Physical-Social Services
    Wang, Xiaokang
    Yang, Laurence T.
    Xie, Xia
    Jin, Jirong
    Deen, M. Jamal
    [J]. IEEE COMMUNICATIONS MAGAZINE, 2017, 55 (11) : 80 - 85