QTT-DLSTM: A Cloud-Edge-Aided Distributed LSTM for Cyber-Physical-Social Big Data

被引:25
作者
Wang, Xiaokang [1 ]
Ren, Lei [2 ]
Yuan, Ruixue [3 ]
Yang, Laurence T. [1 ]
Deen, M. Jamal [4 ]
机构
[1] St Francis Xavier Univ, Dept Comp Sci, Antigonish, NS B2G 2W5, Canada
[2] Beihang Univ, Sch Automat Sci & Elect Engn, Beijing 100191, Peoples R China
[3] Univ Elect Sci & Technol China, Sch Informat & Commun Engn, Chengdu 611731, Peoples R China
[4] McMaster Univ, Dept Elect & Comp Engn, Hamilton, ON L8S 4K1, Canada
基金
美国国家科学基金会;
关键词
Big Data; Tensors; Distributed databases; Training; Production; Cloud computing; Industrial Internet of Things; Big data; cloud-edge computing; cyber-physical-social system (CPSS); long short-term memory (LSTM); tensor; HEALTH-CARE; MODEL; CONTEXT;
D O I
10.1109/TNNLS.2022.3140238
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Cyber-physical-social systems (CPSS), an emerging cross-disciplinary research area, combines cyber-physical systems (CPS) with social networking for the purpose of providing personalized services for humans. CPSS big data, recording various aspects of human lives, should be processed to mine valuable information for CPSS services. To efficiently deal with CPSS big data, artificial intelligence (AI), an increasingly important technology, is used for CPSS data processing and analysis. Meanwhile, the rapid development of edge devices with fast processors and large memories allows local edge computing to be a powerful real-time complement to global cloud computing. Therefore, to facilitate the processing and analysis of CPSS big data from the perspective of multi-attributes, a cloud-edge-aided quantized tensor-train distributed long short-term memory (QTT-DLSTM) method is presented in this article. First, a tensor is used to represent the multi-attributes CPSS big data, which will be decomposed into the QTT form to facilitate distributed training and computing. Second, a distributed cloud-edge computing model is used to systematically process the CPSS data, including global large-scale data processing in the cloud, and local small-scale data processed at the edge. Third, a distributed computing strategy is used to improve the efficiency of training via partitioning the weight matrix and large amounts of input data in the QTT form. Finally, the performance of the proposed QTT-DLSTM method is evaluated using experiments on a public discrete manufacturing process dataset, the Li-ion battery dataset, and a public social dataset.
引用
收藏
页码:7286 / 7298
页数:13
相关论文
共 30 条
  • [21] Mean Squared Error: Love It or Leave It? A new look at signal fidelity measures
    Wang, Zhou
    Bovik, Alan C.
    [J]. IEEE SIGNAL PROCESSING MAGAZINE, 2009, 26 (01) : 98 - 117
  • [22] BACKPROPAGATION THROUGH TIME - WHAT IT DOES AND HOW TO DO IT
    WERBOS, PJ
    [J]. PROCEEDINGS OF THE IEEE, 1990, 78 (10) : 1550 - 1560
  • [23] Automatic Virtual Network Embedding: A Deep Reinforcement Learning Approach With Graph Convolutional Networks
    Yan, Zhongxia
    Ge, Jingguo
    Wu, Yulei
    Li, Liangxiong
    Li, Tong
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2020, 38 (06) : 1040 - 1057
  • [24] Yang YC, 2017, PR MACH LEARN RES, V70
  • [25] Learning Compact Recurrent Neural Networks with Block-Term Tensor Decomposition
    Ye, Jinmian
    Wang, Linnan
    Li, Guangxi
    Chen, Di
    Zhe, Shandian
    Chu, Xinqi
    Xu, Zenglin
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 9378 - 9387
  • [26] Yuan XF, 2020, IEEE T IND INFORM, V16, P3168, DOI [10.1109/TII.2019.2902129, 10.1002/er.4607]
  • [27] A Tensor-Train Deep Computation Model for Industry Informatics Big Data Feature Learning
    Zhang, Qingchen
    Yang, Laurence T.
    Chen, Zhikui
    Li, Peng
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2018, 14 (07) : 3197 - 3204
  • [28] Follow But No Track: Privacy Preserved Profile Publishing in Cyber-Physical Social Systems
    Zheng, Xu
    Cai, Zhipeng
    Yu, Jiguo
    Wang, Chaokun
    Li, Yingshu
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2017, 4 (06): : 1868 - 1878
  • [29] Human-Cyber-Physical Systems (HCPSs) in the Context of New-Generation Intelligent Manufacturing
    Zhou Ji
    Zhou Yanhong
    Wang Baicun
    Zang Jiyuan
    [J]. ENGINEERING, 2019, 5 (04) : 624 - 636
  • [30] An Intelligent Anomaly Detection Scheme for Micro-Services Architectures With Temporal and Spatial Data Analysis
    Zuo, Yuan
    Wu, Yulei
    Min, Geyong
    Huang, Chengqiang
    Pei, Ke
    [J]. IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2020, 6 (02) : 548 - 561