Data imputation in IoT using Spatio-Temporal Variational Auto-Encoder

被引:5
|
作者
Zhang, Shuo [1 ]
Chen, Jinyi [1 ]
Chen, Jiayuan [1 ]
Chen, Xiaofei [1 ]
Huang, Hejiao [1 ,2 ]
机构
[1] Harbin Inst Technol, Shen Zhen, Peoples R China
[2] Guangdong Prov Key Lab Novel Secur Intelligence Te, Shenzhen, Peoples R China
关键词
Data imputation; IoT; VAE; GCN; GRU; MISSING DATA; NETWORK; TIME;
D O I
10.1016/j.neucom.2023.01.022
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In most Internet of Things (IoT) scenes, data missing can be unavoidable when huge number of smart devices are collecting data uninterruptedly. Therefore, data imputation can be an integral part of pre-processing before data mining. It is widely known that IoT time series show strong dependencies in both spatial and temporal dimension, and the spatial relation among the devices is in non-euclidean space. However, most machine-learning-based and deep-learning-based approaches either only take temporal features into account or only catch spatial features in euclidean space. In this paper, we propose a novel network as ST-VAE (Spatio-Temporal Variational Auto-Encoder) to address the problem above. Our archi-tecture is mainly based on Variational Auto-Encoder (VAE). Specifically, two kinds of VAE are utilized. One is for calculating the adjacent matrix of device network which is the essential input of GCN, and the other is for data imputation task based on the spatial and temporal dependencies. Experiments con-ducted on different real-world and public datasets demonstrate that our ST-VAE can not only populate the missing spatio-temporal data accurately but also outperforms other state-of-art approaches from the whole.(c) 2023 Elsevier B.V. All rights reserved.
引用
收藏
页码:23 / 32
页数:10
相关论文
共 50 条
  • [1] Spatio-Temporal Convolutional Sparse Auto-Encoder for Sequence Classification
    Baccouche, Moez
    Mamalet, Franck
    Wolf, Christian
    Garcia, Christophe
    Baskurt, Atilla
    PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
  • [2] Missing Data Imputation for Solar Yield Prediction using Temporal Multi-Modal Variational Auto-Encoder
    Shen, Meng
    Zhang, Huaizheng
    Cao, Yixin
    Yang, Fan
    Wen, Yonggang
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 2558 - 2566
  • [3] MIVAE: Multiple Imputation based on Variational Auto-Encoder
    Ma, Qian
    Li, Xia
    Bai, Mei
    Wang, Xite
    Ning, Bo
    Li, Guanyu
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 123
  • [4] Damage quantification of composite laminate via variational auto-encoder Lamb wave data expansion and spatio-temporal fusion transfer model
    Shao, Weihan
    Qing, Xinlin
    STRUCTURAL HEALTH MONITORING-AN INTERNATIONAL JOURNAL, 2024,
  • [5] Lightweight Deep Learning for Missing Data Imputation in Wastewater Treatment With Variational Residual Auto-Encoder
    Zhang, Wen
    Li, Rui
    Quan, Pei
    Chang, Jiang
    Bai, Yongsheng
    Su, Bojun
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (23): : 38312 - 38326
  • [6] Hamiltonian Variational Auto-Encoder
    Caterini, Anthony L.
    Doucet, Arnaud
    Sejdinovic, Dino
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31
  • [7] COMPOUND VARIATIONAL AUTO-ENCODER
    Su, Shang-Yu
    Lin, Shan-Wei
    Chen, Yun-Nung
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 3577 - 3581
  • [8] Twin Variational Auto-Encoder for Representation Learning in IoT Intrusion Detection
    Phai Vu Dinh
    Nguyen Quang Uy
    Nguyen, Diep N.
    Dinh Thai Hoang
    Son Pham Bao
    Dutkiewicz, Eryk
    2022 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2022, : 848 - 853
  • [9] Constrained Twin Variational Auto-Encoder for Intrusion Detection in IoT Systems
    Dinh, Phai Vu
    Nguyen, Quang Uy
    Hoang, Dinh Thai
    Nguyen, Diep N.
    Bao, Son Pham
    Dutkiewicz, Eryk
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (08): : 14789 - 14803
  • [10] A transferred spatio-temporal deep model based on multi-LSTM auto-encoder for air pollution time series missing value imputation
    Zhang, Xiaoxia
    Zhou, Pengcheng
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2024, 156 : 325 - 338