Data imputation in IoT using Spatio-Temporal Variational Auto-Encoder

被引:5
|
作者
Zhang, Shuo [1 ]
Chen, Jinyi [1 ]
Chen, Jiayuan [1 ]
Chen, Xiaofei [1 ]
Huang, Hejiao [1 ,2 ]
机构
[1] Harbin Inst Technol, Shen Zhen, Peoples R China
[2] Guangdong Prov Key Lab Novel Secur Intelligence Te, Shenzhen, Peoples R China
关键词
Data imputation; IoT; VAE; GCN; GRU; MISSING DATA; NETWORK; TIME;
D O I
10.1016/j.neucom.2023.01.022
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In most Internet of Things (IoT) scenes, data missing can be unavoidable when huge number of smart devices are collecting data uninterruptedly. Therefore, data imputation can be an integral part of pre-processing before data mining. It is widely known that IoT time series show strong dependencies in both spatial and temporal dimension, and the spatial relation among the devices is in non-euclidean space. However, most machine-learning-based and deep-learning-based approaches either only take temporal features into account or only catch spatial features in euclidean space. In this paper, we propose a novel network as ST-VAE (Spatio-Temporal Variational Auto-Encoder) to address the problem above. Our archi-tecture is mainly based on Variational Auto-Encoder (VAE). Specifically, two kinds of VAE are utilized. One is for calculating the adjacent matrix of device network which is the essential input of GCN, and the other is for data imputation task based on the spatial and temporal dependencies. Experiments con-ducted on different real-world and public datasets demonstrate that our ST-VAE can not only populate the missing spatio-temporal data accurately but also outperforms other state-of-art approaches from the whole.(c) 2023 Elsevier B.V. All rights reserved.
引用
收藏
页码:23 / 32
页数:10
相关论文
共 50 条
  • [31] Missing Data of Quality Inspection Imputation Algorithm Base on Stacked Denoising Auto-encoder
    Ning, Xiuli
    Xu, Yingcheng
    Gao, Xiaohong
    Li, Ying
    2017 IEEE 2ND INTERNATIONAL CONFERENCE ON BIG DATA ANALYSIS (ICBDA), 2017, : 89 - 93
  • [32] Missing data imputation for traffic flow speed using spatio-temporal cokriging
    Bae, Bumjoon
    Kim, Hyun
    Lim, Hyeonsup
    Liu, Yuandong
    Han, Lee D.
    Freeze, Phillip B.
    TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2018, 88 : 124 - 139
  • [33] A METHOD FOR FACE FUSION BASED ON VARIATIONAL AUTO-ENCODER
    Li, Xiang
    Wen, Jin-Mei
    Chen, An-Long
    Chen, Bo
    2018 15TH INTERNATIONAL COMPUTER CONFERENCE ON WAVELET ACTIVE MEDIA TECHNOLOGY AND INFORMATION PROCESSING (ICCWAMTIP), 2018, : 77 - 80
  • [34] Sequential Imputation of Missing Spatio-Temporal Precipitation Data Using Random Forests
    Mital, Utkarsh
    Dwivedi, Dipankar
    Brown, James B.
    Faybishenko, Boris
    Painter, Scott L.
    Steefel, Carl I.
    FRONTIERS IN WATER, 2020, 2
  • [35] Disentangling Latent Factors of Variational Auto-encoder with Whitening
    Hahn, Sangchul
    Choi, Heeyoul
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2019: IMAGE PROCESSING, PT III, 2019, 11729 : 590 - 603
  • [36] Fair Transfer Learning with Factor Variational Auto-Encoder
    Liu, Shaofan
    Sun, Shiliang
    Zhao, Jing
    NEURAL PROCESSING LETTERS, 2023, 55 (03) : 2049 - 2061
  • [37] Meta conditional variational auto-encoder for domain generalization
    Ge, Zhiqiang
    Song, Zhihuan
    Li, Xin
    Zhang, Lei
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2022, 222
  • [38] Inpainting of Vintage Films Based on Variational Auto-encoder
    Li, Yuhang
    Ding, Youdong
    Yu, Bing
    2020 5TH INTERNATIONAL CONFERENCE ON MECHANICAL, CONTROL AND COMPUTER ENGINEERING (ICMCCE 2020), 2020, : 612 - 616
  • [39] A contrastive variational graph auto-encoder for node clustering
    Mrabah, Nairouz
    Bouguessa, Mohamed
    Ksantini, Riadh
    PATTERN RECOGNITION, 2024, 149
  • [40] Fair Transfer Learning with Factor Variational Auto-Encoder
    Shaofan Liu
    Shiliang Sun
    Jing Zhao
    Neural Processing Letters, 2023, 55 : 2049 - 2061