Multistage Graph Convolutional Network With Spatial Attention for Multivariate Time Series Imputation

被引:0
|
作者
Chen, Qianyi [1 ,2 ]
Cao, Jiannong [1 ]
Yang, Yu [3 ]
Lin, Wanyu [1 ]
Wang, Sumei [4 ]
Wang, Youwu [4 ]
机构
[1] Hong Kong Polytech Univ, Dept Comp, Hong Kong, Peoples R China
[2] Westlake Univ, Sch Engn, Hangzhou, Peoples R China
[3] Educ Univ Hong Kong, Ctr Learning Teaching & Technol, Hong Kong, Peoples R China
[4] Hong Kong Polytech Univ, Dept Civil & Environm Engn, Hong Kong, Peoples R China
关键词
Monitoring; Correlation; Imputation; Time series analysis; Mathematical models; Data models; Bridges; Feature extraction; Accuracy; Temperature sensors; Data imputation; graph convolutional network (GCN); structural health monitoring (SHM); SENSOR DATA;
D O I
10.1109/TNNLS.2024.3486349
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In multivariate time series (MTS) analysis, data loss is a critical issue that degrades analytical model performance and impairs downstream tasks such as structural health monitoring (SHM) and traffic flow monitoring. In real-world applications, MTS is usually collected by multiple types of sensors, making MTS and correlations between variates heterogeneous. However, existing MTS imputation methods overlook the heterogeneous correlations by manipulating heterogeneous MTS as a homogeneous entity, leading to inaccurate imputation results. Besides, correlations between different data types vary due to ever-changing environmental conditions, forming dynamic correlations in MTS. How to properly learn the hidden correlation from heterogeneous MTS for accurate data imputation remains unresolved. To solve the problem, we propose a multistage graph convolutional network with spatial attention (MSA-GCN). In the first stage, we decompose heterogeneous MTS into several clusters with homogeneous data collected from identical sensor types and learn intracluster correlations. Then, we devise a GCN with spatial attention to explore dynamic intercluster correlations, which is the second stage of MSA-GCN. In the last stage, we decode the learned features from previous stages via stacked convolutional neural networks. We jointly train these three-stage models to predict the missing data in MTS. Leveraging this multistage architecture and spatial attention mechanism makes MSA-GCN effectively learn heterogeneous and dynamic correlations among MTS, resulting in superior imputation performance. We tested MSA-GCN with the monitoring data from a large-span bridge and Wetterstation weather dataset. The results affirm its superiority over baseline models, demonstrating its enhanced accuracy in reducing imputation errors across diverse datasets.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] CGCNImp: a causal graph convolutional network for multivariate time series imputation
    Liu, Caizheng
    Cui, Guangfan
    Liu, Shenghua
    PEERJ COMPUTER SCIENCE, 2022, 8
  • [2] Multistage attention network for multivariate time series prediction
    Hu, Jun
    Zheng, Wendong
    NEUROCOMPUTING, 2020, 383 : 122 - 137
  • [3] Spatial-Temporal Traffic Data Imputation via Graph Attention Convolutional Network
    Ye, Yongchao
    Zhang, Shiyao
    Yu, James J. Q.
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2021, PT I, 2021, 12891 : 241 - 252
  • [4] A Multivariate Temporal Convolutional Attention Network for Time-Series Forecasting
    Wan, Renzhuo
    Tian, Chengde
    Zhang, Wei
    Deng, Wendi
    Yang, Fan
    ELECTRONICS, 2022, 11 (10)
  • [5] Multivariate Time Series Classification With An Attention-Based Multivariate Convolutional Neural Network
    Tripathi, Achyut Mani
    Baruah, Rashmi Dutta
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [6] STAIN: Spatial-Temporal Adversarial Network for Multivariate Time Series Imputation
    Liu, Guangyu
    Shen, Pengfei
    Ma, Zhanguo
    Han, Min
    Lu, Nannan
    2024 IEEE 19TH CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS, ICIEA 2024, 2024,
  • [7] A Graph Recurrent Attention Network for Multivariate Time Series Anomaly Detection
    Cui, Tao
    Liu, Yao
    Zhu, Yueming
    2024 4TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND INTELLIGENT SYSTEMS ENGINEERING, MLISE 2024, 2024, : 57 - 62
  • [8] Graph Attention Network and Informer for Multivariate Time Series Anomaly Detection
    Zhao, Mengmeng
    Peng, Haipeng
    Li, Lixiang
    Ren, Yeqing
    SENSORS, 2024, 24 (05)
  • [9] Multivariate time series classification based on spatial-temporal attention dynamic graph neural network
    Qian, Lipeng
    Zuo, Qiong
    Liu, Haiguang
    Zhu, Hong
    APPLIED INTELLIGENCE, 2025, 55 (02)
  • [10] Dynamic graph-based bilateral recurrent imputation network for multivariate time series
    Lai, Xiaochen
    Zhang, Zheng
    Zhang, Liyong
    Lu, Wei
    Li, Zhuohan
    NEURAL NETWORKS, 2025, 186