Multivariate Time Series Forecasting With Dynamic Graph Neural ODEs

被引:70
作者
Jin, Ming [1 ]
Zheng, Yu [2 ]
Li, Yuan-Fang [1 ]
Chen, Siheng [3 ]
Yang, Bin [4 ]
Pan, Shirui [5 ]
机构
[1] Monash Univ, Fac IT, Dept Data Sci & AI, Clayton, Vic 3800, Australia
[2] La Trobe Univ, Dept Comp Sci & Informat Technol, Melbourne, Vic 3086, Australia
[3] Shanghai Jiao Tong Univ, Shanghai, Peoples R China
[4] East China Normal Univ, Sch Data Sci & Engn, Shanghai 200050, Peoples R China
[5] Griffith Univ, Sch Informat & Commun Technol, Southport, Qld 4222, Australia
关键词
Multivariate time series forecasting; graph neural networks; neural ordinary differential equations; ATTENTION; NETWORK;
D O I
10.1109/TKDE.2022.3221989
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multivariate time series forecasting has long received significant attention in real-world applications, such as energy consumption and traffic prediction. While recent methods demonstrate good forecasting abilities, they have three fundamental limitations. (i). Discrete neural architectures: Interlacing individually parameterized spatial and temporal blocks to encode rich underlying patterns leads to discontinuous latent state trajectories and higher forecasting numerical errors. (ii). High complexity: Discrete approaches complicate models with dedicated designs and redundant parameters, leading to higher computational and memory overheads. (iii). Reliance on graph priors: Relying on predefined static graph structures limits their effectiveness and practicability in real-world applications. In this paper, we address all the above limitations by proposing a continuous model to forecast Multivariate Time series with dynamic Graph neural Ordinary Differential Equations (MTGODE). Specifically, we first abstract multivariate time series into dynamic graphs with time-evolving node features and unknown graph structures. Then, we design and solve a neural ODE to complement missing graph topologies and unify both spatial and temporal message passing, allowing deeper graph propagation and fine-grained temporal information aggregation to characterize stable and precise latent spatial-temporal dynamics. Our experiments demonstrate the superiorities of MTGODE from various perspectives on five time series benchmark datasets.
引用
收藏
页码:9168 / 9180
页数:13
相关论文
共 50 条
[41]   Dependency Learning Graph Neural Network for Multivariate Forecasting [J].
Patel, Arth ;
Sriramulu, Abishek ;
Bergmeir, Christoph ;
Fourrier, Nicolas .
NEURAL INFORMATION PROCESSING, ICONIP 2021, PT V, 2021, 1516 :114-123
[42]   Multivariate Realized Volatility Forecasting with Graph Neural Network [J].
Chen, Qinkai ;
Robert, Christian-Yann .
3RD ACM INTERNATIONAL CONFERENCE ON AI IN FINANCE, ICAIF 2022, 2022, :156-164
[43]   Graph neural networks for multivariate time series regression with application to seismic data [J].
Bloemheuvel, Stefan ;
van den Hoogen, Jurgen ;
Jozinovic, Dario ;
Michelini, Alberto ;
Atzmueller, Martin .
INTERNATIONAL JOURNAL OF DATA SCIENCE AND ANALYTICS, 2023, 16 (03) :317-332
[44]   Series clustering and dynamic periodic patching-based transformer for multivariate time series forecasting [J].
Wang, Yijie ;
Wu, Xiao ;
Zhang, Jiaying ;
Wang, Weiping ;
Zheng, Linjiang ;
Shang, Jiaxing .
APPLIED SOFT COMPUTING, 2025, 174
[45]   Graph neural networks for multivariate time series regression with application to seismic data [J].
Stefan Bloemheuvel ;
Jurgen van den Hoogen ;
Dario Jozinović ;
Alberto Michelini ;
Martin Atzmueller .
International Journal of Data Science and Analytics, 2023, 16 :317-332
[46]   StackDA: A Stacked Dual Attention Neural Network for Multivariate Time-Series Forecasting [J].
Hong, Jungsoo ;
Park, Jinuk ;
Park, Sanghyun .
IEEE ACCESS, 2021, 9 :145955-145967
[47]   LAVARNET: Neural network modeling of causal variable relationships for multivariate time series forecasting [J].
Koutlis, Christos ;
Papadopoulos, Symeon ;
Schinas, Manos ;
Kompatsiaris, Ioannis .
APPLIED SOFT COMPUTING, 2020, 96
[48]   Contrastive learning enhanced by graph neural networks for Universal Multivariate Time Series Representation [J].
Wang, Xinghao ;
Xing, Qiang ;
Xiao, Huimin ;
Ye, Ming .
INFORMATION SYSTEMS, 2024, 125
[49]   Graph Deep Learning for Time Series Forecasting [J].
Cini, Andrea ;
Marisca, Ivan ;
Zambon, Daniele ;
Alippi, Cesare .
ACM COMPUTING SURVEYS, 2025, 57 (12)
[50]   Towards Expressive Spectral-Temporal Graph Neural Networks for Time Series Forecasting [J].
Jin, Ming ;
Shi, Guangsi ;
Li, Yuan-Fang ;
Xiong, Bo ;
Zhou, Tian ;
Salim, Flora D. ;
Zhao, Liang ;
Wu, Lingfei ;
Wen, Qingsong ;
Pan, Shirui .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2025, 47 (06) :4926-4939