Learning Generative RNN-ODE for Collaborative Time-Series and Event Sequence Forecasting

被引:6
作者
Li, Longyuan [1 ]
Yan, Junchi [2 ]
Zhang, Yunhao [2 ]
Zhang, Jihai [2 ]
Bao, Jie [3 ]
Jin, Yaohui [1 ]
Yang, Xiaokang [4 ]
机构
[1] Shanghai Jiao Tong Univ, State Key Lab Adv Opt Commun Syst & Network, MoE Key Lab ArtificialIntel ligence, AI Inst, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, MoE Key Lab ArtificialIntelli gence, AI Inst, Shanghai 200240, Peoples R China
[3] Shanghai Weidi Informat Technol Co Ltd, Shanghai 200050, Peoples R China
[4] Shanghai Jiao Tong Univ, Sch Elect Informat & Elect Engn, Shanghai 200240, Peoples R China
关键词
Forecasting; Predictive models; Data models; Probabilistic logic; Mathematical models; Estimation; Time series analysis; Probabilistic forecasting; event prediction; temporal point processes; time-series; variational auto-encoder; ordinary differential equations; conditional variational learning; MODELS; PREDICTION;
D O I
10.1109/TKDE.2022.3185115
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Time-series and event sequences are widely collected data types in real-world applications. Modeling and forecasting of such temporal data play an important role in an informed decision-making process. A major limitation of previous methods is that they either focus on time-series or events, rather than the combination of the two worlds. In fact, the two types of data often provide complementary information, emphasizing the necessity of jointly modeling the both. In this paper, we propose the RNN-ODE collaborative model for joint modeling and forecasting of heterogeneous time-series and event sequence data, which combines several useful techniques from both Bayesian and deep learning for its interpretability. Specifically, we devise a tailored encoder to combine the advances in deep temporal point processes models and variational recurrent neural networks. To predict the probability of event occurrence over an arbitrary continuous-time horizon, we base our model on the mathematical foundation of Neural Ordinary Differential Equations (NODE). Extensive experimental results on simulations and real data sets show that compared with existing methods, our integrated approach can achieve more competitive forecasting performance of both time-series and event sequences.
引用
收藏
页码:7118 / 7137
页数:20
相关论文
共 88 条
[31]   Multimodal Deep Generative Models for Trajectory Prediction: A Conditional Variational Autoencoder Approach [J].
Ivanovic, Boris ;
Leung, Karen ;
Schmerling, Edward ;
Pavone, Marco .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (02) :295-302
[32]  
Jia JT, 2019, ADV NEUR IN, V32
[33]   MIMIC-III, a freely accessible critical care database [J].
Johnson, Alistair E. W. ;
Pollard, Tom J. ;
Shen, Lu ;
Lehman, Li-wei H. ;
Feng, Mengling ;
Ghassemi, Mohammad ;
Moody, Benjamin ;
Szolovits, Peter ;
Celi, Leo Anthony ;
Mark, Roger G. .
SCIENTIFIC DATA, 2016, 3
[34]  
Kalbfleisch J. D., 1980, The Statistical Analysis of Failure Time Data
[35]   DeepSurv: personalized treatment recommender system using a Cox proportional hazards deep neural network [J].
Katzman, Jared L. ;
Shaham, Uri ;
Cloninger, Alexander ;
Bates, Jonathan ;
Jiang, Tingting ;
Kluger, Yuval .
BMC MEDICAL RESEARCH METHODOLOGY, 2018, 18
[36]  
Kuznetsov V, 2019, PR MACH LEARN RES, V89, P408
[37]  
Kvamme H, 2019, J MACH LEARN RES, V20
[38]  
Le Guen V., 2020, P ADV NEUR INF PROC
[39]  
Lee C., 2017, Big Healthcare Data Analytics: Challenges and Applications, P11, DOI 10.1007/978-3-319-58280-1_2
[40]  
Lee C, 2018, AAAI CONF ARTIF INTE, P2314