Learning Generative RNN-ODE for Collaborative Time-Series and Event Sequence Forecasting

被引:6
作者
Li, Longyuan [1 ]
Yan, Junchi [2 ]
Zhang, Yunhao [2 ]
Zhang, Jihai [2 ]
Bao, Jie [3 ]
Jin, Yaohui [1 ]
Yang, Xiaokang [4 ]
机构
[1] Shanghai Jiao Tong Univ, State Key Lab Adv Opt Commun Syst & Network, MoE Key Lab ArtificialIntel ligence, AI Inst, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, MoE Key Lab ArtificialIntelli gence, AI Inst, Shanghai 200240, Peoples R China
[3] Shanghai Weidi Informat Technol Co Ltd, Shanghai 200050, Peoples R China
[4] Shanghai Jiao Tong Univ, Sch Elect Informat & Elect Engn, Shanghai 200240, Peoples R China
关键词
Forecasting; Predictive models; Data models; Probabilistic logic; Mathematical models; Estimation; Time series analysis; Probabilistic forecasting; event prediction; temporal point processes; time-series; variational auto-encoder; ordinary differential equations; conditional variational learning; MODELS; PREDICTION;
D O I
10.1109/TKDE.2022.3185115
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Time-series and event sequences are widely collected data types in real-world applications. Modeling and forecasting of such temporal data play an important role in an informed decision-making process. A major limitation of previous methods is that they either focus on time-series or events, rather than the combination of the two worlds. In fact, the two types of data often provide complementary information, emphasizing the necessity of jointly modeling the both. In this paper, we propose the RNN-ODE collaborative model for joint modeling and forecasting of heterogeneous time-series and event sequence data, which combines several useful techniques from both Bayesian and deep learning for its interpretability. Specifically, we devise a tailored encoder to combine the advances in deep temporal point processes models and variational recurrent neural networks. To predict the probability of event occurrence over an arbitrary continuous-time horizon, we base our model on the mathematical foundation of Neural Ordinary Differential Equations (NODE). Extensive experimental results on simulations and real data sets show that compared with existing methods, our integrated approach can achieve more competitive forecasting performance of both time-series and event sequences.
引用
收藏
页码:7118 / 7137
页数:20
相关论文
共 88 条
[1]  
Aalen OO, 2008, STAT BIOL HEALTH, P1
[2]   A Stochastic Conditioning Scheme for Diverse Human Motion Prediction [J].
Aliakbarian, Sadegh ;
Saleh, Fatemeh Sadat ;
Salzmann, Mathieu ;
Petersson, Lars ;
Gould, Stephen .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :5222-5231
[3]  
[Anonymous], 2016, Ijcai, DOI [DOI 10.1145/3123266.3123277, DOI 10.1109/SCEECS57921.2023.10061818]
[4]  
[Anonymous], 2016, Multi-task sequence to sequence learning
[5]   Hawkes Processes in Finance [J].
Bacry, Emmanuel ;
Mastromatteo, Iacopo ;
Muzy, Jean-Francois .
MARKET MICROSTRUCTURE AND LIQUIDITY, 2015, 1 (01)
[6]   Patient Subtyping via Time-Aware LSTM Networks [J].
Baytas, Inci M. ;
Xiao, Cao ;
Zhang, Xi ;
Wang, Fei ;
Jain, Anil K. ;
Zhou, Jiayu .
KDD'17: PROCEEDINGS OF THE 23RD ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2017, :65-74
[7]   Deep-learning cardiac motion analysis for human survival prediction [J].
Bello, Ghalib A. ;
Dawes, Timothy J. W. ;
Duan, Jinming ;
Biffi, Carlo ;
de Marvao, Antonio ;
Howard, Luke S. G. E. ;
Gibbs, J. Simon R. ;
Wilkins, Martin R. ;
Cook, Stuart A. ;
Rueckert, Daniel ;
O'Regan, Declan P. .
NATURE MACHINE INTELLIGENCE, 2019, 1 (02) :95-+
[8]   A Bias and Variance Analysis for Multistep-Ahead Time Series Forecasting [J].
Ben Taieb, Souhaib ;
Atiya, Amir F. .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2016, 27 (01) :62-76
[9]   Accurate and Diverse Sampling of Sequences based on a "Best of Many" Sample Objective [J].
Bhattacharyya, Apratim ;
Schiele, Bernt ;
Fritz, Mario .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :8485-8493
[10]  
Binkowski M, 2018, Arxiv, DOI arXiv:1703.04122