Learning Generative RNN-ODE for Collaborative Time-Series and Event Sequence Forecasting

被引:6
作者
Li, Longyuan [1 ]
Yan, Junchi [2 ]
Zhang, Yunhao [2 ]
Zhang, Jihai [2 ]
Bao, Jie [3 ]
Jin, Yaohui [1 ]
Yang, Xiaokang [4 ]
机构
[1] Shanghai Jiao Tong Univ, State Key Lab Adv Opt Commun Syst & Network, MoE Key Lab ArtificialIntel ligence, AI Inst, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, MoE Key Lab ArtificialIntelli gence, AI Inst, Shanghai 200240, Peoples R China
[3] Shanghai Weidi Informat Technol Co Ltd, Shanghai 200050, Peoples R China
[4] Shanghai Jiao Tong Univ, Sch Elect Informat & Elect Engn, Shanghai 200240, Peoples R China
关键词
Forecasting; Predictive models; Data models; Probabilistic logic; Mathematical models; Estimation; Time series analysis; Probabilistic forecasting; event prediction; temporal point processes; time-series; variational auto-encoder; ordinary differential equations; conditional variational learning; MODELS; PREDICTION;
D O I
10.1109/TKDE.2022.3185115
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Time-series and event sequences are widely collected data types in real-world applications. Modeling and forecasting of such temporal data play an important role in an informed decision-making process. A major limitation of previous methods is that they either focus on time-series or events, rather than the combination of the two worlds. In fact, the two types of data often provide complementary information, emphasizing the necessity of jointly modeling the both. In this paper, we propose the RNN-ODE collaborative model for joint modeling and forecasting of heterogeneous time-series and event sequence data, which combines several useful techniques from both Bayesian and deep learning for its interpretability. Specifically, we devise a tailored encoder to combine the advances in deep temporal point processes models and variational recurrent neural networks. To predict the probability of event occurrence over an arbitrary continuous-time horizon, we base our model on the mathematical foundation of Neural Ordinary Differential Equations (NODE). Extensive experimental results on simulations and real data sets show that compared with existing methods, our integrated approach can achieve more competitive forecasting performance of both time-series and event sequences.
引用
收藏
页码:7118 / 7137
页数:20
相关论文
共 88 条
[81]  
Xiao S, 2017, ADV NEUR IN, V30
[82]  
Xiao S, 2017, AAAI CONF ARTIF INTE, P1597
[83]   Learning Time Series Associated Event Sequences With Recurrent Point Process Networks [J].
Xiao, Shuai ;
Yan, Junchi ;
Farajtabar, Mehrdad ;
Song, Le ;
Yang, Xiaokang ;
Zha, Hongyuan .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (10) :3124-3136
[84]  
Yuan Y., 2019, Adv. Neural Inf. Process. Syst, P1, DOI 10.1109/ASMC.2019.8791815
[85]   Seasonal Autoregressive Integrated Moving Average and Support Vector Machine Models Prediction of Short-Term Traffic Flow on Freeways [J].
Zhang, Ning ;
Zhang, Yunlong ;
Lu, Haiting .
TRANSPORTATION RESEARCH RECORD, 2011, (2215) :85-92
[86]   SEISMIC: A Self-Exciting Point Process Model for Predicting Tweet Popularity [J].
Zhao, Qingyuan ;
Erdogdu, Murat A. ;
He, Hera Y. ;
Rajaraman, Anand ;
Leskovec, Jure .
KDD'15: PROCEEDINGS OF THE 21ST ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2015, :1513-1522
[87]  
Zhou Ke, 2013, Artificial Intelligence and Statistics, P641
[88]  
Zuo S., 2020, P INT C MACH LEARN, p11 692