Hybrid variational autoencoder for time series forecasting

被引:5
作者
Cai, Borui [1 ]
Yang, Shuiqiao [2 ]
Gao, Longxiang [3 ]
Xiang, Yong [1 ]
机构
[1] Deakin Univ, Sch Informat Technol, Burwood, Vic 3125, Australia
[2] Univ New South Wales, Sch Comp Sci & Engn, Sydney, NSW 2032, Australia
[3] Qilu Univ Technol, Shandong Acad Sci, Jinan, Peoples R China
基金
澳大利亚研究理事会;
关键词
Time series forecasting; Variational autoencoder; Deep learning;
D O I
10.1016/j.knosys.2023.111079
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Variational autoencoders (VAE) are powerful generative models that learn the latent representations of input data as random variables. Recent studies show that VAE can flexibly learn the complex temporal dynamics of time series and achieve more promising forecasting results than deterministic models. However, a major limitation of existing works is that they fail to jointly learn the local patterns (e.g., seasonality and trend) and temporal dynamics of time series for forecasting. Accordingly, we propose a novel hybrid variational autoencoder (HyVAE) to integrate the learning of local patterns and temporal dynamics by variational inference for time series forecasting. Experimental results on four real-world datasets show that the proposed HyVAE achieves better forecasting results than various counterpart methods, as well as two HyVAE variants that only learn the local patterns or temporal dynamics of time series, respectively.
引用
收藏
页数:9
相关论文
共 38 条
  • [1] How to Handle Data Imbalance and Feature Selection Problems in CNN-Based Stock Price Forecasting
    Aksehir, Zinnet Duygu
    Kilic, Erdal
    [J]. IEEE ACCESS, 2022, 10 : 31297 - 31305
  • [2] A Hybrid Prediction Method for Realistic Network Traffic With Temporal Convolutional Network and LSTM
    Bi, Jing
    Zhang, Xiang
    Yuan, Haitao
    Zhang, Jia
    Zhou, MengChu
    [J]. IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2022, 19 (03) : 1869 - 1879
  • [3] Challu C, 2023, P 37 AAAI C ART INT, V37, P6989
  • [4] Learning to Rotate: Quaternion Transformer for Complicated Periodical Time Series Forecasting
    Chen, Weiqi
    Wang, Wenwei
    Peng, Bingqing
    Wen, Qingsong
    Zhou, Tian
    Sun, Liang
    [J]. PROCEEDINGS OF THE 28TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2022, 2022, : 146 - 156
  • [5] Chen WC, 2022, PR MACH LEARN RES
  • [6] Chen YZ, 2021, PR MACH LEARN RES, V139
  • [7] Cho K., 2014, P 2014 C EMP METH NA, DOI 10.3115/v1/d14-1179
  • [8] A Hybrid System Based on Dynamic Selection for Time Series Forecasting
    de Oliveira, Joao F. L.
    Silva, Eraylson G.
    de Mattos Neto, Paulo S. G.
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (08) : 3251 - 3263
  • [9] Deep Air Quality Forecasting Using Hybrid Deep Learning Framework
    Du, Shengdong
    Li, Tianrui
    Yang, Yan
    Horng, Shi-Jinn
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2021, 33 (06) : 2412 - 2424
  • [10] Toeplitz Inverse Covariance-Based Clustering of Multivariate Time Series Data
    Hallac, David
    Vare, Sagar
    Boyd, Stephen
    Leskovec, Jure
    [J]. KDD'17: PROCEEDINGS OF THE 23RD ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2017, : 215 - 223