Skip-RCNN: A Cost-Effective Multivariate Time Series Forecasting Model

被引:1
作者
Song, Haitao [1 ,2 ]
Zhang, Han [1 ,2 ]
Wang, Tianyi [2 ]
Li, Jiajia [3 ,4 ]
Wang, Zikai [1 ,2 ]
Ji, Hongyu [1 ,2 ]
Chen, Yijun [2 ]
机构
[1] Shanghai Jiao Tong Univ, Artificial Intelligence Res Inst, Shanghai 200240, Peoples R China
[2] Shanghai Artificial Intelligence Res Inst, Shanghai 200240, Peoples R China
[3] Shanghai Jiao Tong Univ, Sch Chem & Chem Engn, Shanghai 200240, Peoples R China
[4] Shanghai Jiao Tong Univ, Natl Ctr Translat Med, Shanghai 200240, Peoples R China
关键词
Deep learning; multivariate time series forecasting; feature fusion; ANOMALY DETECTION; LSTM; NETWORK;
D O I
10.1109/ACCESS.2023.3340698
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multivariate time series (MTS) forecasting is a crucial aspect in many classification and regression tasks. In recent years, deep learning models have become the mainstream framework for MTS forecasting. Among these deep learning methods, the transformer model has been proved particularly effective due to its ability to capture long- and short-term dependencies. However, the computational complexity of transformer-based models sets the obstacles for resource-constrained scenarios. To address this challenge, we propose a novel and efficient Skip-RCNN network that incorporates Skip-RNN and Skip-CNN modules to split the MTS into multiple frames with various time intervals. Thanks to the skipping process of Skip-RNN and Skip-CNN, the resulting network could process information with different reception field together and achieves better performance than the state-of-the-art network. We conducted comparative experiments using our proposed method and six baseline models on seven publicly available datasets. The results demonstrate that our model outperforms other baseline methods in accuracy under most conditions and surpasses the transformer-based model with 0.098 for a short interval and 0.068 for a long interval. Our Skip-RCNN network presents a promising approach to MTS forecasting that can meet the demands of resource-constrained prediction scenarios.
引用
收藏
页码:142087 / 142099
页数:13
相关论文
共 57 条
[1]   Comparative Analysis of Recurrent Neural Network Architectures for Reservoir Inflow Forecasting [J].
Apaydin, Halit ;
Feizi, Hajar ;
Sattari, Mohammad Taghi ;
Colak, Muslume Sevba ;
Shamshirband, Shahaboddin ;
Chau, Kwok-Wing .
WATER, 2020, 12 (05)
[2]   Innovative Processes in Managing an Enterprise from the Energy and Food Sector in the Era of Industry 4.0 [J].
Borowski, Piotr F. .
PROCESSES, 2021, 9 (02) :1-17
[3]   Gaussian process for nonstationary time series prediction [J].
Brahim-Belhouari, S ;
Bermak, A .
COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2004, 47 (04) :705-712
[4]  
Cao DF, 2020, ADV NEUR IN, V33
[5]   Large Bayesian vector autoregressions with stochastic volatility and non-conjugate priors (vol 212, pg 137, 2019) [J].
Carriero, Andrea ;
Chan, Joshua ;
Clark, Todd E. ;
Marcellino, Massimiliano .
JOURNAL OF ECONOMETRICS, 2022, 227 (02) :506-512
[6]   Recurrent Neural Networks for Multivariate Time Series with Missing Values [J].
Che, Zhengping ;
Purushotham, Sanjay ;
Cho, Kyunghyun ;
Sontag, David ;
Liu, Yan .
SCIENTIFIC REPORTS, 2018, 8
[7]   XGBoost: A Scalable Tree Boosting System [J].
Chen, Tianqi ;
Guestrin, Carlos .
KDD'16: PROCEEDINGS OF THE 22ND ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2016, :785-794
[8]   A CRISPR/Cas12a-empowered surface plasmon resonance platform for rapid and specific diagnosis of the Omicron variant of SARS-CoV-2 [J].
Chen, Zhi ;
Li, Jingfeng ;
Li, Tianzhong ;
Fan, Taojian ;
Meng, Changle ;
Li, Chaozhou ;
Kang, Jianlong ;
Chai, Luxiao ;
Hao, Yabin ;
Tang, Yuxuan ;
Al-Hartomy, Omar A. ;
Wageh, Swelm ;
Al-Sehemi, Abdullah G. ;
Luo, Zhiguang ;
Yu, Jiangtian ;
Shao, Yonghong ;
Li, Defa ;
Feng, Shuai ;
Liu, William J. ;
He, Yaqing ;
Ma, Xiaopeng ;
Xie, Zhongjian ;
Zhang, Han .
NATIONAL SCIENCE REVIEW, 2022, 9 (08)
[9]   Deep Learning for Anomaly Detection in Time-Series Data: Review, Analysis, and Guidelines [J].
Choi, Kukjin ;
Yi, Jihun ;
Park, Changhwa ;
Yoon, Sungroh .
IEEE ACCESS, 2021, 9 :120043-120065
[10]  
Cholakov R, 2022, Arxiv, DOI [arXiv:2201.00199, DOI 10.48550/ARXIV.2201.00199]