Inconsistent Multivariate Time Series Forecasting

被引:0
作者
Shen, Li [1 ]
Wang, Yangzhu [1 ]
Fan, Xuyi [1 ]
Yang, Xu [1 ]
Qiu, Huaxin [1 ]
机构
[1] Beihang Univ, Beijing 100191, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Time series analysis; Forecasting; Correlation; Predictive models; Time-frequency analysis; Data models; Data augmentation; Training; Overfitting; Multivariate time series forecasting; deep learning-based forecasting; multiresolution analysis; dynamic mode decomposition;
D O I
10.1109/TKDE.2025.3556940
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Traditional statistical time series forecasting models rely on model identification methods to identify the worthiest model variants to investigate; therefore, the model parameters change with the statistical features of rolling windows to reach optimality. Currently, although deep-learning-based methods achieve promising multivariate forecasting performance, their representations of variable correlations are consistent regardless of the observed local time series properties and dynamic cross-variable relations, rendering them prone to overfitting. To bridge this gap, we propose FPPformer-MD, a novel inconsistent time series forecasting transformer. FPPformer-MD leverages multiresolution analysis to transform each univariate series into multiple frequency scales and evaluate the local variable correlations via their variances. Thus, FPPformer-MD receives richer input features, and its inner inconsistent cross-variable attention mechanism enables the adaptive extraction of cross-variable features. To further alleviate the overfitting problem, we apply dynamic mode decomposition to perform cross-variable data augmentation, which reconstructs the sequence outliers with other correlated sequences during the model training process. Extensive experiments conducted on thirteen real-world benchmarks demonstrate the state-of-the-art performance of FPPformer-MD.
引用
收藏
页码:4117 / 4130
页数:14
相关论文
共 49 条
[1]  
Cheema P, 2024, Arxiv, DOI arXiv:2402.19287
[2]  
Chen J., 2024, P 38 C NEUR INF PROC
[3]   Robust Separation-Enhanced NRC Method for Multiple Periodicity Detection: Applications in Bearing Compound Fault Diagnosis [J].
Chen, Saisai ;
Fan, Wei ;
Xiong, Yuyong ;
Peng, Zhike .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73 :1-11
[4]   APPROXIMATE REALIZATION BASED UPON AN ALTERNATIVE TO THE HANKEL MATRIX - THE PAGE MATRIX [J].
DAMEN, AAH ;
VANDENHOF, PMJ ;
HAJDASINSKI, AK .
SYSTEMS & CONTROL LETTERS, 1982, 2 (04) :202-208
[5]  
Demirel B. U., 2024, P INT C NEUR INF PRO
[6]  
Dong YH, 2021, PR MACH LEARN RES, V139
[7]  
Donghao L., 2024, P INT C LEARN REPR, P1
[8]   TSMixer: Lightweight MLP-Mixer Model for Multivariate Time Series Forecasting [J].
Ekambaram, Vijay ;
Jati, Arindam ;
Nguyen, Nam ;
Sinthong, Phanwadee ;
Kalagnanam, Jayant .
PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023, 2023, :459-469
[9]   Feature Representation and Data Augmentation for Human Activity Classification Based on Wearable IMU Sensor Data Using a Deep LSTM Neural Network [J].
Eyobu, Odongo Steven ;
Han, Dong Seog .
SENSORS, 2018, 18 (09)
[10]   STWave+: A Multi-Scale Efficient Spectral Graph Attention Network With Long-Term Trends for Disentangled Traffic Flow Forecasting [J].
Fang, Yuchen ;
Qin, Yanjun ;
Luo, Haiyong ;
Zhao, Fang ;
Zheng, Kai .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (06) :2671-2685