MCformer: Multivariate Time Series Forecasting With Mixed-Channels Transformer

被引:10
作者
Han, Wenyong [1 ]
Zhu, Tao [1 ]
Chen, Liming [2 ]
Ning, Huansheng [3 ]
Luo, Yang [1 ]
Wan, Yaping [1 ]
机构
[1] Univ South China, Sch Comp Sci, Hengyang 421001, Peoples R China
[2] Dalian Univ Technol, Sch Comp Sci & Technol, Dalian 116024,, Peoples R China
[3] Univ Sci & Technol Beijing, Sch Comp & Commun Engn, Beijing 100083, Peoples R China
基金
中国国家自然科学基金;
关键词
Time series analysis; Forecasting; Predictive models; Data models; Internet of Things; Correlation; Transformers; Long time series; multivariate time series; self-attention; time series forecasting; NETWORK;
D O I
10.1109/JIOT.2024.3401697
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The massive generation of time-series data by large-scale Internet of Things (IoT) devices necessitates the exploration of more effective models for multivariate time-series forecasting. In previous models, there was a predominant use of the channel dependence (CD) strategy (where each channel represents a univariate sequence). Current state-of-the-art (SOTA) models primarily rely on the channel independence (CI) strategy. The CI strategy treats channel multichannel series as separate single-channel series, expanding the data set to improve generalization performance and avoiding interchannel correlation that disrupts long-term features. However, the CI strategy faces the challenge of interchannel correlation forgetting. To address this issue, we propose an innovative Mixed Channels strategy, combining the data expansion advantages of the CI strategy with the ability to mitigate interchannel correlation forgetting. Based on this strategy, we introduce MCformer, a multivariate time-series forecasting model with mixed channel features. The model blends a specific number of channels, leveraging an attention mechanism to effectively capture interchannel correlation information when modeling long-term features. Experimental results demonstrate that the Mixed Channels strategy outperforms pure CI strategy in multivariate time-series forecasting tasks.
引用
收藏
页码:28320 / 28329
页数:10
相关论文
共 30 条
[1]   Multivariate time series dataset for space weather data analytics [J].
Angryk, Rafal A. ;
Martens, Petrus C. ;
Aydin, Berkay ;
Kempton, Dustin ;
Mahajan, Sushant S. ;
Basodi, Sunitha ;
Ahmadzadeh, Azim ;
Cai, Xumin ;
Filali Boubrahimi, Soukaina ;
Hamdi, Shah Muhammad ;
Schuh, Michael A. ;
Georgoulis, Manolis K. .
SCIENTIFIC DATA, 2020, 7 (01)
[2]   Learning Graph Structures With Transformer for Multivariate Time-Series Anomaly Detection in IoT [J].
Chen, Zekai ;
Chen, Dingshuo ;
Zhang, Xiao ;
Yuan, Zixuan ;
Cheng, Xiuzhen .
IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (12) :9179-9189
[3]   Deep Belief Network for Meteorological Time Series Prediction in the Internet of Things [J].
Cheng, Yong ;
Zhou, Xiangyu ;
Wan, Shaohua ;
Choo, Kim-Kwang Raymond .
IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (03) :4369-4376
[4]   Towards Spatio-Temporal Aware Traffic Time Series Forecasting [J].
Cirstea, Razvan-Gabriel ;
Yang, Bin ;
Guo, Chenjuan ;
Tung Kieu ;
Pan, Shirui .
2022 IEEE 38TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2022), 2022, :2900-2913
[5]  
Das A, 2024, Arxiv, DOI arXiv:2304.08424
[6]  
Fan W., 2023, P 37 C NEUR INF PROC
[7]   Multivariate Short-Term Traffic Flow Forecasting Using Time-Series Analysis [J].
Ghosh, Bidisha ;
Basu, Biswajit ;
O'Mahony, Margaret .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2009, 10 (02) :246-254
[8]   A Multivariate-Time-Series-Prediction-Based Adaptive Data Transmission Period Control Algorithm for IoT Networks [J].
Han, Jaeseob ;
Lee, Gyeong Ho ;
Park, Sangdon ;
Lee, Joohyung ;
Choi, Jun Kyun .
IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (01) :419-436
[9]  
Han JD, 2021, AAAI CONF ARTIF INTE, V35, P4081
[10]  
Han L, 2023, Arxiv, DOI arXiv:2304.05206