A Hybrid Prediction Method for Realistic Network Traffic With Temporal Convolutional Network and LSTM

被引:150
作者
Bi, Jing [1 ]
Zhang, Xiang [1 ]
Yuan, Haitao [2 ]
Zhang, Jia [3 ]
Zhou, MengChu [4 ,5 ]
机构
[1] Beijing Univ Technol, Sch Software Engn, Fac Informat Technol, Beijing 100124, Peoples R China
[2] Beihang Univ, Sch Automat Sci & Elect Engn, Beijing 100191, Peoples R China
[3] Southern Methodist Univ, Lyle Sch Engn, Dept Comp Sci, Dallas, TX 75205 USA
[4] New Jersey Inst Technol, Dept Elect & Comp Engn, Newark, NJ 07102 USA
[5] King Abdulaziz Univ, Ctr Res Excellence Renewable Energy & Power Syst, Jeddah 21589, Saudi Arabia
基金
中国国家自然科学基金;
关键词
Predictive models; Time series analysis; Feature extraction; Deep learning; Load modeling; Task analysis; Support vector machines; Long short-term memory (LSTM); machine learning; network traffic prediction; Savitzky-Golay (SG) filter; temporal convolutional network (TCN); SHORT-TERM-MEMORY; NEURAL-NETWORKS; TIME-SERIES; MODEL; DROPOUT;
D O I
10.1109/TASE.2021.3077537
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Accurate and real-time prediction of network traffic can not only help system operators allocate resources rationally according to their actual business needs but also help them assess the performance of a network and analyze its health status. In recent years, neural networks have been proved suitable to predict time series data, represented by the model of a long short-term memory (LSTM) neural network and a temporal convolutional network (TCN). This article proposes a novel hybrid prediction method named SG and TCN-based LSTM (ST-LSTM) for such network traffic prediction, which synergistically combines the power of the Savitzky-Golay (SG) filter, the TCN, as well as the LSTM. ST-LSTM employs a three-phase end-to-end methodology serving time series prediction. It first eliminates noise in raw data using the SG filter, then extracts short-term features from sequences applying the TCN, and then captures the long-term dependence in the data exploiting the LSTM. Experimental results over real-world datasets demonstrate that the proposed ST-LSTM outperforms state-of-the-art algorithms in terms of prediction accuracy.
引用
收藏
页码:1869 / 1879
页数:11
相关论文
共 60 条
[1]   A Neural Network Architecture Combining Gated Recurrent Unit (GRU) and Support Vector Machine (SVM) for Intrusion Detection in Network Traffic Data [J].
Agarap, Abien Fred M. .
PROCEEDINGS OF 2018 10TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND COMPUTING (ICMLC 2018), 2018, :26-30
[2]   A Review of Deep Learning Methods Applied on Load Forecasting [J].
Almalaq, Abdulaziz ;
Edwards, George .
2017 16TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA), 2017, :511-516
[3]  
Amarasinghe K, 2017, PROC IEEE INT SYMP, P1483, DOI 10.1109/ISIE.2017.8001465
[4]  
[Anonymous], 2001, Technical Analysis from A to Z
[5]  
Azami H., 2012, JSIP, V03, P39, DOI [DOI 10.4236/JSIP.2012.31006, 10.4236/jsip.2012.31006]
[6]  
Bai S., 2018, arXiv
[7]   LONG-RANGE DEPENDENCE IN VARIABLE-BIT-RATE VIDEO TRAFFIC [J].
BERAN, J ;
SHERMAN, R ;
TAQQU, MS ;
WILLINGER, W .
IEEE TRANSACTIONS ON COMMUNICATIONS, 1995, 43 (2-4) :1566-1579
[8]   Support vector regression for link load prediction [J].
Bermolen, Paola ;
Rossi, Dario .
COMPUTER NETWORKS, 2009, 53 (02) :191-201
[9]   Time-Dependent Cloud Workload Forecasting via Multi-Task Learning [J].
Bi, Jing ;
Yuan, Haitao ;
Zhou, MengChu ;
Liu, Qing .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2019, 4 (03) :2401-2406
[10]   XGBoost: A Scalable Tree Boosting System [J].
Chen, Tianqi ;
Guestrin, Carlos .
KDD'16: PROCEEDINGS OF THE 22ND ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2016, :785-794