Forecasting Stock Prices Using a Hybrid Deep Learning Model Integrating Attention Mechanism, Multi-Layer Perceptron, and Bidirectional Long-Short Term Memory Neural Network

被引:52
作者
Chen, Qian [1 ]
Zhang, Wenyu [1 ]
Lou, Yu [1 ]
机构
[1] Zhejiang Univ Finance & Econ, Sch Informat Management & Artificial Intelligence, Hangzhou 310018, Peoples R China
基金
浙江省自然科学基金; 中国国家自然科学基金;
关键词
Stock prices forecasting; attention mechanism; bidirectional long-short term memory neural network; multi-layer perceptron; deep learning; TIME-SERIES; SELECTION; PREDICTION;
D O I
10.1109/ACCESS.2020.3004284
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Stock prices forecasting is a topic research in the fields of investment and national policy, which has been a challenging problem owing to the multi-noise, nonlinearity, high-frequency, and chaos of stocks. These characteristics of stocks impede most forecasting models from extracting valuable information from stocks data. Herein, a novel hybrid deep learning model integrating attention mechanism, multi-layer perceptron, and bidirectional long-short term memory neural network is proposed. First, the raw data including four types of datasets (historical prices of stocks, technical indicators of stocks closing prices, natural resources prices, and historical data of the Google index) are transformed into a knowledge base with reduced dimensions using principal component analysis. Subsequently, multi-layer perceptron is used for the fast transformation of feature space and rapid gradient descent, bidirectional long-short term memory neural network for extracting temporal features of stock time series data, and attention mechanism for making the neural network focus more on crucial temporal information by assigning higher weights. Finally, a comprehensive model evaluation method is used to compare the proposed model with seven related baseline models. After extensive experiments, the proposed model demonstrated its good forecasting performance.
引用
收藏
页码:117365 / 117376
页数:12
相关论文
共 62 条
[1]   Introduction to financial forecasting [J].
AbuMostafa, YS ;
Atiya, AF .
APPLIED INTELLIGENCE, 1996, 6 (03) :205-213
[2]  
[Anonymous], 1995, Financ Anal J, DOI DOI 10.2469/FAJ.V51.N1.1861
[3]  
[Anonymous], 1974, Journal of The Royal Statistical Society Series C-applied Statistics
[4]  
[Anonymous], 1962, Numer. Math.
[5]  
Benesty J., 2009, Noise Reduction in Speech Processing. Springer Topics in Signal Processing, P1
[6]   Describing Video With Attention-Based Bidirectional LSTM [J].
Bin, Yi ;
Yang, Yang ;
Shen, Fumin ;
Xie, Ning ;
Shen, Heng Tao ;
Li, Xuelong .
IEEE TRANSACTIONS ON CYBERNETICS, 2019, 49 (07) :2631-2641
[7]   Twitter mood predicts the stock market [J].
Bollen, Johan ;
Mao, Huina ;
Zeng, Xiaojun .
JOURNAL OF COMPUTATIONAL SCIENCE, 2011, 2 (01) :1-8
[8]   GENERALIZED AUTOREGRESSIVE CONDITIONAL HETEROSKEDASTICITY [J].
BOLLERSLEV, T .
JOURNAL OF ECONOMETRICS, 1986, 31 (03) :307-327
[9]   Affective Computing and Sentiment Analysis [J].
Cambria, Erik .
IEEE INTELLIGENT SYSTEMS, 2016, 31 (02) :102-107
[10]   Financial forecasting using support vector machines [J].
Cao, L ;
Tay, FEH .
NEURAL COMPUTING & APPLICATIONS, 2001, 10 (02) :184-192