BERT-BiLSTM-Attention model for sentiment analysis on Chinese stock reviews

被引：0

作者：

Li, Xiaoyan ^{[1
]}

Chen, Lei ^{[1
]}

Chen, Baoguo ^{[1
]}

Ge, Xianlei ^{[2
]}

机构：

[1] Department of Computer, Huainan Normal University, Huainan

[2] Department of Electronic Engineering, Huainan Normal University, Huainan

来源：

Applied Mathematics and Nonlinear Sciences | 2024年 / 9卷 / 01期

关键词：

Attention; BERT; BiLSTM; Sentiment analysis; Stock;

D O I：

10.2478/amns-2024-1847

中图分类号：

学科分类号：

摘要：

COVID-19 has produced significant fluctuations and impacts on the Chinese stock market, and the sentiment analysis of stock reviews is important for the study of economic recovery. Owing to the shortage of well-annotated Chinese stock reviews, and the more emotional complexity and obscurity of Chinese stock review text, this paper proposes an innovative Chinese stock review sentiment analysis model BERT-BiLSTM-Attention, which encodes the stock review text by BERT to enhance the semantic feature representation of the text and the ability to understand the context, BiLSTM is then utilized to enhance the contextual information of the overall context of the review as well as the model's comprehension of the text sequences, and then Attention mechanism is utilized to obtain important textual information and get the most effective information quickly. Experiments show that the model is effective in sentiment analysis of Chinese stock reviews, with an accuracy of 93.98%. It can be proved that the proposed model well enhances the performance of stock review text classification, and has a strong generalization ability, which can be used for sentiment analysis in many fields. © 2024 Xiaoyan Li et al., published by Sciendo.

引用

共 26 条

[1]

Pham T., Vo D., Li F., Baker K., Han B., Lindsay L., Pashna M., Rowley R., Natural language processing for analysis of student online sentiment in a postgraduate program, Pacific Journal of Technology Enhanced Learning, 2, pp. 15-30, (2020)

[2]

Jayakody J.P.U.S.D., Kumara B.T.G.S., Sentiment analysis on product reviews on Twitter using machine learning approaches, Proceedings of the 2021 International Conference on Decision Aid Sciences and Application (DASA), pp. 1056-1061, (2021)

[3]

Sheu H.-J., Lu Y.-C., Wei Y.-C., Causalities between sentiment indicators and stock market returns under different market scenarios, International Journal of Business and Finance Research, 4, 1, pp. 159-171, (2010)

[4]

Bhardwaj A., Narayan Y., Vanraj P., Dutta M., Sentiment analysis for Indian stock market prediction using Sensex and Nifty, Procedia Computer Science, 70, pp. 85-91, (2015)

[5]

Rao T., Srivastava S., Analyzing stock market movements using Twitter sentiment analysis, ASONAM'12 Proceedings of the 2012 International Conference on Advances in Social Networks Analysis and Mining (ASONAM 2012), pp. 119-123, (2012)

[6]

Xu F., Keselj V., Collective sentiment mining of microblogs in 24-hour stock price movement prediction, 16th IEEE Conference on Business Informatics (CBI 2014), 2, pp. 60-67, (2014)

[7]

Li X., Wu P., Wang W., Incorporating stock prices and news sentiments for stock market prediction: A case of Hong Kong, Information Processing & Management, 57, 5, (2020)

[8]

Xu G., Yu Z., Yao H., Li F., Meng Y., Wu X., Chinese text sentiment analysis based on extended sentiment dictionary, IEEE Access, 7, pp. 43749-43762, (2019)

[9]

Ahmed M., Chen Q., Li Z., Constructing domain-dependent sentiment dictionary for sentiment analysis, Neural Computing and Applications, 32, pp. 14719-14732, (2020)

[10]

Malviya S., Tiwari A.K., Srivastava R., Tiwari V., Machine learning techniques for sentiment analysis: A review, SAMRIDDHI: A Journal of Physical Sciences, Engineering and Technology, 12, pp. 72-78, (2020)

← 1 2 3 →