Sentiment analysis of Chinese stock reviews based on BERT model

被引:60
作者
Li, Mingzheng [1 ]
Chen, Lei [1 ]
Zhao, Jing [1 ]
Li, Qiang [1 ]
机构
[1] Huainan Normal Univ, Coll Comp Sci, Huainan 232038, Peoples R China
关键词
Chinese stock reviews; Sentiment analysis; BERT; Fine-tuning;
D O I
10.1007/s10489-020-02101-8
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A large number of stock reviews are available on the Internet. Sentiment analysis of stock reviews has strong significance in research on the financial market. Due to the lack of a large amount of labeled data, it is difficult to improve the accuracy of Chinese stock sentiment classification using traditional methods. To address this challenge, in this paper, a novel sentiment analysis model for Chinese stock reviews based on BERT is proposed. This model relies on a pre-trained model to improve the accuracy of classification. The model use a BERT pre-training language model to perform representation of stock reviews on the sentence level, and subsequently feed the obtained feature vector into the classifier layer for classification. In the experiments, we demonstrate that our method has higher precision, recall, and F1 than TextCNN, TextRNN, Att-BLSTM and TextCRNN. Our model can obtain the best results which are indicated to be effective in Chinese stock review sentiment analysis. Meanwhile, Our model has powerful generalization capacity and can perform sentiment analysis in many fields.
引用
收藏
页码:5016 / 5024
页数:9
相关论文
共 35 条
[11]  
[冯时 Feng Shi], 2012, [计算机研究与发展, Journal of Computer Research and Development], V49, P2395
[12]  
Hanandeh ES, 2017, J COMPUT SCI
[13]  
Hochreiter S, 1997, NEURAL COMPUT, V9, P1735, DOI [10.1162/neco.1997.9.1.1, 10.1007/978-3-642-24797-2]
[14]   Learning-Based Content Caching with Update Strategy for Fog Radio Access Networks [J].
Jiang, Fan ;
Yuan, Zeng ;
Sun, Changyin ;
Ren, Yuan ;
Wang, Junxuan .
2019 IEEE/CIC INTERNATIONAL CONFERENCE ON COMMUNICATIONS IN CHINA (ICCC), 2019,
[15]  
Jotheeswaran J., 2015, ARPN J ENG APPL SCI, V10, P5883
[16]  
Kim Yoon., 2014, P C EMP METH NAT LAN, P1746, DOI 10.3115/v1/D14-1181
[17]   Contextual post-processing based on the confusion matrix in offline handwritten Chinese script recognition [J].
Li, YX ;
Tan, CL ;
Ding, XQ ;
Liu, CS .
PATTERN RECOGNITION, 2004, 37 (09) :1901-1912
[18]   A method for multi-class sentiment classification based on an improved one-vs-one (OVO) strategy and the support vector machine (SVM) algorithm [J].
Liu, Yang ;
Bi, Jian-Wu ;
Fan, Zhi-Ping .
INFORMATION SCIENCES, 2017, 394 :38-52
[19]  
Mikolov T., 2013, Advances in Neural Information Processing Systems, V26, P3111, DOI 10.48550/arXiv.1310.4546
[20]   Thumbs up? Sentiment classification using machine learning techniques [J].
Pang, B ;
Lee, L ;
Vaithyanathan, S .
PROCEEDINGS OF THE 2002 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING, 2002, :79-86