Aspect-Level Sentiment Analysis Approach via BERT and Aspect Feature Location Model

被引:14
作者
Pang, Guangyao [1 ]
Lu, Keda [1 ]
Zhu, Xiaoying [1 ]
He, Jie [1 ]
Mo, Zhiyi [1 ]
Peng, Zizhen [2 ]
Pu, Baoxing [1 ]
机构
[1] Wuzhou Univ, Sch Data Sci & Software Engn, Wuzhou 543002, Peoples R China
[2] Wuzhou Vocat Coll, Dept Mech & Elect Engn, Wuzhou 543002, Peoples R China
基金
中国国家自然科学基金;
关键词
WORD EMBEDDINGS;
D O I
10.1155/2021/5534615
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the rapid development of Internet social platforms, buyer shows (such as comment text) have become an important basis for consumers to understand products and purchase decisions. The early sentiment analysis methods were mainly text-level and sentence-level, which believed that a text had only one sentiment. This phenomenon will cover up the details, and it is difficult to reflect people's fine-grained and comprehensive sentiments fully, leading to people's wrong decisions. Obviously, aspect-level sentiment analysis can obtain a more comprehensive sentiment classification by mining the sentiment tendencies of different aspects in the comment text. However, the existing aspect-level sentiment analysis methods mainly focus on attention mechanism and recurrent neural network. They lack emotional sensitivity to the position of aspect words and tend to ignore long-term dependencies. In order to solve this problem, on the basis of Bidirectional Encoder Representations from Transformers (BERT), this paper proposes an effective aspect-level sentiment analysis approach (ALM-BERT) by constructing an aspect feature location model. Specifically, we use the pretrained BERT model first to mine more aspect-level auxiliary information from the comment context. Secondly, for the sake of learning the expression features of aspect words and the interactive information of aspect words' context, we construct an aspect-based sentiment feature extraction method. Finally, we construct evaluation experiments on three benchmark datasets. The experimental results show that the aspect-level sentiment analysis performance of the ALM-BERT approach proposed in this paper is significantly better than other comparison methods.
引用
收藏
页数:13
相关论文
共 44 条
  • [1] Long short-term memory
    Hochreiter, S
    Schmidhuber, J
    [J]. NEURAL COMPUTATION, 1997, 9 (08) : 1735 - 1780
  • [2] [Anonymous], 2017, P INT C NEURAL INFOR
  • [3] Bahdanau Y.B.J.F.D., P 3 INT C LEARN REPR, P1
  • [4] Bengio Y., P 13 INT C ART INT S, P1
  • [5] Trading Private Range Counting over Big IoT Data
    Cai, Zhipeng
    He, Zaobo
    [J]. 2019 39TH IEEE INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS (ICDCS 2019), 2019, : 144 - 153
  • [6] A Private and Efficient Mechanism for Data Uploading in Smart Cyber-Physical Systems
    Cai, Zhipeng
    Zheng, Xu
    [J]. IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2020, 7 (02): : 766 - 775
  • [7] Chang M.-W., P C N AM CHAPT ASS C, P1
  • [8] Chen P., 2017, P EMNLP, P452, DOI [10.18653/v1/D17-1047, DOI 10.18653/V1/D17-1047]
  • [9] Ding B.L.X., P INT C WEB SEARCH W, P231
  • [10] Dong L, 2014, PROCEEDINGS OF THE 52ND ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, VOL 2, P49