Aspect-Level Sentiment Analysis Approach via BERT and Aspect Feature Location Model

被引:14
作者
Pang, Guangyao [1 ]
Lu, Keda [1 ]
Zhu, Xiaoying [1 ]
He, Jie [1 ]
Mo, Zhiyi [1 ]
Peng, Zizhen [2 ]
Pu, Baoxing [1 ]
机构
[1] Wuzhou Univ, Sch Data Sci & Software Engn, Wuzhou 543002, Peoples R China
[2] Wuzhou Vocat Coll, Dept Mech & Elect Engn, Wuzhou 543002, Peoples R China
基金
中国国家自然科学基金;
关键词
WORD EMBEDDINGS;
D O I
10.1155/2021/5534615
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the rapid development of Internet social platforms, buyer shows (such as comment text) have become an important basis for consumers to understand products and purchase decisions. The early sentiment analysis methods were mainly text-level and sentence-level, which believed that a text had only one sentiment. This phenomenon will cover up the details, and it is difficult to reflect people's fine-grained and comprehensive sentiments fully, leading to people's wrong decisions. Obviously, aspect-level sentiment analysis can obtain a more comprehensive sentiment classification by mining the sentiment tendencies of different aspects in the comment text. However, the existing aspect-level sentiment analysis methods mainly focus on attention mechanism and recurrent neural network. They lack emotional sensitivity to the position of aspect words and tend to ignore long-term dependencies. In order to solve this problem, on the basis of Bidirectional Encoder Representations from Transformers (BERT), this paper proposes an effective aspect-level sentiment analysis approach (ALM-BERT) by constructing an aspect feature location model. Specifically, we use the pretrained BERT model first to mine more aspect-level auxiliary information from the comment context. Secondly, for the sake of learning the expression features of aspect words and the interactive information of aspect words' context, we construct an aspect-based sentiment feature extraction method. Finally, we construct evaluation experiments on three benchmark datasets. The experimental results show that the aspect-level sentiment analysis performance of the ALM-BERT approach proposed in this paper is significantly better than other comparison methods.
引用
收藏
页数:13
相关论文
共 44 条
  • [11] Fan FF, 2018, 2018 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2018), P3433
  • [12] Gao Z., 2020, IEEE ACCESS, V7, P154290
  • [13] Aspect Level Sentiment Classification with Attention-over-Attention Neural Networks
    Huang, Binxuan
    Ou, Yanglan
    Carley, Kathleen M.
    [J]. SOCIAL, CULTURAL, AND BEHAVIORAL MODELING, SBP-BRIMS 2018, 2018, 10899 : 197 - 206
  • [14] Jiang L., P 49 ANN M ASS COMP, P151
  • [15] Jing Hongfei Y, P C EMP METH NAT LAN, P56
  • [16] Kiritchenko S., 2014, P 8 INT WORKSH SEM E, P437, DOI DOI 10.3115/V1/S14-2076
  • [17] Li X, 2018, PROCEEDINGS OF THE 56TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL), VOL 1, P946
  • [18] Deep Learning Based Inference of Private Information Using Embedded Sensors in Smart Devices
    Liang, Yi
    Cai, Zhipeng
    Yu, Jiguo
    Han, Qilong
    Li, Yingshu
    [J]. IEEE NETWORK, 2018, 32 (04): : 8 - 14
  • [19] Multi-Round Incentive Mechanism for Cold Start-Enabled Mobile Crowdsensing
    Lin, Yaguang
    Cai, Zhipeng
    Wang, Xiaoming
    Hao, Fei
    Wang, Liang
    Sai, Akshita Maradapu Vera Venkata
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2021, 70 (01) : 993 - 1007
  • [20] Dynamic Control of Fraud Information Spreading in Mobile Social Networks
    Lin, Yaguang
    Wang, Xiaoming
    Hao, Fei
    Jiang, Yichuan
    Wu, Yulei
    Min, Geyong
    He, Daojing
    Zhu, Sencun
    Zhao, Wei
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2021, 51 (06): : 3725 - 3738