Aspect-Level Sentiment Analysis Approach via BERT and Aspect Feature Location Model

被引:15
作者
Pang, Guangyao [1 ]
Lu, Keda [1 ]
Zhu, Xiaoying [1 ]
He, Jie [1 ]
Mo, Zhiyi [1 ]
Peng, Zizhen [2 ]
Pu, Baoxing [1 ]
机构
[1] Wuzhou Univ, Sch Data Sci & Software Engn, Wuzhou 543002, Peoples R China
[2] Wuzhou Vocat Coll, Dept Mech & Elect Engn, Wuzhou 543002, Peoples R China
基金
中国国家自然科学基金;
关键词
WORD EMBEDDINGS;
D O I
10.1155/2021/5534615
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the rapid development of Internet social platforms, buyer shows (such as comment text) have become an important basis for consumers to understand products and purchase decisions. The early sentiment analysis methods were mainly text-level and sentence-level, which believed that a text had only one sentiment. This phenomenon will cover up the details, and it is difficult to reflect people's fine-grained and comprehensive sentiments fully, leading to people's wrong decisions. Obviously, aspect-level sentiment analysis can obtain a more comprehensive sentiment classification by mining the sentiment tendencies of different aspects in the comment text. However, the existing aspect-level sentiment analysis methods mainly focus on attention mechanism and recurrent neural network. They lack emotional sensitivity to the position of aspect words and tend to ignore long-term dependencies. In order to solve this problem, on the basis of Bidirectional Encoder Representations from Transformers (BERT), this paper proposes an effective aspect-level sentiment analysis approach (ALM-BERT) by constructing an aspect feature location model. Specifically, we use the pretrained BERT model first to mine more aspect-level auxiliary information from the comment context. Secondly, for the sake of learning the expression features of aspect words and the interactive information of aspect words' context, we construct an aspect-based sentiment feature extraction method. Finally, we construct evaluation experiments on three benchmark datasets. The experimental results show that the aspect-level sentiment analysis performance of the ALM-BERT approach proposed in this paper is significantly better than other comparison methods.
引用
收藏
页数:13
相关论文
共 44 条
[11]  
Gao Z., 2020, IEEE ACCESS, V7, P154290
[12]  
Hochreiter S., 1997, Neural Computation, V9, P1735
[13]   Aspect Level Sentiment Classification with Attention-over-Attention Neural Networks [J].
Huang, Binxuan ;
Ou, Yanglan ;
Carley, Kathleen M. .
SOCIAL, CULTURAL, AND BEHAVIORAL MODELING, SBP-BRIMS 2018, 2018, 10899 :197-206
[14]  
Jiang L., P 49 ANN M ASS COMP, P151
[15]  
Jing Hongfei Y, P C EMP METH NAT LAN, P56
[16]  
Li X, 2018, PROCEEDINGS OF THE 56TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL), VOL 1, P946
[17]   Deep Learning Based Inference of Private Information Using Embedded Sensors in Smart Devices [J].
Liang, Yi ;
Cai, Zhipeng ;
Yu, Jiguo ;
Han, Qilong ;
Li, Yingshu .
IEEE NETWORK, 2018, 32 (04) :8-14
[18]   Multi-Round Incentive Mechanism for Cold Start-Enabled Mobile Crowdsensing [J].
Lin, Yaguang ;
Cai, Zhipeng ;
Wang, Xiaoming ;
Hao, Fei ;
Wang, Liang ;
Sai, Akshita Maradapu Vera Venkata .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2021, 70 (01) :993-1007
[19]   Dynamic Control of Fraud Information Spreading in Mobile Social Networks [J].
Lin, Yaguang ;
Wang, Xiaoming ;
Hao, Fei ;
Jiang, Yichuan ;
Wu, Yulei ;
Min, Geyong ;
He, Daojing ;
Zhu, Sencun ;
Zhao, Wei .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2021, 51 (06) :3725-3738
[20]   Aspect-based sentiment analysis with gated alternate neural network [J].
Liu, Ning ;
Shen, Bo .
KNOWLEDGE-BASED SYSTEMS, 2020, 188