Aspect-Level Sentiment Analysis Approach via BERT and Aspect Feature Location Model

被引:15
作者
Pang, Guangyao [1 ]
Lu, Keda [1 ]
Zhu, Xiaoying [1 ]
He, Jie [1 ]
Mo, Zhiyi [1 ]
Peng, Zizhen [2 ]
Pu, Baoxing [1 ]
机构
[1] Wuzhou Univ, Sch Data Sci & Software Engn, Wuzhou 543002, Peoples R China
[2] Wuzhou Vocat Coll, Dept Mech & Elect Engn, Wuzhou 543002, Peoples R China
基金
中国国家自然科学基金;
关键词
WORD EMBEDDINGS;
D O I
10.1155/2021/5534615
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the rapid development of Internet social platforms, buyer shows (such as comment text) have become an important basis for consumers to understand products and purchase decisions. The early sentiment analysis methods were mainly text-level and sentence-level, which believed that a text had only one sentiment. This phenomenon will cover up the details, and it is difficult to reflect people's fine-grained and comprehensive sentiments fully, leading to people's wrong decisions. Obviously, aspect-level sentiment analysis can obtain a more comprehensive sentiment classification by mining the sentiment tendencies of different aspects in the comment text. However, the existing aspect-level sentiment analysis methods mainly focus on attention mechanism and recurrent neural network. They lack emotional sensitivity to the position of aspect words and tend to ignore long-term dependencies. In order to solve this problem, on the basis of Bidirectional Encoder Representations from Transformers (BERT), this paper proposes an effective aspect-level sentiment analysis approach (ALM-BERT) by constructing an aspect feature location model. Specifically, we use the pretrained BERT model first to mine more aspect-level auxiliary information from the comment context. Secondly, for the sake of learning the expression features of aspect words and the interactive information of aspect words' context, we construct an aspect-based sentiment feature extraction method. Finally, we construct evaluation experiments on three benchmark datasets. The experimental results show that the aspect-level sentiment analysis performance of the ALM-BERT approach proposed in this paper is significantly better than other comparison methods.
引用
收藏
页数:13
相关论文
共 44 条
[21]   Content Attention Model for Aspect Based Sentiment Analysis [J].
Liu, Qiao ;
Zhang, Haibin ;
Zeng, Yifu ;
Huang, Ziqi ;
Wu, Zufeng .
WEB CONFERENCE 2018: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW2018), 2018, :1023-1032
[22]  
Liu Y., P INT JOINT C ART IN, P2134
[23]   VGCN-BERT: Augmenting BERT with Graph Embedding for Text Classification [J].
Lu, Zhibin ;
Du, Pan ;
Nie, Jian-Yun .
ADVANCES IN INFORMATION RETRIEVAL, ECIR 2020, PT I, 2020, 12035 :369-382
[24]  
Ma DH, 2017, PROCEEDINGS OF THE TWENTY-SIXTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P4068
[25]   Aspect-based sentiment analysis using adaptive aspect-based lexicons [J].
Mowlaei, Mohammad Erfan ;
Abadeh, Mohammad Saniee ;
Keshavarz, Hamidreza .
EXPERT SYSTEMS WITH APPLICATIONS, 2020, 148
[26]   Issues and Challenges of Aspect-based Sentiment Analysis: A Comprehensive Survey [J].
Nazir, Ambreen ;
Rao, Yuan ;
Wu, Lianwei ;
Sun, Ling .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2022, 13 (02) :845-863
[27]  
Pontiki M., 2014, P 8 INT WORKSHOP SEM, P27, DOI [10.3115/v1/S14-2004, DOI 10.3115/V1/S14-2004]
[28]   Opinion Word Expansion and Target Extraction through Double Propagation [J].
Qiu, Guang ;
Liu, Bing ;
Bu, Jiajun ;
Chen, Chun .
COMPUTATIONAL LINGUISTICS, 2011, 37 (01) :9-27
[29]   A Multi-Layer Dual Attention Deep Learning Model With Refined Word Embeddings for Aspect-Based Sentiment Analysis [J].
Rida-E-Fatima, Syeda ;
Javed, Ali ;
Banjar, Ameen ;
Irtaza, Aun ;
Dawood, Hassan ;
Dawood, Hussain ;
Alamri, Abdullah .
IEEE ACCESS, 2019, 7 :114795-114807
[30]   Targeted Sentiment Classification with Attentional Encoder Network [J].
Song, Youwei ;
Wang, Jiahai ;
Jiang, Tao ;
Liu, Zhiyue ;
Rao, Yanghui .
ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2019: TEXT AND TIME SERIES, PT IV, 2019, 11730 :93-103