A hybrid approach for aspect-based sentiment analysis using a double rotatory attention model

被引：0

作者：

Zhou G. ^{[1
]}

Cheng J. ^{[1
]}

Frasincar F. ^{[1
]}

机构：

[1] Econometric Institute, Erasmus University Rotterdam, P.O. Box 1738, Rotterdam

来源：

International Journal of Web Engineering and Technology | 2022年 / 17卷 / 01期

关键词：

BERT; classification; contextual word embeddings; double rotatory attention; DRA; hierarchical attention; hybrid approach; LCR-Rot; lexicalised domain ontology; sentiment analysis;

D O I：

10.1504/ijwet.2022.125085

中图分类号：

学科分类号：

摘要：

Nowadays, the web is an essential hub for gathering comments on entities and their associated aspects. In this paper, we propose a model which is capable of extracting these opinions and predicting the sentiment scores in aspect-level sentiment mining. In our two-step approach, a lexicalised domain ontology is firstly applied for sentiment classification. If the result is inconclusive from the first step, the backup model double rotatory attention mechanism is applied, which utilises deep contextual word embeddings to better capture the (multi-)word semantics in the given text. This study contributes to the current research by introducing novel repetition and rotatory structures to refine the attention mechanism. It is shown that our model outperforms state-of-the-art methods on the datasets of SemEval 2015 and SemEval 2016. Copyright © 2022 Inderscience Enterprises Ltd.

引用

页码：3 / 28

页数：25

共 51 条

[1]

Alani H., Kim S., Millard D.E., Weal M.J., Hall W., Lewis P.H., Shadbolt N.R., Automatic ontology-based knowledge extraction from web documents, IEEE Intelligent Systems, 18, 1, pp. 14-21, (2003)

[2]

Bengio Y., Ducharme R., Vincent P., Jauvin C., A neural probabilistic language model, Journal of Machine Learning Research, 3, pp. 1137-1155, (2003)

[3]

Bloehdorn S., Cimiano P., Hotho A., Staab S., An ontology-based framework for text mining, LDV Forum, 20, pp. 87-112, (2005)

[4]

Chen Z., Mukherjee A., Liu B., Aspect extraction with automated prior knowledge learning, Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 347-358, (2014)

[5]

Coden A., Gruhl D., Lewis N., Mendes P.N., Nagarajan M., Ramakrishnan C., Welch S., Semantic lexicon expansion for concept-based aspect-aware sentiment analysis, Proceedings of the Semantic Web Evaluation Challenge, pp. 34-40, (2014)

[6]

Collobert R., Weston J., Bottou L., Karlen M., Kavukcuoglu K., Kuksa P., Natural language processing (almost) from scratch, Journal of Machine Learning Research, 12, pp. 2493-2537, (2011)

[7]

Cui Y., Chen Z., Wei S., Wang S., Liu T., Hu G., Attention-Over-Attention Neural Networks for Reading Comprehension, (2016)

[8]

Das S.R., Chen M.Y., Yahoo! for Amazon: sentiment extraction from small talk on the web, Management Science, 53, 9, pp. 1375-1388, (2007)

[9]

Devlin J., Chang M-W., Lee K., Toutanova K., BERT: pre-training of deep bidirectional transformers for language understanding, Preceeding of the North American Chapter of the Association for Computational Linguistics: Langage Techology, pp. 4171-4186, (2019)

[10]

Hu M., Liu B., Mining and summarizing customer reviews, Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 168-177, (2004)

← 1 2 3 4 5 6 →