Sentiment Analysis of Russian Reviews to Estimate the Usefulness of Drugs Using the Domain-Specific XLM-RoBERTa Model

被引:1
作者
Sboev, Alexander [1 ,2 ]
Naumov, Aleksandr [1 ]
Moloshnikov, Ivan [1 ]
Rybka, Roman [1 ]
机构
[1] Kurchatov Inst, Natl Res Ctr, Moscow, Russia
[2] Natl Res Nucl Univ MEPhI, Moscow, Russia
来源
BIOLOGICALLY INSPIRED COGNITIVE ARCHITECTURES 2021 | 2022年 / 1032卷
基金
俄罗斯科学基金会;
关键词
Sentiment analysis; Text classification; Transfer learning; Russian-language texts; Public opinion;
D O I
10.1007/978-3-030-96993-6_49
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper considers the problem of classifying Russian-language drug reviews into five classes (corresponding to the authors' rating scores) and into two classes (the drug is helpful or useless) in terms of the sentiment analysis task. The dataset of reviews with a markup of pharmaceutically-significant entities and the set of neural network models based on language models are used for the study. The result obtained in this task formulation is compared to a solution based on extracting the named entities relevant to the drug-taking effectiveness, including the positive dynamics after the drug, the side effects occurring, the worsening of the condition, and the absence of the effect. It is shown that both approaches (a classification one and one based on the extracted entities) demonstrate close results in the case of using the best-performing model - XML-RoBERTa-sag.
引用
收藏
页码:447 / 456
页数:10
相关论文
共 26 条
[1]   A novel method for sentiment classification of drug reviews using fusion of deep and machine learning techniques [J].
Basiri, Mohammad Ehsan ;
Abdar, Moloud ;
Cifci, Mehmet Akif ;
Nemati, Shahla ;
Acharya, U. Rajendra .
KNOWLEDGE-BASED SYSTEMS, 2020, 198
[2]  
Bojanowski P., 2017, Transactions of the association for computational linguistics, V5, P135, DOI [10.1162/tacl_a_00051, 10.1162/tacla00051, DOI 10.1162/TACL_A_00051]
[3]  
Burtsev M, 2018, 56TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2018): PROCEEDINGS OF SYSTEM DEMONSTRATIONS, P122
[4]   Comparing deep learning architectures for sentiment analysis on drug reviews [J].
Colon-Ruiz, Cristobal ;
Segura-Bedmar, Isabel .
JOURNAL OF BIOMEDICAL INFORMATICS, 2020, 110
[5]  
Conneau A, 2020, Arxiv, DOI [arXiv:1911.02116, 10.48550/arXiv.1911.02116]
[6]  
Dai D, 2019, AAAI CONF ARTIF INTE, P6300
[7]  
Denecke K., 2015, Health web science: Social media data for healthcare
[8]  
Devlin J, 2019, Arxiv, DOI [arXiv:1810.04805, 10.48550/arXiv.1810.04805]
[9]   Aspect-Based Sentiment Analysis of Drug Reviews Applying Cross-Domain and Cross-Data Learning [J].
Grasser, Felix ;
Kallumadi, Surya ;
Malberg, Hagen ;
Zaunseder, Sebastian .
DH '18: PROCEEDINGS OF THE 2018 INTERNATIONAL CONFERENCE ON DIGITAL HEALTH, 2018, :121-125
[10]   Aspect-Level Drug Reviews Sentiment Analysis Based on Double BiGRU and Knowledge Transfer [J].
Han, Yue ;
Liu, Meiling ;
Jing, Weipeng .
IEEE ACCESS, 2020, 8 :21314-21325