A Graph Neural Network-Based Context-Aware Framework for Sentiment Analysis Classification in Chinese Microblogs

被引:0
作者
Jin, Zhesheng [1 ]
Zhang, Yunhua [1 ]
机构
[1] Zhejiang Sci Tech Univ, Dept Comp Sci & Technol, Hangzhou 310018, Peoples R China
关键词
sentiment analysis; Chinese microblogs; graph neural networks; context-aware embeddings; syntactic structure modeling; RNN;
D O I
10.3390/math13060997
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Sentiment analysis in Chinese microblogs is challenged by complex syntactic structures and fine-grained sentiment shifts. To address these challenges, a Contextually Enriched Graph Neural Network (CE-GNN) is proposed, integrating self-supervised learning, context-aware sentiment embeddings, and Graph Neural Networks (GNNs) to enhance sentiment classification. First, CE-GNN is pre-trained on a large corpus of unlabeled text through self-supervised learning, where Masked Language Modeling (MLM) and Next Sentence Prediction (NSP) are leveraged to obtain contextualized embeddings. These embeddings are then refined through a context-aware sentiment embedding layer, which is dynamically adjusted based on the surrounding text to improve sentiment sensitivity. Next, syntactic dependencies are captured by Graph Neural Networks (GNNs), where words are represented as nodes and syntactic relationships are denoted as edges. Through this graph-based structure, complex sentence structures, particularly in Chinese, can be interpreted more effectively. Finally, the model is fine-tuned on a labeled dataset, achieving state-of-the-art performance in sentiment classification. Experimental results demonstrate that CE-GNN achieves superior accuracy, with a Macro F-measure of 80.21% and a Micro F-measure of 82.93%. Ablation studies further confirm that each module contributes significantly to the overall performance.
引用
收藏
页数:25
相关论文
共 49 条
[1]  
Abdallah H, 2020, Arxiv, DOI [arXiv:2004.08246, 10.1088/2632-2153/aba8e8, DOI 10.1088/2632-2153/ABA8E8]
[2]   Deep Learning in Sentiment Analysis: Recent Architectures [J].
Abdullah, Tariq ;
Ahmet, Ahmed .
ACM COMPUTING SURVEYS, 2023, 55 (08)
[3]   Transformer models for text-based emotion detection: a review of BERT-based approaches [J].
Acheampong, Francisca Adoma ;
Nunoo-Mensah, Henry ;
Chen, Wenyu .
ARTIFICIAL INTELLIGENCE REVIEW, 2021, 54 (08) :5789-5829
[4]   Business boosting through sentiment analysis using Artificial Intelligence approach [J].
Ahmed, Alim Al Ayub ;
Agarwal, Sugandha ;
Kurniawan, IMade Gede Ariestova ;
Anantadjaya, Samuel P. D. ;
Krishnan, Chitra .
INTERNATIONAL JOURNAL OF SYSTEM ASSURANCE ENGINEERING AND MANAGEMENT, 2022, 13 (SUPPL 1) :699-709
[5]   ABCDM: An Attention-based Bidirectional CNN-RNN Deep Model for sentiment analysis [J].
Basiri, Mohammad Ehsan ;
Nemati, Shahla ;
Abdar, Moloud ;
Cambria, Erik ;
Acharya, U. Rajendra .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2021, 115 :279-294
[6]  
Ben-Baruch E, 2021, Arxiv, DOI arXiv:2009.14119
[7]  
Brody S, 2022, Arxiv, DOI [arXiv:2105.14491, DOI 10.48550/ARXIV.2105.14491]
[8]   A hybrid Persian sentiment analysis framework: Integrating dependency grammar based rules and deep neural networks [J].
Dashtipour, Kia ;
Gogate, Mandar ;
Li, Jingpeng ;
Jiang, Fengling ;
Kong, Bin ;
Hussain, Amir .
NEUROCOMPUTING, 2020, 380 :1-10
[9]  
Dong Guozhu., 2018, Feature engineering for machine learning and data analytics
[10]  
Dosovitskiy A, 2021, Arxiv, DOI arXiv:2010.11929