Multi-level graph neural network for text sentiment analysis

被引:45
|
作者
Liao, Wenxiong [1 ]
Zeng, Bi [1 ]
Liu, Jianqi [2 ]
Wei, Pengfei [1 ]
Cheng, Xiaochun [3 ]
Zhang, Weiwen [1 ]
机构
[1] Guangdong Univ Technol, Sch Comp, Guangzhou, Guangdong, Peoples R China
[2] Guangdong Univ Technol, Sch Automat, Guangzhou, Guangdong, Peoples R China
[3] Middlesex Univ, Dept Comp Sci, London, England
基金
中国国家自然科学基金;
关键词
text sentiment analysis; graph neural network; attention mechanism; deep learning;
D O I
10.1016/j.compeleceng.2021.107096
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Text sentiment analysis is a fundamental task in the field of natural language processing (NLP). Recently, graph neural networks (GNNs) have achieved excellent performance in various NLP tasks. However, a GNN only considers the adjacent words when updating the node representations of the graph, and thus the model can only focus on the local features while ignoring global features. In this paper, we propose a novel multi-level graph neural network (MLGNN) for text sentiment analysis. To consider both local features and global features, we apply node connection windows with different sizes at different levels. Particularly, we integrate a scaled dot-product attention mechanism as a message passing mechanism into our method for fusing the features of each word node in the graph. The experimental results demonstrated that the proposed model outperformed other models in text sentiment analysis tasks.
引用
收藏
页数:11
相关论文
共 50 条
  • [11] A Multi-step Attention and Multi-level Structure Network for Multimodal Sentiment Analysis
    Zhang, Chuanlei
    Zhao, Hongwei
    Wang, Bo
    Wang, Wei
    Ke, Ting
    Li, Jianrong
    NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING, NLPCC 2022, PT I, 2022, 13551 : 723 - 735
  • [12] Multi-level graph convolutional recurrent neural network for semantic image segmentation
    Jiang, Dingchao
    Qu, Hua
    Zhao, Jihong
    Zhao, Jianlong
    Liang, Wei
    TELECOMMUNICATION SYSTEMS, 2021, 77 (03) : 563 - 576
  • [13] Multi-level graph convolutional recurrent neural network for semantic image segmentation
    Dingchao Jiang
    Hua Qu
    Jihong Zhao
    Jianlong Zhao
    Wei Liang
    Telecommunication Systems, 2021, 77 : 563 - 576
  • [14] Inferring Users' Social Roles with a Multi-Level Graph Neural Network Model
    Zhang, Chunrui
    Wang, Shen
    Zhan, Dechen
    Yin, Mingyong
    Lou, Fang
    ENTROPY, 2021, 23 (11)
  • [15] A multi-level probabilistic neural network
    Zong, Ning
    Hong, Xia
    ADVANCES IN NEURAL NETWORKS - ISNN 2007, PT 2, PROCEEDINGS, 2007, 4492 : 516 - +
  • [16] BN-GRAPH: Data Augmentation Based Bangla Text Sentiment Analysis in Deep Graph Neural Network
    Nitish Ranjan Bhowmik
    M. Rubaiyat Hossain Mondal
    Mohammad Arifuzzaman
    SN Computer Science, 6 (4)
  • [17] Multi-Level Graph Neural Network With Sparsity Pooling for Recognizing Parkinson’s Disease
    Zhang, Xiaobo
    Zhou, Yuxin
    Lu, Zhijie
    Zhai, Donghai
    Luo, Haonan
    Li, Tianrui
    Li, Yang
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2023, 31 : 4459 - 4469
  • [18] A fuzzy convolutional neural network for text sentiment analysis
    Tuan-Linh Nguyen
    Kavuri, Swathi
    Lee, Minho
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2018, 35 (06) : 6025 - 6034
  • [19] Story Point Level Classification by Text Level Graph Neural Network
    Phan, Hung
    Jannesari, Ali
    2022 IEEE/ACM 1ST INTERNATIONAL WORKSHOP ON NATURAL LANGUAGE-BASED SOFTWARE ENGINEERING (NLBSE 2022), 2022, : 75 - 78
  • [20] Multi-level fusion with deep neural networks for multimodal sentiment classification
    Zhang Guangwei
    Zhao Bing
    Li Ruifan
    TheJournalofChinaUniversitiesofPostsandTelecommunications, 2022, 29 (03) : 25 - 33