Enhancing Text Classification by Graph Neural Networks With Multi-Granular Topic-Aware Graph

被引:18
|
作者
Gu, Yongchun [1 ]
Wang, Yi [2 ]
Zhang, Heng-Ru [3 ]
Wu, Jiao [4 ]
Gu, Xingquan [5 ]
机构
[1] Sichuan Univ Arts & Sci, Sch Math, Dazhou 635000, Peoples R China
[2] Zhejiang Normal Univ, Key Lab Intelligent Educ Technol & Applicat Zhejia, Jinhua 321004, Peoples R China
[3] Southwest Petr Univ, Sch Comp Sci, Chengdu 610500, Peoples R China
[4] China Jiliang Univ, Coll Sci, Hangzhou 310018, Peoples R China
[5] China Jiliang Univ, Coll Standardizat, Hangzhou 310018, Peoples R China
关键词
Text categorization; Graph neural networks; Feature extraction; Representation learning; Neural networks; Task analysis; Support vector machines; text classification; text graph construction;
D O I
10.1109/ACCESS.2023.3250109
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Text classification based on graph neural networks (GNNs) has been widely studied by virtue of its potential to capture complex and across-granularity relations among texts of different types from learning on a text graph. Existing methods typically construct text graphs based on words-documents to capture relevant intra-class document representations among the same documents via words-words and words-documents propagation. However, a natural problem is that polysemy words in documents may become an information medium between documents of different categories, promoting heterophily information propagation. The performance of text classification will be somewhat constrained by this issue. This paper proposes a novel text classification method based on GNN from multi-granular topic-aware perspective, referred to as Text-MGNN. Specifically, topic nodes are introduced to build a triple node set of "word, document, topic, " and multi-granularity relations are modeled on a text graph for this triple node set. The introduction of topic nodes has three significant advantages. The first is to strengthen the propagation of topics, words, and documents. The second is to enhance class-aware representation learning. The final is to mitigate the effect of heterophily information caused by polysemy words. Extensive experiments are conducted on three real-world datasets. Results validate that our proposed method outperforms 11 baselines methods.
引用
收藏
页码:20169 / 20183
页数:15
相关论文
共 50 条
  • [1] Topic-aware cosine graph convolutional neural network for short text classification
    Min C.
    Chu Y.
    Lin H.
    Wang B.
    Yang L.
    Xu B.
    Soft Computing, 2024, 28 (13-14) : 8119 - 8132
  • [2] Enhanced Topic-Aware Summarization Using Statistical Graph Neural Networks
    Khaliq, Ayesha
    Awan, Salman Afsar
    Ahmad, Fahad
    Zia, Muhammad Azam
    Iqbal, Muhammad Zafar
    CMC-COMPUTERS MATERIALS & CONTINUA, 2024, 80 (02): : 3221 - 3242
  • [3] GATSum: Graph Based Topic-Aware Abstract Text Summarization
    Jiang, Ming
    Zou, Yifan
    Xu, Jian
    Zhang, Min
    INFORMATION TECHNOLOGY AND CONTROL, 2022, 51 (02): : 345 - 355
  • [4] Topic-aware Heterogeneous Graph Neural Network for Link Prediction
    Xu, Siyong
    Yang, Cheng
    Shi, Chuan
    Fang, Yuan
    Guo, Yuxin
    Yang, Tianchi
    Zhang, Luhao
    Hu, Maodi
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, CIKM 2021, 2021, : 2261 - 2270
  • [5] Topic-aware hierarchical multi-attention network for text classification
    Ye Jiang
    Yimin Wang
    International Journal of Machine Learning and Cybernetics, 2023, 14 : 1863 - 1875
  • [6] Topic-aware hierarchical multi-attention network for text classification
    Jiang, Ye
    Wang, Yimin
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2023, 14 (05) : 1863 - 1875
  • [7] Recurrent Graph Neural Networks for Text Classification
    Wei, Xinde
    Huang, Hai
    Ma, Longxuan
    Yang, Ze
    Xu, Liutong
    PROCEEDINGS OF 2020 IEEE 11TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND SERVICE SCIENCE (ICSESS 2020), 2020, : 91 - 97
  • [8] Graph neural networks for text classification: a survey
    Wang, Kunze
    Ding, Yihao
    Han, Soyeon Caren
    ARTIFICIAL INTELLIGENCE REVIEW, 2024, 57 (08)
  • [9] MGPOOL: multi-granular graph pooling convolutional networks representation learning
    Zhenghua Xin
    Guolong Chen
    Jie Chen
    Shu Zhao
    Zongchao Wang
    Aidong Fang
    Zhenggao Pan
    Lin Cui
    International Journal of Machine Learning and Cybernetics, 2022, 13 : 783 - 796
  • [10] MGPOOL: multi-granular graph pooling convolutional networks representation learning
    Xin, Zhenghua
    Chen, Guolong
    Chen, Jie
    Zhao, Shu
    Wang, Zongchao
    Fang, Aidong
    Pan, Zhenggao
    Cui, Lin
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2022, 13 (03) : 783 - 796