Enhancing Text Classification by Graph Neural Networks With Multi-Granular Topic-Aware Graph

被引:18
|
作者
Gu, Yongchun [1 ]
Wang, Yi [2 ]
Zhang, Heng-Ru [3 ]
Wu, Jiao [4 ]
Gu, Xingquan [5 ]
机构
[1] Sichuan Univ Arts & Sci, Sch Math, Dazhou 635000, Peoples R China
[2] Zhejiang Normal Univ, Key Lab Intelligent Educ Technol & Applicat Zhejia, Jinhua 321004, Peoples R China
[3] Southwest Petr Univ, Sch Comp Sci, Chengdu 610500, Peoples R China
[4] China Jiliang Univ, Coll Sci, Hangzhou 310018, Peoples R China
[5] China Jiliang Univ, Coll Standardizat, Hangzhou 310018, Peoples R China
关键词
Text categorization; Graph neural networks; Feature extraction; Representation learning; Neural networks; Task analysis; Support vector machines; text classification; text graph construction;
D O I
10.1109/ACCESS.2023.3250109
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Text classification based on graph neural networks (GNNs) has been widely studied by virtue of its potential to capture complex and across-granularity relations among texts of different types from learning on a text graph. Existing methods typically construct text graphs based on words-documents to capture relevant intra-class document representations among the same documents via words-words and words-documents propagation. However, a natural problem is that polysemy words in documents may become an information medium between documents of different categories, promoting heterophily information propagation. The performance of text classification will be somewhat constrained by this issue. This paper proposes a novel text classification method based on GNN from multi-granular topic-aware perspective, referred to as Text-MGNN. Specifically, topic nodes are introduced to build a triple node set of "word, document, topic, " and multi-granularity relations are modeled on a text graph for this triple node set. The introduction of topic nodes has three significant advantages. The first is to strengthen the propagation of topics, words, and documents. The second is to enhance class-aware representation learning. The final is to mitigate the effect of heterophily information caused by polysemy words. Extensive experiments are conducted on three real-world datasets. Results validate that our proposed method outperforms 11 baselines methods.
引用
收藏
页码:20169 / 20183
页数:15
相关论文
共 50 条
  • [41] Imbalanced Graph Classification via Graph-of-Graph Neural Networks
    Wang, Yu
    Zhao, Yuying
    Shah, Neil
    Derr, Tyler
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, : 2068 - 2077
  • [42] Knowledge-enhanced graph convolutional neural networks for text classification
    Wang T.
    Zhu X.-F.
    Tang G.
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2022, 56 (02): : 322 - 328
  • [43] Text Level Graph Neural Network for Text Classification
    Huang, Lianzhe
    Ma, Dehong
    Li, Sujian
    Zhang, Xiaodong
    Wang, Houfeng
    2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019): PROCEEDINGS OF THE CONFERENCE, 2019, : 3444 - 3450
  • [44] Path Queries on Massive Graphs Based on Multi-granular Graph Partitioning
    He, Fu-gui
    Zhang, Yan-ping
    Chen, Jie
    Zhang, Ling
    ROUGH SETS AND KNOWLEDGE TECHNOLOGY, 2011, 6954 : 569 - 578
  • [45] A Multi-Granular Aggregation-Enhanced Knowledge Graph Representation for Recommendation
    Liu, Xi
    Song, Rui
    Wang, Yuhang
    Xu, Hao
    INFORMATION, 2022, 13 (05)
  • [46] Exploiting Distance Graph and Hidden Topic Models for Multi-label Text Classification
    Thi-Ngan Pham
    Van-Hien Tran
    Tri-Thanh Nguyen
    Quang-Thuy Ha
    ADVANCED TOPICS IN INTELLIGENT INFORMATION AND DATABASE SYSTEMS, 2017, 710 : 321 - 331
  • [47] Multi-Grained Semantics-Aware Graph Neural Networks
    Zhong, Zhiqiang
    Li, Cheng-Te
    Pang, Jun
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (07) : 7251 - 7262
  • [48] Review of Graph Neural Network in Text Classification
    Malekzadeh, Masoud
    Hajibabaee, Parisa
    Heidari, Maryam
    Zad, Samira
    Uzuner, Ozlem
    Jones, James H. Jr Jr
    2021 IEEE 12TH ANNUAL UBIQUITOUS COMPUTING, ELECTRONICS & MOBILE COMMUNICATION CONFERENCE (UEMCON), 2021, : 84 - 91
  • [49] BGNN-XML: Bilateral Graph Neural Networks for Extreme Multi-Label Text Classification
    Zong, Daoming
    Sun, Shiliang
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (07) : 6698 - 6709
  • [50] Connecting the Dots: What Graph-Based Text Representations Work Best for Text Classification using Graph Neural Networks?
    Bugueno, Margarita
    de Melo, Gerard
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (EMNLP 2023), 2023, : 8943 - 8960