Enhancing Text Classification by Graph Neural Networks With Multi-Granular Topic-Aware Graph

被引:18
|
作者
Gu, Yongchun [1 ]
Wang, Yi [2 ]
Zhang, Heng-Ru [3 ]
Wu, Jiao [4 ]
Gu, Xingquan [5 ]
机构
[1] Sichuan Univ Arts & Sci, Sch Math, Dazhou 635000, Peoples R China
[2] Zhejiang Normal Univ, Key Lab Intelligent Educ Technol & Applicat Zhejia, Jinhua 321004, Peoples R China
[3] Southwest Petr Univ, Sch Comp Sci, Chengdu 610500, Peoples R China
[4] China Jiliang Univ, Coll Sci, Hangzhou 310018, Peoples R China
[5] China Jiliang Univ, Coll Standardizat, Hangzhou 310018, Peoples R China
关键词
Text categorization; Graph neural networks; Feature extraction; Representation learning; Neural networks; Task analysis; Support vector machines; text classification; text graph construction;
D O I
10.1109/ACCESS.2023.3250109
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Text classification based on graph neural networks (GNNs) has been widely studied by virtue of its potential to capture complex and across-granularity relations among texts of different types from learning on a text graph. Existing methods typically construct text graphs based on words-documents to capture relevant intra-class document representations among the same documents via words-words and words-documents propagation. However, a natural problem is that polysemy words in documents may become an information medium between documents of different categories, promoting heterophily information propagation. The performance of text classification will be somewhat constrained by this issue. This paper proposes a novel text classification method based on GNN from multi-granular topic-aware perspective, referred to as Text-MGNN. Specifically, topic nodes are introduced to build a triple node set of "word, document, topic, " and multi-granularity relations are modeled on a text graph for this triple node set. The introduction of topic nodes has three significant advantages. The first is to strengthen the propagation of topics, words, and documents. The second is to enhance class-aware representation learning. The final is to mitigate the effect of heterophily information caused by polysemy words. Extensive experiments are conducted on three real-world datasets. Results validate that our proposed method outperforms 11 baselines methods.
引用
收藏
页码:20169 / 20183
页数:15
相关论文
共 50 条
  • [31] Structure-Aware Multi-Hop Graph Convolution for Graph Neural Networks
    Li, Yang
    Tanaka, Yuichi
    IEEE Access, 2022, 10 : 16624 - 16633
  • [32] Structure-Aware Multi-Hop Graph Convolution for Graph Neural Networks
    Li, Yang
    Tanaka, Yuichi
    IEEE ACCESS, 2022, 10 : 16624 - 16633
  • [33] Active Learning with Multi-Granular Graph Auto-Encoder
    He, Yi
    Yuan, Xu
    Tzeng, Nian-Feng
    Wu, Xindong
    20TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2020), 2020, : 1058 - 1063
  • [34] Retrieving Complex Tables with Multi-Granular Graph Representation Learning
    Wang, Fei
    Sun, Kexuan
    Chen, Muhao
    Pujara, Jay
    Szekely, Pedro
    SIGIR '21 - PROCEEDINGS OF THE 44TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2021, : 1472 - 1482
  • [35] Video as Conditional Graph Hierarchy for Multi-Granular Question Answering
    Xiao, Junbin
    Yao, Angela
    Liu, Zhiyuan
    Li, Yicong
    Ji, Wei
    Chua, Tat-Seng
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 2804 - 2812
  • [36] ConCas: Cascade Popularity Prediction Based on Topic-Aware Graph Contrastive Learning
    Ling, Chen
    Zhang, Xianren
    Shang, Jiaxing
    Liu, Dajiang
    Li, Yong
    Xie, Wu
    Qiang, Baohua
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT I, 2022, 13368 : 516 - 528
  • [37] Integrating Topic-Aware Heterogeneous Graph Neural Network With Transformer Model for Medical Scientific Document Abstractive Summarization
    Khaliq, Ayesha
    Khan, Atif
    Awan, Salman Afsar
    Jan, Salman
    Umair, Muhammad
    Zuhairi, Megat F.
    IEEE ACCESS, 2024, 12 : 113855 - 113866
  • [38] Graph Convolutional Networks for Text Classification
    Yao, Liang
    Mao, Chengsheng
    Luo, Yuan
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 7370 - 7377
  • [39] Substructure Aware Graph Neural Networks
    Zeng, Dingyi
    Liu, Wanlong
    Chen, Wenyu
    Zhou, Li
    Zhang, Malu
    Qu, Hong
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 9, 2023, : 11129 - 11137
  • [40] Parameterized Hypercomplex Graph Neural Networks for Graph Classification
    Le, Tuan
    Bertolini, Marco
    Noe, Frank
    Clevert, Djork-Arne
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2021, PT III, 2021, 12893 : 204 - 216