Contrastive knowledge integrated graph neural networks for Chinese medical text classification

被引:12
|
作者
Lan, Ge [1 ]
Hu, Mengting [1 ]
Li, Ye [2 ]
Zhang, Yuzhi [1 ]
机构
[1] Nankai Univ, Coll Software, Tianjin 300350, Peoples R China
[2] Nankai Univ, Coll Artificial Intelligence, Tianjin 300350, Peoples R China
关键词
Knowledge graph; Graph neural networks; Medical text classification; Supervised contrastive learning;
D O I
10.1016/j.engappai.2023.106057
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper aims at medical text classification, where texts describe medicines, diseases, or other medical topics. This field is still challenging since medical texts contain intensive specialization and terminology, which require professional semantic and structured knowledge to classify. Based on our observations, medical knowledge graph (KG) can provide such knowledge although they may be ambiguous. To this end, we propose contrastive knowledge integrated graph neural networks (ConKGNN) to make full use of the above knowledge. Specifically, the proposed method builds two graphs for a medical text, i.e. text graph and text-specific subgraph, containing the text information and relevant KG information, respectively. Two graphs are merged into a united graph, which is jointly modeled by graph neural networks (GNN). In this way, our approach adequately learns interactions between neighbors. Meanwhile, it promotes the mutual influences between text and KG. We further propose graph-based supervised contrastive learning. By randomly cutting off nodes from the text graph, an augmented united graph is obtained. Learning it in a contrastive way could enhance the robustness of introducing KG information. Comprehensive experiments are conducted on five Chinese medical datasets and experimental results show our model outperforms strong baselines remarkably. Consequently, our model can serve as an efficient medical text classifier with excellent performance. We release the code at https://github.com/nolongernome/ConKGNN.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Knowledge Graph Integrated Graph Neural Networks for Chinese Medical Text Classification
    Nankai University, College of Software, Tianjin, China
    不详
    Proc. - IEEE Int. Conf. Bioinform. Biomed., BIBM, 1600, (682-687):
  • [2] Knowledge-enhanced graph convolutional neural networks for text classification
    Wang T.
    Zhu X.-F.
    Tang G.
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2022, 56 (02): : 322 - 328
  • [3] Contrastive Graph Convolutional Networks with adaptive augmentation for text classification
    Yang, Yintao
    Miao, Rui
    Wang, Yili
    Wang, Xin
    INFORMATION PROCESSING & MANAGEMENT, 2022, 59 (04)
  • [4] Combining Concept Graph with Improved Neural Networks for Chinese Short Text Classification
    Liao, Jialu
    Sun, Fanke
    Gu, Jinguang
    SEMANTIC TECHNOLOGY, JIST 2019, 2020, 1157 : 205 - 212
  • [5] Recurrent Graph Neural Networks for Text Classification
    Wei, Xinde
    Huang, Hai
    Ma, Longxuan
    Yang, Ze
    Xu, Liutong
    PROCEEDINGS OF 2020 IEEE 11TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND SERVICE SCIENCE (ICSESS 2020), 2020, : 91 - 97
  • [6] Graph neural networks for text classification: a survey
    Wang, Kunze
    Ding, Yihao
    Han, Soyeon Caren
    ARTIFICIAL INTELLIGENCE REVIEW, 2024, 57 (08)
  • [7] Contrastive Learning with Heterogeneous Graph Attention Networks on Short Text Classification
    Sun, Zhongtian
    Harit, Anoushka
    Cristea, Alexandra, I
    Yu, Jialin
    Shi, Lei
    Al Moubayed, Noura
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [8] Label Incorporated Graph Neural Networks for Text Classification
    Xin, Yuan
    Xu, Linli
    Guo, Junliang
    Li, Jiquan
    Sheng, Xin
    Zhou, Yuanyuan
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 8892 - 8898
  • [9] Relational Turkish text classification with graph neural networks
    Okur, Halil Ibrahim
    Tohma, Kadir
    Sertbas, Ahmet
    JOURNAL OF POLYTECHNIC-POLITEKNIK DERGISI, 2024,
  • [10] Bipartite Graph Coarsening for Text Classification Using Graph Neural Networks
    dos Santos, Nicolas Roque
    Minatel, Diego
    Baria Valejo, Alan Demetrius
    Lopes, Alneu de A.
    PROGRESS IN PATTERN RECOGNITION, IMAGE ANALYSIS, COMPUTER VISION, AND APPLICATIONS, CIARP 2023, PT I, 2024, 14469 : 589 - 604