Contrastive knowledge integrated graph neural networks for Chinese medical text classification

被引:12
|
作者
Lan, Ge [1 ]
Hu, Mengting [1 ]
Li, Ye [2 ]
Zhang, Yuzhi [1 ]
机构
[1] Nankai Univ, Coll Software, Tianjin 300350, Peoples R China
[2] Nankai Univ, Coll Artificial Intelligence, Tianjin 300350, Peoples R China
关键词
Knowledge graph; Graph neural networks; Medical text classification; Supervised contrastive learning;
D O I
10.1016/j.engappai.2023.106057
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper aims at medical text classification, where texts describe medicines, diseases, or other medical topics. This field is still challenging since medical texts contain intensive specialization and terminology, which require professional semantic and structured knowledge to classify. Based on our observations, medical knowledge graph (KG) can provide such knowledge although they may be ambiguous. To this end, we propose contrastive knowledge integrated graph neural networks (ConKGNN) to make full use of the above knowledge. Specifically, the proposed method builds two graphs for a medical text, i.e. text graph and text-specific subgraph, containing the text information and relevant KG information, respectively. Two graphs are merged into a united graph, which is jointly modeled by graph neural networks (GNN). In this way, our approach adequately learns interactions between neighbors. Meanwhile, it promotes the mutual influences between text and KG. We further propose graph-based supervised contrastive learning. By randomly cutting off nodes from the text graph, an augmented united graph is obtained. Learning it in a contrastive way could enhance the robustness of introducing KG information. Comprehensive experiments are conducted on five Chinese medical datasets and experimental results show our model outperforms strong baselines remarkably. Consequently, our model can serve as an efficient medical text classifier with excellent performance. We release the code at https://github.com/nolongernome/ConKGNN.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] An Integrated Graph-of-Words with Tensor Graph Neural Network Learning Paradigm for Text Classification
    Tham Vo
    Hien Thanh Vu
    CYBERNETICS AND SYSTEMS, 2024, 55 (05) : 1255 - 1284
  • [22] Text Level Graph Neural Network for Text Classification
    Huang, Lianzhe
    Ma, Dehong
    Li, Sujian
    Zhang, Xiaodong
    Wang, Houfeng
    2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019): PROCEEDINGS OF THE CONFERENCE, 2019, : 3444 - 3450
  • [23] Graph Convolutional Networks for Text Classification
    Yao, Liang
    Mao, Chengsheng
    Luo, Yuan
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 7370 - 7377
  • [24] Label Contrastive Coding Based Graph Neural Network for Graph Classification
    Ren, Yuxiang
    Bai, Jiyang
    Zhang, Jiawei
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS (DASFAA 2021), PT I, 2021, 12681 : 123 - 140
  • [25] Combining Knowledge with Deep Convolutional Neural Networks for Short Text Classification
    Wang, Jin
    Wang, Zhongyuan
    Zhang, Dawei
    Yan, Jun
    PROCEEDINGS OF THE TWENTY-SIXTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 2915 - 2921
  • [26] Dynamic heterogeneous graph contrastive networks for knowledge tracing
    Han, Yehong
    Tang, Hailiang
    Zhang, Wenxiao
    Du, Lin
    Zhao, Jun
    Shao, Minglai
    APPLIED SOFT COMPUTING, 2024, 166
  • [27] Self-supervised short text classification with heterogeneous graph neural networks
    Cao, Meng
    Yuan, Jinliang
    Yu, Hualei
    Zhang, Baoming
    Wang, Chongjun
    EXPERT SYSTEMS, 2023, 40 (06)
  • [28] Contrastive Graph Pooling for Explainable Classification of Brain Networks
    Xu, Jiaxing
    Bian, Qingtian
    Li, Xinhang
    Zhang, Aihu
    Ke, Yiping
    Qiao, Miao
    Zhang, Wei
    Sim, Wei Khang Jeremy
    Gulyas, Balazs
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2024, 43 (09) : 3292 - 3305
  • [29] An chinese text classification algorithmbased on graph spacemodel
    Jia, Xiaoqiang
    BioTechnology: An Indian Journal, 2013, 8 (06) : 787 - 794
  • [30] Semisupervised Graph Neural Networks for Graph Classification
    Xie, Yu
    Liang, Yanfeng
    Gong, Maoguo
    Qin, A. K.
    Ong, Yew-Soon
    He, Tiantian
    IEEE TRANSACTIONS ON CYBERNETICS, 2023, 53 (10) : 6222 - 6235