Contrastive knowledge integrated graph neural networks for Chinese medical text classification

被引:12
|
作者
Lan, Ge [1 ]
Hu, Mengting [1 ]
Li, Ye [2 ]
Zhang, Yuzhi [1 ]
机构
[1] Nankai Univ, Coll Software, Tianjin 300350, Peoples R China
[2] Nankai Univ, Coll Artificial Intelligence, Tianjin 300350, Peoples R China
关键词
Knowledge graph; Graph neural networks; Medical text classification; Supervised contrastive learning;
D O I
10.1016/j.engappai.2023.106057
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper aims at medical text classification, where texts describe medicines, diseases, or other medical topics. This field is still challenging since medical texts contain intensive specialization and terminology, which require professional semantic and structured knowledge to classify. Based on our observations, medical knowledge graph (KG) can provide such knowledge although they may be ambiguous. To this end, we propose contrastive knowledge integrated graph neural networks (ConKGNN) to make full use of the above knowledge. Specifically, the proposed method builds two graphs for a medical text, i.e. text graph and text-specific subgraph, containing the text information and relevant KG information, respectively. Two graphs are merged into a united graph, which is jointly modeled by graph neural networks (GNN). In this way, our approach adequately learns interactions between neighbors. Meanwhile, it promotes the mutual influences between text and KG. We further propose graph-based supervised contrastive learning. By randomly cutting off nodes from the text graph, an augmented united graph is obtained. Learning it in a contrastive way could enhance the robustness of introducing KG information. Comprehensive experiments are conducted on five Chinese medical datasets and experimental results show our model outperforms strong baselines remarkably. Consequently, our model can serve as an efficient medical text classifier with excellent performance. We release the code at https://github.com/nolongernome/ConKGNN.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] Knowledge-Aware Neural Networks for Medical Forum Question Classification
    Roy, Soumyadeep
    Chakraborty, Sudip
    Mandal, Aishik
    Balde, Gunjan
    Sharma, Prakhar
    Natarajan, Anandhavelu
    Khosla, Megha
    Sural, Shamik
    Ganguly, Niloy
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, CIKM 2021, 2021, : 3398 - 3402
  • [42] Knowledge-Graph- and GCN-Based Domain Chinese Long Text Classification Method
    Wang, Yifei
    Wang, Yongwei
    Hu, Hao
    Zhou, Shengnan
    Wang, Qinwu
    APPLIED SCIENCES-BASEL, 2023, 13 (13):
  • [43] Multi-layer Convolutional Neural Network Model Based on Prior Knowledge of Knowledge Graph for Text Classification
    Meng, Yining
    Wang, Guoyin
    Liu, Qun
    2019 IEEE 4TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND BIG DATA ANALYSIS (ICCCBDA), 2019, : 618 - 624
  • [44] Leveraging world knowledge in Chinese text classification
    Xu, Shu
    Sun, Maosong
    ALPIT 2007: PROCEEDINGS OF THE 6TH INTERNATIONAL CONFERENCE ON ADVANCED LANGUAGE PROCESSING AND WEB INFORMATION TECHNOLOGY, 2007, : 33 - +
  • [45] Molecular contrastive learning of representations via graph neural networks
    Yuyang Wang
    Jianren Wang
    Zhonglin Cao
    Amir Barati Farimani
    Nature Machine Intelligence, 2022, 4 : 279 - 287
  • [46] A link prediction method for Chinese financial event knowledge graph based on graph attention networks and convolutional neural networks
    Cheng, Haitao
    Wang, Ke
    Tan, Xiaoying
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 138
  • [47] Reinforced Contrastive Graph Neural Networks (RCGNN) for Anomaly Detection
    Sun, Zenan
    Su, Jingyi
    Jeon, Donghyun
    Velasquez, Alvaro
    Song, Houbing
    Niu, Shuteng
    2022 IEEE INTERNATIONAL PERFORMANCE, COMPUTING, AND COMMUNICATIONS CONFERENCE, IPCCC, 2022,
  • [48] Parameterized Hypercomplex Graph Neural Networks for Graph Classification
    Le, Tuan
    Bertolini, Marco
    Noe, Frank
    Clevert, Djork-Arne
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2021, PT III, 2021, 12893 : 204 - 216
  • [49] Cybersecurity Knowledge Graph Improvement with Graph Neural Networks
    Dasgupta, Soham
    Piplai, Aritran
    Ranade, Priyanka
    Joshi, Anupam
    2021 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2021, : 3290 - 3297
  • [50] Research on Text Classification Based on Knowledge Graph and Multimodal
    Jing, Li
    Yao, Ke
    Computer Engineering and Applications, 2024, 59 (02) : 102 - 109