Contrastive knowledge integrated graph neural networks for Chinese medical text classification

被引:12
|
作者
Lan, Ge [1 ]
Hu, Mengting [1 ]
Li, Ye [2 ]
Zhang, Yuzhi [1 ]
机构
[1] Nankai Univ, Coll Software, Tianjin 300350, Peoples R China
[2] Nankai Univ, Coll Artificial Intelligence, Tianjin 300350, Peoples R China
关键词
Knowledge graph; Graph neural networks; Medical text classification; Supervised contrastive learning;
D O I
10.1016/j.engappai.2023.106057
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper aims at medical text classification, where texts describe medicines, diseases, or other medical topics. This field is still challenging since medical texts contain intensive specialization and terminology, which require professional semantic and structured knowledge to classify. Based on our observations, medical knowledge graph (KG) can provide such knowledge although they may be ambiguous. To this end, we propose contrastive knowledge integrated graph neural networks (ConKGNN) to make full use of the above knowledge. Specifically, the proposed method builds two graphs for a medical text, i.e. text graph and text-specific subgraph, containing the text information and relevant KG information, respectively. Two graphs are merged into a united graph, which is jointly modeled by graph neural networks (GNN). In this way, our approach adequately learns interactions between neighbors. Meanwhile, it promotes the mutual influences between text and KG. We further propose graph-based supervised contrastive learning. By randomly cutting off nodes from the text graph, an augmented united graph is obtained. Learning it in a contrastive way could enhance the robustness of introducing KG information. Comprehensive experiments are conducted on five Chinese medical datasets and experimental results show our model outperforms strong baselines remarkably. Consequently, our model can serve as an efficient medical text classifier with excellent performance. We release the code at https://github.com/nolongernome/ConKGNN.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] Review of Graph Neural Network in Text Classification
    Malekzadeh, Masoud
    Hajibabaee, Parisa
    Heidari, Maryam
    Zad, Samira
    Uzuner, Ozlem
    Jones, James H. Jr Jr
    2021 IEEE 12TH ANNUAL UBIQUITOUS COMPUTING, ELECTRONICS & MOBILE COMMUNICATION CONFERENCE (UEMCON), 2021, : 84 - 91
  • [32] Disentangled Relational Graph Neural Network with Contrastive Learning for knowledge graph completion
    Yin, Hong
    Zhong, Jiang
    Li, Rongzhen
    Li, Xue
    KNOWLEDGE-BASED SYSTEMS, 2024, 295
  • [33] Enhancing Text Classification by Graph Neural Networks With Multi-Granular Topic-Aware Graph
    Gu, Yongchun
    Wang, Yi
    Zhang, Heng-Ru
    Wu, Jiao
    Gu, Xingquan
    IEEE ACCESS, 2023, 11 : 20169 - 20183
  • [34] Connecting the Dots: What Graph-Based Text Representations Work Best for Text Classification using Graph Neural Networks?
    Bugueno, Margarita
    de Melo, Gerard
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (EMNLP 2023), 2023, : 8943 - 8960
  • [35] Graph Convolutional Networks for Fast Text Classification
    Cai, Houyv
    Lv, Shaoqing
    Lu, Guangyue
    Li, Tingting
    Proceedings - 2022 4th International Conference on Natural Language Processing, ICNLP 2022, 2022, : 420 - 425
  • [36] Tensor Graph Convolutional Networks for Text Classification
    Liu, Xien
    You, Xinxin
    Zhang, Xiao
    Wu, Ji
    Lv, Ping
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 8409 - 8416
  • [37] Chinese Short Text Classification with Mutual-Attention Convolutional Neural Networks
    Hao, Ming
    Xu, Bo
    Liang, Jing-Yi
    Zhang, Bo-Wen
    Yin, Xu-Cheng
    ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2020, 19 (05)
  • [38] Attention-Based Recurrent Neural Networks in Chinese Short Text Classification
    Lin, Xin
    Chen, Jiahao
    Tan, Jun
    Bi, Ning
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE (ICPRAI 2018), 2018, : 399 - 402
  • [39] Dynamic Neural Networks for Text Classification
    Vega, Lea
    Mendez-Vazquez, Andres
    2016 INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND APPLICATIONS (ICCIA), 2016, : 6 - 11
  • [40] Multipattern Integrated Networks With Contrastive Pretraining for Graph Anomaly Detection
    Yang, Manzhi
    Zhang, Jian
    Lin, Liyuan
    Han, Jinpeng
    Chen, Xiaoguang
    Wang, Zhen
    Wang, Fei-Yue
    IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2024, 11 (05): : 5619 - 5630