Medication Recommendation Based on a Knowledge-enhanced Pre-training Model

被引:3
|
作者
Wang, Mengzhen [1 ]
Chen, Jianhui [2 ]
Lin, Shaofu [1 ]
机构
[1] Beijing Univ Technol, Fac Informat Technol, Coll Software Engn, Beijing, Peoples R China
[2] Beijing Univ Technol, Beijing Int Collaborat Base Brain Informat & Wisd, Beijing, Peoples R China
来源
PROCEEDINGS OF 2021 IEEE/WIC/ACM INTERNATIONAL CONFERENCE ON WEB INTELLIGENCE AND INTELLIGENT AGENT TECHNOLOGY WORKSHOPS AND SPECIAL SESSIONS: (WI-IAT WORKSHOP/SPECIAL SESSION 2021) | 2021年
关键词
Electronic medical record; Graph Attention Network; Pre-training model; Medication recommendation; NEURAL-NETWORK;
D O I
10.1145/3498851.3498968
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
More and more attention has been paid to electronic medical record (EMR)-based auxiliary diagnosis and treatment, in which medication recommendation is an important research direction. The existing medication recommendation models mainly depend on the data of patients, diagnosis and medications. However, the insufficient amount of clinical data with temporal dependencies becomes a major obstacle. This paper proposes a new knowledge-enhanced pre-training model for medication recommendation. On the one hand, the classification knowledge in diagnostic codes and drug codes is encoded by Graph Attention Network and fused into the clinical data for expanding the data content. On the other hand, a large number of single visit data of EMR are used to create the pre-trained visit model by a modified BERT for expanding the data scale. The experimental results on EMR data from more than 2,000 medical and health institutions in Hainan, China show that the fusion of classification knowledge and pre-training model can effectively improve the accuracy of medication recommendation.
引用
收藏
页码:290 / 294
页数:5
相关论文
共 50 条
  • [21] Power transformer fault diagnosis based on a self-strengthening offline pre-training model
    Zhong, Mingwei
    Yi, Siqi
    Fan, Jingmin
    Zhang, Yikang
    He, Guanglin
    Cao, Yunfei
    Feng, Lutao
    Tan, Zhichao
    Mo, Wenjun
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 126
  • [22] Human Pose Estimation Based Pre-training Model and Efficient High-Resolution Representation
    Wen, Jinchen
    Chi, Jianning
    Wu, Chengdong
    Yu, Xiaosheng
    2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 8463 - 8468
  • [23] Combustion oscillation prediction method in centrally-staged combustors based on pre-training model
    Qin Z.
    Wang X.
    Han X.
    Lin Y.
    Tuijin Jishu/Journal of Propulsion Technology, 2024, 45 (04):
  • [24] A deep neural network model for Chinese toponym matching with geographic pre-training model
    Qiu, Qinjun
    Zheng, Shiyu
    Tian, Miao
    Li, Jiali
    Ma, Kai
    Tao, Liufeng
    Xie, Zhong
    INTERNATIONAL JOURNAL OF DIGITAL EARTH, 2024, 17 (01)
  • [25] GeoNER: Geological Named Entity Recognition with Enriched Domain Pre-Training Model and Adversarial Training
    Ma, Kai
    Hu, Xinxin
    Tian, Miao
    Tan, Yongjian
    Zheng, Shuai
    Tao, Liufeng
    Qiu, Qinjun
    ACTA GEOLOGICA SINICA-ENGLISH EDITION, 2024, 98 (05) : 1404 - 1417
  • [26] Meta-path structured graph pre-training for improving knowledge tracing in intelligent tutoring
    Zhu, Menglin
    Qiu, Liqing
    Zhou, Jingcheng
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 254
  • [27] Research on Effectiveness of the Pre-Training Model in Improving the Performance of Spectral Feature Extraction
    Ren, Ju-xiang
    Liu, Zhong-bao
    SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44 (12) : 3480 - 3484
  • [28] Graph neural pre-training based drug-target affinity prediction
    Ye, Qing
    Sun, Yaxin
    FRONTIERS IN GENETICS, 2024, 15
  • [29] Multilingual Pre-training Model-Assisted Contrastive Learning Neural Machine Translation
    Sun, Shuo
    Hou, Hong-xu
    Yang, Zong-heng
    Wang, Yi-song
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [30] Flight parameter prediction for high-dynamic Hypersonic vehicle system based on pre-training machine learning model
    Zhou, Dengji
    Huang, Dawen
    Zhang, Xing
    Tie, Ming
    Wang, Yulin
    Shen, Yaoxin
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART G-JOURNAL OF AEROSPACE ENGINEERING, 2024, 238 (11) : 1041 - 1054