CEHMR: Curriculum learning enhanced hierarchical multi-label classification for medication recommendation

被引:7
|
作者
Sun, Mengxuan [1 ,2 ]
Niu, Jinghao [1 ]
Yang, Xuebing [1 ]
Gu, Yifan [1 ,2 ]
Zhang, Wensheng [1 ,2 ,3 ]
机构
[1] Chinese Acad Sci, Inst Automat, State Key Lab Multimodal Artificial Intelligence S, Beijing, Peoples R China
[2] Univ Chinese Acad Sci, Beijing, Peoples R China
[3] Guangzhou Univ, Guangzhou, Peoples R China
基金
国家重点研发计划;
关键词
Medication recommendation; EHR; Hierarchical multi-label classification; Curriculum learning;
D O I
10.1016/j.artmed.2023.102613
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The medication recommendation (MR) or medication combination prediction task aims to predict effective prescriptions given accurate patient representations derived from electronic health records (EHRs), which contributes to improving the quality of clinical decision-making, especially for patients with multi-morbidity. Although in recent years deep learning technology has achieved great success in MR, the performance of current multi-label based MR solutions is unsatisfactory. They mainly focus on improving the patient representation module and modeling the medication label dependencies such as drug-drug interaction (DDI) correlation and co-occurrence relationship. However, the hierarchical dependency among medication labels and diversity of difficulty among MR training examples lack sufficient consideration. In this paper, we propose a framework of Curriculum learning Enhanced Hierarchical multi-label classification for MR (CEHMR). Motivated by the category hierarchy of medications which organizes standard medication codes in a hierarchical structure, we utilize it to provide more trustworthy prior knowledge for modeling label dependency. Specifically, we design a hierarchical multi-label classifier with a learnable gate fusion layer, to simultaneously capture the level-independent (local) and level-dependent (global) hierarchical information in the medication hierarchy. In addition, to overcome the diversity of training example difficulties, and progressively achieve a smoother training process, we introduce a bootstrap-based curriculum learning strategy. Hence, the example difficulty can be measured based on the predictive performance of the MR model, and then all training examples would be retrained from easy to hard under the guidance of a predefined training scheduler. Experiments on the real-world medical MIMIC-III database demonstrate that the proposed framework can achieve state-of-theart performance compared with seven representative baselines, and extensive ablation studies validate the effectiveness of each component of CEHMR.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Active learning for hierarchical multi-label classification
    Nakano, Felipe Kenji
    Cerri, Ricardo
    Vens, Celine
    DATA MINING AND KNOWLEDGE DISCOVERY, 2020, 34 (05) : 1496 - 1530
  • [2] Active learning for hierarchical multi-label classification
    Felipe Kenji Nakano
    Ricardo Cerri
    Celine Vens
    Data Mining and Knowledge Discovery, 2020, 34 : 1496 - 1530
  • [3] Hierarchical contrastive learning for multi-label text classification
    Wei Zhang
    Yun Jiang
    Yun Fang
    Shuai Pan
    Scientific Reports, 15 (1)
  • [4] Hierarchical Transfer Learning for Multi-label Text Classification
    Banerjee, Siddhartha
    Akkaya, Cem
    Perez-Sorrosal, Francisco
    Tsioutsiouliklis, Kostas
    57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), 2019, : 6295 - 6300
  • [5] Joint Learning of Hyperbolic Label Embeddings for Hierarchical Multi-label Classification
    Chatterjee, Soumya
    Maheshwari, Ayush
    Ramakrishnan, Ganesh
    Jagarlapudi, Saketha Nath
    16TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (EACL 2021), 2021, : 2829 - 2841
  • [6] MATAR: Keywords Enhanced Multi-label Learning for Tag Recommendation
    Li, Licheng
    Yao, Yuan
    Xu, Feng
    Lu, Jian
    WEB TECHNOLOGIES AND APPLICATIONS (APWEB 2015), 2015, 9313 : 268 - 279
  • [7] A novel curriculum learning framework for multi-label emotion classification
    Lin, Nankai
    Wu, Hongyan
    Zeng, Peijian
    Bai, Qifeng
    Zhou, Dong
    Yang, Aimin
    COMPUTER JOURNAL, 2025,
  • [8] Contrastive Enhanced Learning for Multi-Label Text Classification
    Wu, Tianxiang
    Yang, Shuqun
    APPLIED SCIENCES-BASEL, 2024, 14 (19):
  • [9] Hierarchical text classification with multi-label contrastive learning and KNN
    Zhang, Jun
    Li, Yubin
    Shen, Fanfan
    He, Yueshun
    Tan, Hai
    He, Yanxiang
    NEUROCOMPUTING, 2024, 577
  • [10] ReliefF for Hierarchical Multi-label Classification
    Slavkov, Ivica
    Karcheska, Jana
    Kocev, Dragi
    Kalajdziski, Slobodan
    Dzeroski, Saso
    NEW FRONTIERS IN MINING COMPLEX PATTERNS, NFMCP 2013, 2014, 8399 : 148 - 161