Multi-head self-attention mechanism enabled individualized hemoglobin prediction and treatment recommendation systems in anemia management for hemodialysis patients

被引:3
|
作者
Yang, Ju-Yeh [1 ,2 ,3 ]
Lee, Tsung-Chun [4 ,5 ]
Liao, Wo -Ting [6 ,7 ]
Hsu, Chih-Chung [6 ,7 ]
机构
[1] Natl Taiwan Univ, Inst Hlth Policy & Management, Coll Publ Hlth, Taipei, Taiwan
[2] Lee Ming Inst Technol, Ctr Gen Educ, New Taipei City, Taiwan
[3] Far Eastern Mem Hosp, Dept Internal Med, Div Nephrol, New Taipei City, Taiwan
[4] Taipei Med Univ, Shuang Ho Hosp, Dept Internal Med, Div Gastroenterol & Hepatol, New Taipei City, Taiwan
[5] Taipei Med Univ, Coll Med, Sch Med, Dept Internal Med, Taipei, Taiwan
[6] Natl Cheng Kung Univ, Inst Data Sci, Miin Wu Sch Comp, Dept Stat, Tainan, Taiwan
[7] Natl Cheng Kung Univ, Data Sci Ctr, Miin Wu Sch Comp, Tainan, Taiwan
关键词
Self-attention mechanism; Prediction; Recommendation; Anemia; Hemodialysis; Informer; STAGE RENAL-DISEASE; ERYTHROPOIETIN THERAPY; HEMATOCRIT;
D O I
10.1016/j.heliyon.2022.e12613
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Anemia is a critical complication in hemodialysis patients, but the response to erythropoietin-stimulating agents (ESA) treatment varies from patient to patient and is not linear across different time points. The aim of this study was to develop deep learning algorithms for indi-vidualized anemia management. We retrospectively collected 36,677 data points from 623 he-modialysis patients, including clinical data, laboratory values, hemoglobin levels, and previous ESA doses. To reduce the computational complexity associated with recurrent neural networks (RNN) in processing time-series data, we developed neural networks based on multi-head self-attention mechanisms in an efficient and effective hemoglobin prediction model. Our proposed model achieved a more accurate hemoglobin prediction than the state-of-the-art RNN model, as shown by the smaller mean absolute error (MAE) of hemoglobin (0.451 vs. 0.593 g/dL, p = 0.014). In ESA (including darbepoetin and epoetin) dose recommendation, the simulation results by our model revealed a higher rate of achieved hemoglobin targets (physician prescription vs. model: 86.3 % vs. 92.7 %, p < 0.001), a lower rate of hemoglobin levels below 10 g/dL (13.7 % vs. 7.3 %, p < 0.001) and smaller change in hemoglobin levels (0.6 g/dL vs. 0.4 g/dL, p < 0.001) in all patients. Our model holds great potential for individualized anemia management as a computerized clinical decision support system for hemodialysis patients. Further external vali-dation with other datasets and prospective clinical utility studies are warranted.
引用
收藏
页数:12
相关论文
共 6 条
  • [1] Reference Crop Evapotranspiration Prediction Based on Gated Recurrent Unit with Quantum Inspired Multi-head Self-attention Mechanism
    Gao, Zehai
    Yang, Dongzhe
    Li, Baojun
    Gao, Zijun
    Li, Chengcheng
    WATER RESOURCES MANAGEMENT, 2025, 39 (03) : 1481 - 1501
  • [2] An integrated multi-head dual sparse self-attention network for remaining useful life prediction
    Zhang, Jiusi
    Li, Xiang
    Tian, Jilun
    Luo, Hao
    Yin, Shen
    RELIABILITY ENGINEERING & SYSTEM SAFETY, 2023, 233
  • [3] A Bearing Fault Diagnosis Method Based on Dilated Convolution and Multi-Head Self-Attention Mechanism
    Hou, Peng
    Zhang, Jianjie
    Jiang, Zhangzheng
    Tang, Yiyu
    Lin, Ying
    APPLIED SCIENCES-BASEL, 2023, 13 (23):
  • [4] Non-Invasive Load Decomposition Method Based on Multi-Scale TCN and Multi-Head Self-Attention Mechanism
    Zhang, Yan
    Li, Fei
    Xiao, Yang
    Li, Kai
    Xia, Lei
    Tan, Huilei
    INTERNATIONAL JOURNAL OF MULTIPHYSICS, 2024, 18 (03) : 547 - 556
  • [5] Efficient temporal flow Transformer accompanied with multi-head probsparse self-attention mechanism for remaining useful life prognostics
    Chang, Yuanhong
    Li, Fudong
    Chen, Jinglong
    Liu, Yulang
    Li, Zipeng
    RELIABILITY ENGINEERING & SYSTEM SAFETY, 2022, 226
  • [6] HADNet: A Novel Lightweight Approach for Abnormal Sound Detection on Highway Based on 1D Convolutional Neural Network and Multi-Head Self-Attention Mechanism
    Liang, Cong
    Chen, Qian
    Li, Qiran
    Wang, Qingnan
    Zhao, Kang
    Tu, Jihui
    Jafaripournimchahi, Ammar
    ELECTRONICS, 2024, 13 (21)