Evaluating the effectiveness of self-attention mechanism in tuberculosis time series forecasting

被引:0
作者
Lv, Zhihong [1 ]
Sun, Rui [1 ]
Liu, Xin [1 ]
Wang, Shuo [2 ]
Guo, Xiaowei [1 ]
Lv, Yuan [1 ]
Yao, Min [3 ]
Zhou, Junhua [1 ]
机构
[1] Hunan Normal Univ, Sch Med, Key Lab Mol Epidemiol Hunan Prov, Changsha 410013, Hunan, Peoples R China
[2] Changsha Univ Sci & Technol, Changsha 410114, Hunan, Peoples R China
[3] Hunan Prov Ctr Dis Control & Prevent, Changsha 410005, Hunan, Peoples R China
基金
中国国家自然科学基金;
关键词
Tuberculosis; Time series forecasting; Self-attention mechanism; ARIMA model; LSTM model;
D O I
10.1186/s12879-024-10183-9
中图分类号
R51 [传染病];
学科分类号
100401 ;
摘要
BackgroundWith the increasing impact of tuberculosis on public health, accurately predicting future tuberculosis cases is crucial for optimizing of health resources and medical service allocation. This study applies a self-attention mechanism to predict the number of tuberculosis cases, aiming to evaluate its effectiveness in forecasting.MethodsMonthly tuberculosis case data from Changde City between 2010 and 2021 were used to construct a self-attention model, a long short-term memory (LSTM) model, and an autoregressive integrated moving average (ARIMA) model. The performance of these models was evaluated using three metrics: root mean square error (RMSE), mean absolute error (MAE), and mean absolute percentage error (MAPE).ResultsThe self-attention model outperformed the other models in terms of prediction accuracy. On the test set, the RMSE of the self-attention model was approximately 7.41% lower than that of the LSTM model, MAE was reduced by about 10.99%, and MAPE was reduced by approximately 9.87%. Compared to the ARIMA model, RMSE was reduced by about 28.86%, MAE by about 32.22%, and MAPE by approximately 29.89%.ConclusionThe self-attention model can effectively improve the prediction accuracy of tuberculosis cases, providing guidance for health departments optimizing of health resources and medical service allocation.
引用
收藏
页数:13
相关论文
共 41 条
[21]  
Nguyen TN, 2021, J Health Inf Dev Ctries, V15
[22]   Novel analysis of nonlinear dynamics of a fractional model for tuberculosis disease via the generalized Caputo fractional derivative operator (case study of Nigeria) [J].
Rashid, Saima ;
Guerrero Sanchez, Yolanda ;
Singh, Jagdev ;
Abualnaja, Khadijah M. .
AIMS MATHEMATICS, 2022, 7 (06) :10096-10121
[23]   Hybrid approaches based on SARIMA and artificial neural networks for inspection time series forecasting [J].
Ruiz-Aguilar, J. J. ;
Turias, I. J. ;
Jimenez-Come, M. J. .
TRANSPORTATION RESEARCH PART E-LOGISTICS AND TRANSPORTATION REVIEW, 2014, 67 :1-13
[24]   Modeling Global Monkeypox Infection Spread Data: A Comparative Study of Time Series Regression and Machine Learning Models [J].
Singh, Vishwajeet ;
Khan, Saif Ali ;
Yadav, Subhash Kumar ;
Akhter, Yusuf .
CURRENT MICROBIOLOGY, 2024, 81 (01)
[25]   Exploring Self-Attention Mechanisms for Speech Separation [J].
Subakan, Cem ;
Ravanelli, Mirco ;
Cornell, Samuele ;
Grondin, Francois ;
Bronzi, Mirko .
IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2023, 31 :2169-2180
[26]   The Prediction of Influenza-like Illness and Respiratory Disease Using LSTM and ARIMA [J].
Tsan, Yu-Tse ;
Chen, Der-Yuan ;
Liu, Po-Yu ;
Kristiani, Endah ;
Nguyen, Kieu Lan Phuong ;
Yang, Chao-Tung .
INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH, 2022, 19 (03)
[27]   Predicting the Long-Term Dependencies in Time Series Using Recurrent Artificial Neural Networks [J].
Ubal, Cristian ;
Di-Giorgi, Gustavo ;
Contreras-Reyes, Javier E. ;
Salas, Rodrigo .
MACHINE LEARNING AND KNOWLEDGE EXTRACTION, 2023, 5 (04) :1340-1358
[28]  
Vaswani A, 2017, ADV NEUR IN, V30
[29]   The burden of travel for care and its influencing factors in China: An inpatient-based study of travel time [J].
Wang, Qingyu ;
Jiang, Qingling ;
Yang, Yili ;
Pan, Jay .
JOURNAL OF TRANSPORT & HEALTH, 2022, 25
[30]   Comparison of ARIMA and GM(1,1) models for prediction of hepatitis B in China [J].
Wang, Ya-wen ;
Shen, Zhong-zhou ;
Jiang, Yu .
PLOS ONE, 2018, 13 (09)