Self-Attention-Based Deep Learning Network for Regional Influenza Forecasting

被引:17
|
作者
Jung, Seungwon [1 ]
Moon, Jaeuk [1 ]
Park, Sungwoo [1 ]
Hwang, Eenjun [1 ]
机构
[1] Korea Univ, Sch Elect Engn, Seoul 02841, South Korea
关键词
Artificial neural networks; deep learning; regional influenza forecasting; self-attention; NEURAL-NETWORKS; NUMBER; MODEL;
D O I
10.1109/JBHI.2021.3093897
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Early prediction of influenza plays an important role in minimizing the damage caused, as it provides the resources and time needed to formulate preventive measures. Compared to traditional mechanistic approach, deep/machine learning-based models have demonstrated excellent forecasting performance by efficiently handling various data such as weather and internet data. However, due to the limited availability and reliability of such data, many forecasting models use only historical occurrence data and formulate the influenza forecasting as a multivariate time-series task. Recently, attention mechanisms have been exploited to deal with this issue by selecting valuable data in the input data and giving them high weights. Particularly, self-attention has shown its potential in various forecasting tasks by utilizing the predictive relationship between objects from the input data describing target objects. Hence, in this study, we propose a forecasting model based on self-attention for regional influenza forecasting, called SAIFlu-Net. The model exploits a long short-term memory network for extracting time-series patterns of each region and the self-attention mechanism to find the similarities between the occurrence patterns. To evaluate its performance, we conducted extensive experiments with existing forecasting models using weekly regional influenza datasets. The results show that the proposed model outperforms other models in terms of root mean square error and Pearson correlation coefficient.
引用
收藏
页码:922 / 933
页数:12
相关论文
共 50 条
  • [1] A Self-Attention-Based Deep Reinforcement Learning Approach for AGV Dispatching Systems
    Wei, Qinglai
    Yan, Yutian
    Zhang, Jie
    Xiao, Jun
    Wang, Cong
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (06) : 7911 - 7922
  • [2] RESEAT: Recurrent Self-Attention Network for Multi-Regional Influenza Forecasting
    Moon, Jaeuk
    Jung, Seungwon
    Park, Sungwoo
    Hwang, Eenjun
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2023, 27 (05) : 2585 - 2596
  • [3] AttnPep: A Self-Attention-Based Deep Learning Method for Peptide Identification in Shotgun Proteomics
    Li, Yulin
    He, Qingzu
    Guo, Huan
    Shuai, Stella C.
    Cheng, Jinyan
    Liu, Liyu
    Shuai, Jianwei
    JOURNAL OF PROTEOME RESEARCH, 2024, 23 (02) : 834 - 843
  • [4] A Self-Attention-Based Deep Learning Model for Estimating Global Phytoplankton Pigment Profiles
    Yang, Yi
    Li, Xiaolong
    Li, Xiaofeng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [5] A self-attention-based deep architecture for online handwriting recognition
    Molavi S.A.
    BabaAli B.
    Neural Computing and Applications, 2024, 36 (27) : 17165 - 17179
  • [6] EAML: ensemble self-attention-based mutual learning network for document image classification
    Bakkali, Souhail
    Ming, Zuheng
    Coustaty, Mickael
    Rusinol, Marcal
    INTERNATIONAL JOURNAL ON DOCUMENT ANALYSIS AND RECOGNITION, 2021, 24 (03) : 251 - 268
  • [7] EAML: ensemble self-attention-based mutual learning network for document image classification
    Souhail Bakkali
    Zuheng Ming
    Mickaël Coustaty
    Marçal Rusiñol
    International Journal on Document Analysis and Recognition (IJDAR), 2021, 24 : 251 - 268
  • [8] Spatiotemporal Self-Attention-Based Network Traffic Prediction in IIoT
    Liu, Xiaoteng
    Huang, Chuanhe
    Abbas Ashraf, M. Wasim
    Huang, Shidong
    Chen, Yirong
    Wireless Communications and Mobile Computing, 2023, 2023
  • [9] hERG-Att: Self-attention-based deep neural network for predicting hERG blockers
    Kim, Hyunho
    Nam, Hojung
    COMPUTATIONAL BIOLOGY AND CHEMISTRY, 2020, 87
  • [10] Self-Attention-Based Temporary Curiosity in Reinforcement Learning Exploration
    Hu, Hangkai
    Song, Shiji
    Huang, Gao
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2021, 51 (09): : 5773 - 5784