Graph-Enabled Reinforcement Learning for Time Series Forecasting With Adaptive Intelligence

被引:1
作者
Shaik, Thanveer [1 ]
Tao, Xiaohui [1 ]
Xie, Haoran [2 ]
Li, Lin [3 ]
Yong, Jianming [4 ]
Li, Yuefeng [5 ]
机构
[1] Univ Southern Queensland, Sch Math Physics& Comp, Toowoomba, Qld 4350, Australia
[2] Lingnan Univ, Dept Comp & Decis Sci, Hong Kong, Peoples R China
[3] Wuhan Univ Technol, Sch Comp & Artificial Intelligence, Wuhan 430062, Peoples R China
[4] Univ Southern Queensland, Sch Business, Toowoomba, Qld 4350, Australia
[5] Sch Comp Sci, Queensland Universityof Technol, Brisbane, Qld 4000, Australia
来源
IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE | 2024年 / 8卷 / 04期
基金
澳大利亚研究理事会;
关键词
Monitoring; Predictive models; Forecasting; Vectors; Medical services; Task analysis; Recurrent neural networks; Graph neural networks; reinforcement learning; intelligent monitoring; Bayesian optimization;
D O I
10.1109/TETCI.2024.3398024
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Reinforcement learning (RL) is renowned for its proficiency in modeling sequential tasks and adaptively learning latent data patterns. Deep learning models have been extensively explored and adopted in regression and classification tasks. However, deep learning has limitations, such as the assumption of equally spaced and ordered data, and the inability to incorporate graph structure in time-series prediction. Graph Neural Network (GNN) can overcome these challenges by capturing the temporal dependencies in time-series data effectively. In this study, we propose a novel approach for predicting time-series data using GNN, augmented with Reinforcement Learning(GraphRL) for monitoring. GNNs explicitly integrate the graph structure of the data into the model, enabling them to naturally capture temporal dependencies. This approach facilitates more accurate predictions in complex temporal structures, as encountered in healthcare, traffic, and weather forecasting domains. We further enhance our GraphRL model's performance through fine-tuning with a Bayesian optimization technique. The proposed framework surpasses baseline models in time-series forecasting and monitoring. This study's contributions include introducing a novel GraphRL framework for time-series prediction and demonstrating GNNs' efficacy compared to traditional deep learning models, such as Recurrent Neural Networks (RNN) and Long Short-Term Memory Networks(LSTM). Overall, this study underscores the potential of GraphRL in yielding accurate and efficient predictions within dynamic RL environments.
引用
收藏
页码:2908 / 2918
页数:11
相关论文
共 40 条
  • [1] Predicting Intensive Care Unit Length of Stay and Mortality Using Patient Vital Signs: Machine Learning Model Development and Validation
    Alghatani, Khalid
    Ammar, Nariman
    Rezgui, Abdelmounaam
    Shaban-Nejad, Arash
    [J]. JMIR MEDICAL INFORMATICS, 2021, 9 (05)
  • [2] Deep reinforcement learning meets graph neural networks: Exploring a routing optimization use case
    Almasan, Paul
    Suarez-Varela, Jose
    Rusek, Krzysztof
    Barlet-Ros, Pere
    Cabellos-Aparicio, Albert
    [J]. COMPUTER COMMUNICATIONS, 2022, 196 : 184 - 194
  • [3] Vital Signs Prediction for COVID-19 Patients in ICU
    Amer, Ahmed Youssef Ali
    Wouters, Femke
    Vranken, Julie
    Dreesen, Pauline
    de Korte-de Boer, Dianne
    van Rosmalen, Frank
    van Bussel, Bas C. T.
    Smit-Fun, Valerie
    Duflot, Patrick
    Guiot, Julien
    van der Horst, Iwan C. C.
    Mesotten, Dieter
    Vandervoort, Pieter
    Aerts, Jean-Marie
    Vanrumste, Bart
    [J]. SENSORS, 2021, 21 (23)
  • [4] VITAL SIGNS DATA AND PROBABILITY OF HOSPITALIZATION, TRANSFER TO ANOTHER FACILITY, OR EMERGENCY DEPARTMENT DEATH AMONG ADULTS PRESENTING FOR MEDICAL ILLNESSES TO THE EMERGENCY DEPARTMENT AT A LARGE URBAN HOSPITAL IN THE UNITED STATES
    Asiimwe, Stephen B.
    Vittinghoff, Eric
    Whooley, Mary
    [J]. JOURNAL OF EMERGENCY MEDICINE, 2020, 58 (04) : 570 - 579
  • [5] Bai J. Z., 2018, ARXIV
  • [6] Baig MM, 2016, PROCEEDINGS OF THE 2016 IEEE REGION 10 CONFERENCE (TENCON), P2943, DOI 10.1109/TENCON.2016.7848584
  • [7] Chen K., 2022, ARXIV
  • [8] Cho K., 2014, P SSST 2014 8 WORKSH, DOI [10.3115/v1/w14-4012, DOI 10.3115/V1/W14-4012]
  • [9] HLGST: Hybrid local-global spatio-temporal model for travel time estimation using Siamese graph convolutional with triplet networks
    Elsir, Alfateh M. Tag
    Khaled, Alkilane
    Shen, Yanming
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2023, 229
  • [10] Can the artificial intelligence technique of reinforcement learning use continuously-monitored digital data to optimize treatment for weight loss?
    Forman, Evan M.
    Kerrigan, Stephanie G.
    Butryn, Meghan L.
    Juarascio, Adrienne S.
    Manasse, Stephanie M.
    Ontanon, Santiago
    Dallal, Diane H.
    Crochiere, Rebecca J.
    Moskow, Danielle
    [J]. JOURNAL OF BEHAVIORAL MEDICINE, 2019, 42 (02) : 276 - 290