Enhancing wound healing through deep reinforcement learning for optimal therapeutics

被引:0
|
作者
Lu, Fan [1 ]
Zlobina, Ksenia [1 ]
Rondoni, Nicholas A. [1 ]
Teymoori, Sam [1 ]
Gomez, Marcella [1 ]
机构
[1] Univ Calif Santa Cruz, Baskin Sch Engn, Appl Math, Santa Cruz, CA 95064 USA
来源
ROYAL SOCIETY OPEN SCIENCE | 2024年 / 11卷 / 07期
关键词
deep learning; reinforcement learning; optimal adaptive control; wound healing; optimal treatment regime; CLOSED-LOOP CONTROL; PROPOFOL ANESTHESIA; SYSTEMS; DRUG; APPROXIMATION;
D O I
10.1098/rsos.240228
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Finding the optimal treatment strategy to accelerate wound healing is of utmost importance, but it presents a formidable challenge owing to the intrinsic nonlinear nature of the process. We propose an adaptive closed-loop control framework that incorporates deep learning, optimal control and reinforcement learning to accelerate wound healing. By adaptively learning a linear representation of nonlinear wound healing dynamics using deep learning and interactively training a deep reinforcement learning agent for tracking the optimal signal derived from this representation without the need for intricate mathematical modelling, our approach has not only successfully reduced the wound healing time by 45.56% compared to the one without any treatment, but also demonstrates the advantages of offering a safer and more economical treatment strategy. The proposed methodology showcases a significant potential for expediting wound healing by effectively integrating perception, predictive modelling and optimal adaptive control, eliminating the need for intricate mathematical models.
引用
收藏
页数:17
相关论文
共 50 条
  • [21] Deep Learning and Reinforcement Learning for Assessing and Enhancing Academic Performance in University Students: A Scoping Review
    Stasolla, Fabrizio
    Zullo, Antonio
    Maniglio, Roberto
    Passaro, Anna
    Di Gioia, Mariacarla
    Curcio, Enza
    Martini, Elvira
    AI, 2025, 6 (02)
  • [22] Learning to Navigate Through Complex Dynamic Environment With Modular Deep Reinforcement Learning
    Wang, Yuanda
    He, Haibo
    Sun, Changyin
    IEEE TRANSACTIONS ON GAMES, 2018, 10 (04) : 400 - 412
  • [23] From Reinforcement Learning to Deep Reinforcement Learning: An Overview
    Agostinelli, Forest
    Hocquet, Guillaume
    Singh, Sameer
    Baldi, Pierre
    BRAVERMAN READINGS IN MACHINE LEARNING: KEY IDEAS FROM INCEPTION TO CURRENT STATE, 2018, 11100 : 298 - 328
  • [24] Enhancing of Wound Healing in Burn Patients through Candida albicans β-Glucan
    Abedini, Fateme
    Mohammadi, Shahla Roudbar
    Dahmardehei, Mostafa
    Ajami, Marjan
    Salimi, Maryam
    Khalandi, Halala
    Mohsenzadegan, Monireh
    Seif, Farhad
    Shirvan, Bahador Nikoueian
    Yaalimadad, Sanaz
    Roudbary, Maryam
    Rodrigues, Celia F.
    JOURNAL OF FUNGI, 2022, 8 (03)
  • [25] Enhancing wound healing through innovative technologies: microneedle patches and iontophoresis
    Jin, Yong Xun
    Chien, Pham Ngoc
    Nga, Pham Thi
    Zhang, Xin Rui
    Giang, Nguyen Ngan
    Le, Linh Thi Thuy
    Trinh, Thuy-Tien Thi
    Zhou, Shu Yi
    Nam, Sun Young
    Heo, Chan Yeong
    FRONTIERS IN BIOENGINEERING AND BIOTECHNOLOGY, 2024, 12
  • [26] Autonomous exploration through deep reinforcement learning
    Yan, Xiangda
    Huang, Jie
    He, Keyan
    Hong, Huajie
    Xu, Dasheng
    INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION, 2023, 50 (05): : 793 - 803
  • [27] Enhancing the Crowdsourced Live Streaming: a Deep Reinforcement Learning Approach
    Zhang, Rui-Xiao
    Huang, Tianchi
    Ma, Ming
    Pang, Haitian
    Yao, Xin
    Wu, Chenglei
    Sun, Lifeng
    PROCEEDINGS OF THE 29TH ACM WORKSHOP ON NETWORK AND OPERATING SYSTEMS SUPPORT FOR DIGITAL AUDIO AND VIDEO (NOSSDAV'19), 2019, : 55 - 60
  • [28] Enhancing Navigational Performance with Holistic Deep-Reinforcement-Learning
    Meusel, Marvin
    Kaestner, Linh
    Bhuiyan, Teham
    Lambrecht, Jens
    INTELLIGENT AUTONOMOUS SYSTEMS 18, VOL 1, IAS18-2023, 2024, 795 : 57 - 69
  • [29] Transfer Learning in Deep Reinforcement Learning
    Islam, Tariqul
    Abid, Dm. Mehedi Hasan
    Rahman, Tanvir
    Zaman, Zahura
    Mia, Kausar
    Hossain, Ramim
    PROCEEDINGS OF SEVENTH INTERNATIONAL CONGRESS ON INFORMATION AND COMMUNICATION TECHNOLOGY, ICICT 2022, VOL 1, 2023, 447 : 145 - 153
  • [30] Enhancing deep reinforcement learning for scale flexibility in real-time strategy games
    Lemos, Marcelo Luiz Harry Diniz
    Vieira, Ronaldo Silva
    Tavares, Anderson Rocha
    Marcolino, Leandro Soriano
    Chaimowicz, Luiz
    ENTERTAINMENT COMPUTING, 2025, 52