Enhancing wound healing through deep reinforcement learning for optimal therapeutics

被引:0
|
作者
Lu, Fan [1 ]
Zlobina, Ksenia [1 ]
Rondoni, Nicholas A. [1 ]
Teymoori, Sam [1 ]
Gomez, Marcella [1 ]
机构
[1] Univ Calif Santa Cruz, Baskin Sch Engn, Appl Math, Santa Cruz, CA 95064 USA
来源
ROYAL SOCIETY OPEN SCIENCE | 2024年 / 11卷 / 07期
关键词
deep learning; reinforcement learning; optimal adaptive control; wound healing; optimal treatment regime; CLOSED-LOOP CONTROL; PROPOFOL ANESTHESIA; SYSTEMS; DRUG; APPROXIMATION;
D O I
10.1098/rsos.240228
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Finding the optimal treatment strategy to accelerate wound healing is of utmost importance, but it presents a formidable challenge owing to the intrinsic nonlinear nature of the process. We propose an adaptive closed-loop control framework that incorporates deep learning, optimal control and reinforcement learning to accelerate wound healing. By adaptively learning a linear representation of nonlinear wound healing dynamics using deep learning and interactively training a deep reinforcement learning agent for tracking the optimal signal derived from this representation without the need for intricate mathematical modelling, our approach has not only successfully reduced the wound healing time by 45.56% compared to the one without any treatment, but also demonstrates the advantages of offering a safer and more economical treatment strategy. The proposed methodology showcases a significant potential for expediting wound healing by effectively integrating perception, predictive modelling and optimal adaptive control, eliminating the need for intricate mathematical models.
引用
收藏
页数:17
相关论文
共 50 条
  • [41] Reinforcement learning for control: Performance, stability, and deep approximators
    Busoniu, Lucian
    de Bruin, Tim
    Tolic, Domagoj
    Kober, Jens
    Palunko, Ivana
    ANNUAL REVIEWS IN CONTROL, 2018, 46 : 8 - 28
  • [42] Applications of Deep Reinforcement Learning in Communications and Networking: A Survey
    Luong, Nguyen Cong
    Hoang, Dinh Thai
    Gong, Shimin
    Niyato, Dusit
    Wang, Ping
    Liang, Ying-Chang
    Kim, Dong In
    IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2019, 21 (04): : 3133 - 3174
  • [43] Cellular therapeutics and immunotherapies in wound healing - on the pulse of time?
    Huelsboemer, Lioba
    Knoedler, Leonard
    Kochen, Alejandro
    Yu, Catherine T.
    Hosseini, Helia
    Hollmann, Katharina S.
    Choi, Ashley E.
    Stogner, Viola A.
    Knoedler, Samuel
    Hsia, Henry C.
    Pomahac, Bohdan
    Kauke-Navarro, Martin
    MILITARY MEDICAL RESEARCH, 2024, 11 (01)
  • [44] Antimicrobial Peptides: The Promising Therapeutics for Cutaneous Wound Healing
    Miao, Fengze
    Li, Ying
    Tai, Zongguang
    Zhang, Yong
    Gao, Yue
    Hu, Menghong
    Zhu, Quangang
    MACROMOLECULAR BIOSCIENCE, 2021, 21 (10)
  • [45] A survey on deep learning and deep reinforcement learning in robotics with a tutorial on deep reinforcement learning
    Morales, Eduardo F.
    Murrieta-Cid, Rafael
    Becerra, Israel
    Esquivel-Basaldua, Marco A.
    INTELLIGENT SERVICE ROBOTICS, 2021, 14 (05) : 773 - 805
  • [46] Engineering nanoparticle therapeutics for impaired wound healing in diabetes
    Shamiya, Yasmeen
    Ravi, Shruthi Polla
    Coyle, Ali
    Chakrabarti, Subrata
    Paul, Arghya
    DRUG DISCOVERY TODAY, 2022, 27 (04) : 1156 - 1166
  • [47] A survey on deep learning and deep reinforcement learning in robotics with a tutorial on deep reinforcement learning
    Eduardo F. Morales
    Rafael Murrieta-Cid
    Israel Becerra
    Marco A. Esquivel-Basaldua
    Intelligent Service Robotics, 2021, 14 : 773 - 805
  • [48] An Intelligent Framework for English Teaching through Deep Learning and Reinforcement Learning with Interactive Mobile Technology
    Hu J.
    Jin G.
    Int. J. Interact. Mob. Technol., 2024, 9 (74-87): : 74 - 87
  • [49] IFRIT: Focused Testing through Deep Reinforcement Learning
    Romdhana, Andrea
    Ceccato, Mariano
    Merlo, Alessio
    Tonella, Paolo
    2022 IEEE 15TH INTERNATIONAL CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION (ICST 2022), 2022, : 24 - 34
  • [50] ENHANCING BATTERY STORAGE ENERGY ARBITRAGE WITH DEEP REINFORCEMENT LEARNING AND TIME-SERIES FORECASTING
    Sage, Manuel
    Campbell, Joshua
    Zhao, Yaoyao Fiona
    PROCEEDINGS OF ASME 2024 18TH INTERNATIONAL CONFERENCE ON ENERGY SUSTAINABILITY, ES2024, 2024,