Enhancing wound healing through deep reinforcement learning for optimal therapeutics

被引:0
|
作者
Lu, Fan [1 ]
Zlobina, Ksenia [1 ]
Rondoni, Nicholas A. [1 ]
Teymoori, Sam [1 ]
Gomez, Marcella [1 ]
机构
[1] Univ Calif Santa Cruz, Baskin Sch Engn, Appl Math, Santa Cruz, CA 95064 USA
来源
ROYAL SOCIETY OPEN SCIENCE | 2024年 / 11卷 / 07期
关键词
deep learning; reinforcement learning; optimal adaptive control; wound healing; optimal treatment regime; CLOSED-LOOP CONTROL; PROPOFOL ANESTHESIA; SYSTEMS; DRUG; APPROXIMATION;
D O I
10.1098/rsos.240228
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Finding the optimal treatment strategy to accelerate wound healing is of utmost importance, but it presents a formidable challenge owing to the intrinsic nonlinear nature of the process. We propose an adaptive closed-loop control framework that incorporates deep learning, optimal control and reinforcement learning to accelerate wound healing. By adaptively learning a linear representation of nonlinear wound healing dynamics using deep learning and interactively training a deep reinforcement learning agent for tracking the optimal signal derived from this representation without the need for intricate mathematical modelling, our approach has not only successfully reduced the wound healing time by 45.56% compared to the one without any treatment, but also demonstrates the advantages of offering a safer and more economical treatment strategy. The proposed methodology showcases a significant potential for expediting wound healing by effectively integrating perception, predictive modelling and optimal adaptive control, eliminating the need for intricate mathematical models.
引用
收藏
页数:17
相关论文
共 50 条
  • [31] Latency Fairness Optimization on Wireless Networks Through Deep Reinforcement Learning
    Lopez-Sanchez, Maria
    Villena-Rodriguez, Alejandro
    Gomez, Gerardo
    Martin-Vega, Francisco J.
    Aguayo-Torres, Mari Carmen
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (04) : 5407 - 5412
  • [32] A Survey on Deep Reinforcement Learning
    Liu Q.
    Zhai J.-W.
    Zhang Z.-Z.
    Zhong S.
    Zhou Q.
    Zhang P.
    Xu J.
    2018, Science Press (41): : 1 - 27
  • [33] Deep Reinforcement Learning in Medicine
    Jonsson, Anders
    KIDNEY DISEASES, 2019, 5 (01) : 18 - 22
  • [34] Explainability in deep reinforcement learning
    Heuillet, Alexandre
    Couthouis, Fabien
    Diaz-Rodriguez, Natalia
    KNOWLEDGE-BASED SYSTEMS, 2021, 214 (214)
  • [35] A Deep Learning Pipeline for the Segmentation of In Vitro Wound Healing Microscopy Images following Laser Therapy
    Dogru, Dilan
    Ozdemir, Mehmet Akif
    Ozdemir, Gizem Dilara
    Avsar, Nermin Topaloglu
    Guren, Onan
    2022 MEDICAL TECHNOLOGIES CONGRESS (TIPTEKNO'22), 2022,
  • [36] A Maximum Divergence Approach to Optimal Policy in Deep Reinforcement Learning
    Yang, Zhiyou
    Qu, Hong
    Fu, Mingsheng
    Hu, Wang
    Zhao, Yongze
    IEEE TRANSACTIONS ON CYBERNETICS, 2023, 53 (03) : 1499 - 1510
  • [37] Market Making With Signals Through Deep Reinforcement Learning
    Gasperov, Bruno
    Kostanjcar, Zvonko
    IEEE ACCESS, 2021, 9 : 61611 - 61622
  • [38] Supply Chain Synchronization Through Deep Reinforcement Learning
    Jackson, Ilya
    TRANSBALTICA XII: TRANSPORTATION SCIENCE AND TECHNOLOGY, 2022, : 490 - 498
  • [39] Optimal Economic Gas Turbine Dispatch with Deep Reinforcement Learning
    Sage, Manuel
    Staniszewski, Martin
    Zhao, Yaoyao Fiona
    IFAC PAPERSONLINE, 2023, 56 (02): : 10039 - 10044
  • [40] Multi-agent deep reinforcement learning: a survey
    Gronauer, Sven
    Diepold, Klaus
    ARTIFICIAL INTELLIGENCE REVIEW, 2022, 55 (02) : 895 - 943