Deep reinforcement learning for time-critical wilderness search and rescue using drones

被引:0
|
作者
Ewers, Jan-Hendrik [1 ]
Anderson, David [1 ]
Thomson, Douglas [1 ]
机构
[1] Univ Glasgow, Autonomous Syst & Connect, Glasgow City, Scotland
来源
FRONTIERS IN ROBOTICS AND AI | 2025年 / 11卷
基金
英国工程与自然科学研究理事会;
关键词
reinforcement learning; search planning; mission planning; autonomous systems; wilderness search and rescue; unmanned aerial vehicle; machine learning;
D O I
10.3389/frobt.2024.1527095
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Traditional search and rescue methods in wilderness areas can be time-consuming and have limited coverage. Drones offer a faster and more flexible solution, but optimizing their search paths is crucial for effective operations. This paper proposes a novel algorithm using deep reinforcement learning to create efficient search paths for drones in wilderness environments. Our approach leverages a priori data about the search area and the missing person in the form of a probability distribution map. This allows the policy to learn optimal flight paths that maximize the probability of finding the missing person quickly. Experimental results show that our method achieves a significant improvement in search times compared to traditional coverage planning and search planning algorithms by over 160 % , a difference that can mean life or death in real-world search operations Additionally, unlike previous work, our approach incorporates a continuous action space enabled by cubature, allowing for more nuanced flight patterns.
引用
收藏
页数:10
相关论文
共 50 条
  • [21] MSN: Mapless Short-Range Navigation Based on Time Critical Deep Reinforcement Learning
    Li, Bohan
    Huang, Zhelong
    Chen, Tony Weitong
    Dai, Tianlun
    Zang, Yalei
    Xie, Wenbin
    Tian, Bo
    Cai, Ken
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (08) : 8628 - 8637
  • [22] On Machine Learning Applicability to Transaction Time Prediction for Time-Critical C-ITS Applications
    Stepanov, Nikolai
    Veprev, Albert
    Sharapova, Alexandra
    Alekseeva, Daria
    Komarov, Mikhail
    Lohan, Elena Simona
    Ometov, Aleksandr
    2021 44TH INTERNATIONAL CONFERENCE ON TELECOMMUNICATIONS AND SIGNAL PROCESSING (TSP), 2021, : 408 - 413
  • [23] Application of Deep Learning Technique in UAV's Search and Rescue Operations
    Naing, Kyaw Min
    Zakeri, Ahmad
    Iliev, Oliver
    Venkateshaiah, Navya
    INTELLIGENT SYSTEMS AND APPLICATIONS, VOL 1, 2019, 868 : 893 - 901
  • [24] Autonomous Household Energy Management Using Deep Reinforcement Learning
    Tsang, Nathan
    Cao, Collin
    Wu, Serena
    Yan, Zilin
    Yousefi, Ashkan
    Fred-Ojala, Alexander
    Sidhu, Ikhlaq
    2019 IEEE INTERNATIONAL CONFERENCE ON ENGINEERING, TECHNOLOGY AND INNOVATION (ICE/ITMC), 2019,
  • [25] Control of heap leach piles using deep reinforcement learning
    Canales, Claudio
    Diaz-Quezada, Simon
    Leiva, Francisco
    Estay, Humberto
    Ruiz-del-Solar, Javier
    MINERALS ENGINEERING, 2024, 212
  • [26] Imperfect-Information Game AI Agent Based on Reinforcement Learning Using Tree Search and a Deep Neural Network
    Ouyang, Xin
    Zhou, Ting
    ELECTRONICS, 2023, 12 (11)
  • [27] Solvent extraction process design using deep reinforcement learning
    Plathottam S.J.
    Richey B.
    Curry G.
    Cresko J.
    Iloeje C.O.
    Journal of Advanced Manufacturing and Processing, 2021, 3 (02)
  • [28] Wheel Loader Scooping Controller Using Deep Reinforcement Learning
    Azulay, Osher
    Shapiro, Amir
    IEEE ACCESS, 2021, 9 : 24145 - 24154
  • [29] An Automatic Cost Learning Framework for Image Steganography Using Deep Reinforcement Learning
    Tang, Weixuan
    Li, Bin
    Barni, Mauro
    Li, Jin
    Huang, Jiwu
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2021, 16 : 952 - 967
  • [30] Cooperative USV-UAV marine search and rescue with visual navigation and reinforcement learning-based control
    Wang, Yuanda
    Liu, Wenzhang
    Liu, Jian
    Sun, Changyin
    ISA TRANSACTIONS, 2023, 137 : 222 - 235