Deep reinforcement learning for time-critical wilderness search and rescue using drones

被引:0
|
作者
Ewers, Jan-Hendrik [1 ]
Anderson, David [1 ]
Thomson, Douglas [1 ]
机构
[1] Univ Glasgow, Autonomous Syst & Connect, Glasgow City, Scotland
来源
FRONTIERS IN ROBOTICS AND AI | 2025年 / 11卷
基金
英国工程与自然科学研究理事会;
关键词
reinforcement learning; search planning; mission planning; autonomous systems; wilderness search and rescue; unmanned aerial vehicle; machine learning;
D O I
10.3389/frobt.2024.1527095
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Traditional search and rescue methods in wilderness areas can be time-consuming and have limited coverage. Drones offer a faster and more flexible solution, but optimizing their search paths is crucial for effective operations. This paper proposes a novel algorithm using deep reinforcement learning to create efficient search paths for drones in wilderness environments. Our approach leverages a priori data about the search area and the missing person in the form of a probability distribution map. This allows the policy to learn optimal flight paths that maximize the probability of finding the missing person quickly. Experimental results show that our method achieves a significant improvement in search times compared to traditional coverage planning and search planning algorithms by over 160 % , a difference that can mean life or death in real-world search operations Additionally, unlike previous work, our approach incorporates a continuous action space enabled by cubature, allowing for more nuanced flight patterns.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Drones Chasing Drones: Reinforcement Learning and Deep Search Area Proposal
    Akhloufi, Moulay A.
    Arola, Sebastien
    Bonnet, Alexandre
    DRONES, 2019, 3 (03) : 1 - 14
  • [2] Deep Reinforcement Learning for Autonomous Search and Rescue
    Zuluaga, Juan Gonzalo Carcamo
    Leidig, Jonathan P.
    Trefftz, Christian
    Wolffe, Greg
    NAECON 2018 - IEEE NATIONAL AEROSPACE AND ELECTRONICS CONFERENCE, 2018, : 521 - 524
  • [3] Coverage path planning for maritime search and rescue using reinforcement learning
    Ai, Bo
    Jia, Maoxin
    Xu, Hanwen
    Xu, Jiangling
    Wen, Zhen
    Li, Benshuai
    Zhang, Dan
    OCEAN ENGINEERING, 2021, 241
  • [4] A Reinforcement Learning Based Resource Management Approach for Time-critical Workloads in Distributed Computing Environment
    Liu, Zixia
    Zhang, Hong
    Rao, Bingbing
    Wang, Liqiang
    2018 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2018, : 252 - 261
  • [5] Dynamic Data Streams for Time-Critical IoT Systems in Energy-Aware IoT Devices Using Reinforcement Learning
    Habeeb, Fawzy
    Szydlo, Tomasz
    Kowalski, Lukasz
    Noor, Ayman
    Thakker, Dhaval
    Morgan, Graham
    Ranjan, Rajiv
    SENSORS, 2022, 22 (06)
  • [6] Project Vulture: A Prototype for Using Drones in Search and Rescue Operations
    Quan, Andres
    Herrmann, Charles
    Soliman, Hamdy
    2019 15TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING IN SENSOR SYSTEMS (DCOSS), 2019, : 619 - 624
  • [7] Deep Reinforcement Learning for Sponsored Search Real-time Bidding
    Zhao, Jun
    Qiu, Guang
    Guan, Ziyu
    Zhao, Wei
    He, Xiaofei
    KDD'18: PROCEEDINGS OF THE 24TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2018, : 1021 - 1030
  • [8] Robustness challenges in Reinforcement Learning based time-critical cloud resource scheduling: A Meta-Learning based solution
    Liu, Hongyun
    Chen, Peng
    Ouyang, Xue
    Gao, Hui
    Yan, Bing
    Grosso, Paola
    Zhao, Zhiming
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2023, 146 : 18 - 33
  • [9] Learning Relevant Questions for Conversational Product Search using Deep Reinforcement Learning
    Montazeralghaem, Ali
    Allan, James
    WSDM'22: PROCEEDINGS OF THE FIFTEENTH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, 2022, : 746 - 754
  • [10] Deep Reinforcement Learning for Internet of Drones Networks: Issues and Research Directions
    Aboueleneen, Noor
    Alwarafy, Abdulmalik
    Abdallah, Mohamed
    IEEE OPEN JOURNAL OF THE COMMUNICATIONS SOCIETY, 2023, 4 : 671 - 683