Drone Swarm Coordination Using Reinforcement Learning for Efficient Wildfires Fighting

被引:0
作者
Blais M.-A. [1 ,2 ]
Akhloufi M.A. [1 ,2 ]
机构
[1] Dept. of Computer Science, Université de Moncton, Moncton, NB
[2] Perception, Robotics, and Intelligent Machines (PRIME), Université de Moncton, Moncton, NB
基金
加拿大自然科学与工程研究理事会;
关键词
Drones; Intelligent system; Reinforcement learning; Swarm; Wildfires;
D O I
10.1007/s42979-024-02650-6
中图分类号
学科分类号
摘要
Natural events, such as wildfires, pose a serious threat to the human population and cause significant environmental and economic damage. As climate change increases the frequency and intensity of extreme natural events, more efficient solutions are required to mitigate their impacts. One proposed solution is the usage of a swarm of drones and unmanned ground vehicles to extinguish wildfires. Controlling a swarm of drones is a challenging task that requires a complex control system capable of providing a good coordination between multiple vehicles. Artificial intelligence, particularly reinforcement learning, has been proposed as a solution for the autonomous control of a swarm. In this paper, we propose a conceptual system based on reinforcement learning and swarm robotics to efficiently combat wildfires. Our system consists of an overwatch drone and multiple payload drones which are responsible for carrying fire suppressants. The goal of our research is to guide a swarm of payload drones to a wildfire while preserving a tight swarm grouping. Each drone is individually controlled and aware of the position of the goal and the positions of other agents. To compare different algorithms, we tested a DQN, Rainbow DQN and FQF using a simulation and four AirSim scenarios. With our approach, we achieve impressive results in controlling a swarm of drones towards a common goal. Our research demonstrates the possibility of utilizing reinforcement learning to control a swarm of drones for wildfire fighting. © The Author(s), under exclusive licence to Springer Nature Singapore Pte Ltd 2024.
引用
收藏
相关论文
共 113 条
  • [1] Smith A.B., Katz R.W., Us billion-dollar weather and climate disasters: data sources, trends, accuracy and biases, Nat Hazards, 67, 2, pp. 387-410, (2013)
  • [2] Melillo J.M., Richmond T., Yohe G., Et al., Climate change impacts in the United States, Third National Climate Assessment, 52, (2014)
  • [3] Wang D., Guan D., Zhu S., Kinnon M.M., Geng G., Zhang Q., Zheng H., Lei T., Shao S., Gong P., Et al., Economic footprint of California wildfires in 2018, Nat Sustain, 4, 3, pp. 252-260, (2021)
  • [4] Ghali R., Akhloufi M.A., Jmal M., Souidene Mseddi W., Attia R., Wildfire segmentation using deep vision transformers, Remote Sens, 13, 17, (2021)
  • [5] Akhloufi M.A., Tokime R.B., Elassady H., Wildland fires detection and segmentation using deep learning, Pattern Recognition and Tracking XXIX, pp. 86-97, (2018)
  • [6] Aydin B., Selvi E., Tao J., Starek M.J., Use of fire-extinguishing balls for a conceptual system of drone-assisted wildfire fighting, Drones, 3, 1, (2019)
  • [7] Khennou F., Ghaoui J., Akhloufi M.A., Forest fire spread prediction using deep learning, Geospatial Informatics XI, 11733, pp. 106-117, (2021)
  • [8] Mishra B., Garg D., Narang P., Mishra V., Drone-surveillance for search and rescue in natural disaster, Comput Commun, 156, pp. 1-10, (2020)
  • [9] Akhloufi M.A., Couturier A., Castro N.A., Unmanned aerial vehicles for wildland fires: sensing, perception, cooperation and assistance, Drones, 5, 1, (2021)
  • [10] Ghali R., Akhloufi M.A., Mseddi W.S., Deep learning and transformer approaches for UAV-based wildfire detection and segmentation, Sensors, 22, 5, (2022)