Deep Learning for Victims Detection from Virtual and Real Search and Rescue Environments

被引:4
作者
Cruz Ulloa, Christyan [1 ]
Garcia, Miguel [1 ]
del Cerro, Jaime [1 ]
Barrientos, Antonio [1 ]
机构
[1] Univ Politecn Madrid, Consejo Super Invest Cient, Ctr Automat & Robot, Madrid 28006, Spain
来源
ROBOT2022: FIFTH IBERIAN ROBOTICS CONFERENCE: ADVANCES IN ROBOTICS, VOL 2 | 2023年 / 590卷
关键词
Virtual reality; Deep learning; Convolutional neural networks; ROS; Search and rescue; Unity; Quadruped robot;
D O I
10.1007/978-3-031-21062-4_1
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Robotic interventions in post-disaster environments to carry out search and rescue explorations allow optimizing time for identifying victims and safeguarding the rescuer's integrity. The rising in the neural networks field and their application in image detection algorithms have made it possible to facilitate the early detection of victims in these first phases of exploration. This article analyses the effectiveness of applying neural network models obtained from training with different datasets of both: images captured in real environments and synthetic images from recreated virtual post-disaster environments for detecting victims. For this development, tests have been carried out in environments at the ETSII-Universidad Politecnica de Madrid, generating models from images obtained with the ARTU-R robot (A1 Rescue Task UPM Robot) and have been validated with real search and rescue exercises at the University of Malaga. The main results show that the models obtained from virtual environments apply to real ones.
引用
收藏
页码:3 / 13
页数:11
相关论文
共 22 条
[1]  
Blackburn M.R, 2002, After action report to the jointprogram office: center for the robotic assisted search and rescue (CRASAR) related efforts at the world trade center
[2]  
Borkman S., 2021, arXiv
[3]   Validating The Search and Rescue Game Environment As A Robot Simulator By Performing A Simulated Anomaly Detection Task [J].
Craighead, Jeff ;
Gutierrez, Rodrigo ;
Burke, Jennifer ;
Murphy, Robin .
2008 IEEE/RSJ INTERNATIONAL CONFERENCE ON ROBOTS AND INTELLIGENT SYSTEMS, VOLS 1-3, CONFERENCE PROCEEDINGS, 2008, :2289-2295
[4]   Autonomous Thermal Vision Robotic System for Victims Recognition in Search and Rescue Missions [J].
Cruz Ulloa, Christyan ;
Prieto Sanchez, Guillermo ;
Barrientos, Antonio ;
Del Cerro, Jaime .
SENSORS, 2021, 21 (21)
[5]  
Eguchi R., 2012, tech. rep.
[6]  
Hartawan DR, 2019, 2019 IEEE INTERNATIONAL CONFERENCE ON INDUSTRY 4.0, ARTIFICIAL INTELLIGENCE, AND COMMUNICATIONS TECHNOLOGY (IAICT), P105, DOI [10.1109/iciaict.2019.8784782, 10.1109/ICIAICT.2019.8784782]
[7]   Multi-Robot Interfaces and Operator Situational Awareness: Study of the Impact of Immersion and Prediction [J].
Jesus Roldan, Juan ;
Pena-Tapia, Elena ;
Martin-Barrio, Andres ;
Olivares-Mendez, Miguel A. ;
Del Cerro, Jaime ;
Barrientos, Antonio .
SENSORS, 2017, 17 (08)
[8]  
Kruijff-Korbayová I, 2016, IEEE INT SYMP SAFE, P278, DOI 10.1109/SSRR.2016.7784314
[9]  
Lee Yong-Hwan, 2020, [Journal of the Semiconductor & Display Technology, 반도체디스플레이기술학회지], V19, P85
[10]   Agricultural Greenhouses Detection in High-Resolution Satellite Images Based on Convolutional Neural Networks: Comparison of Faster R-CNN, YOLO v3 and SSD [J].
Li, Min ;
Zhang, Zhijie ;
Lei, Liping ;
Wang, Xiaofan ;
Guo, Xudong .
SENSORS, 2020, 20 (17) :1-14