An augmented reality software suite enabling seamless human robot interaction

被引:35
作者
Aivaliotis, Sotiris [1 ]
Lotsaris, Konstantinos [1 ]
Gkournelos, Christos [1 ]
Fourtakas, Nikolaos [1 ]
Koukas, Spyridon [1 ]
Kousi, Niki [1 ]
Makris, Sotiris [1 ]
机构
[1] Univ Patras, Lab Mfg Syst & Automat, Dept Mech Engn & Aeronaut, Patras 26504, Greece
基金
欧盟地平线“2020”;
关键词
Augmented reality; human-robot interaction; digital twin; flexible production systems; DIGITAL TWIN; INDUSTRY; 4.0; SYSTEMS; FUTURE;
D O I
10.1080/0951192X.2022.2104459
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
This paper presents an Augmented Reality software suite aiming at supporting the operator's interaction with flexible mobile robot workers. The developed AR suite, integrated with the shopfloor's Digital Twin, provides the operators' a) virtual interfaces to easily program the mobile robots b) information on the process and the production status, c) safety awareness by superimposing the active safety zones around the robots and d) instructions for recovering the system from unexpected events. The application's purpose is to simplify and accelerate the industrial manufacturing process by introducing an easy and intuitive way of interaction with the hardware, without requiring special programming skills or long training from the human operators. The proposed software is developed for the Microsoft's HoloLens Mixed Reality Headset 2, integrated with Robotic Operation System (ROS), and it has been tested in a case study inspired from the automotive industry.
引用
收藏
页码:3 / 29
页数:27
相关论文
共 65 条
[11]   Using augmented reality to build digital twin for reconfigurable additive manufacturing system [J].
Cai, Yi ;
Wang, Yi ;
Burnett, Morice .
JOURNAL OF MANUFACTURING SYSTEMS, 2020, 56 :598-604
[12]  
Chandan K., 2019, ARXIV
[13]   MoveIt! [J].
Chitta, Sachin ;
Sucan, Ioan ;
Cousins, Steve .
IEEE ROBOTICS & AUTOMATION MAGAZINE, 2012, 19 (01) :18-19
[14]  
Chryssolouris G., 2006, Manufacturing Systems: Theory and Practice
[15]  
Cogurcu Y.E., 2021, 4 UK RAS C PHD STUDE, DOI [10.31256/Ft3Ex7U, DOI 10.31256/FT3EX7U]
[16]   Assessing Instructions in Augmented Reality for Human-Robot Collaborative Assembly by Using Demonstrators [J].
Danielsson, Oscar ;
Syberfeldt, Anna ;
Brewster, Rodney ;
Wang, Lihui .
MANUFACTURING SYSTEMS 4.0, 2017, 63 :89-94
[17]  
Dianatfar Morteza, 2021, Procedia CIRP, V97, P407, DOI 10.1016/j.procir.2020.05.259
[18]  
Dimitropoulos Nikos, 2021, Procedia CIRP, V97, P464, DOI 10.1016/j.procir.2020.07.006
[19]  
Huy DQ, 2017, 2017 3RD INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND ROBOTICS (ICCAR), P719, DOI 10.1109/ICCAR.2017.7942791
[20]   Augmented and Virtual Reality for Inspection and Maintenance Processes in the Aviation Industry [J].
Eschen, Henrik ;
Koetter, Tobias ;
Rodeck, Rebecca ;
Harnisch, Martin ;
Schueppstuhl, Thorsten .
PROCEEDINGS OF THE 6TH INTERNATIONAL CONFERENCE IN THROUGH-LIFE ENGINEERING SERVICES, 2018, 19 :156-163