An augmented reality software suite enabling seamless human robot interaction

被引:35
作者
Aivaliotis, Sotiris [1 ]
Lotsaris, Konstantinos [1 ]
Gkournelos, Christos [1 ]
Fourtakas, Nikolaos [1 ]
Koukas, Spyridon [1 ]
Kousi, Niki [1 ]
Makris, Sotiris [1 ]
机构
[1] Univ Patras, Lab Mfg Syst & Automat, Dept Mech Engn & Aeronaut, Patras 26504, Greece
基金
欧盟地平线“2020”;
关键词
Augmented reality; human-robot interaction; digital twin; flexible production systems; DIGITAL TWIN; INDUSTRY; 4.0; SYSTEMS; FUTURE;
D O I
10.1080/0951192X.2022.2104459
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
This paper presents an Augmented Reality software suite aiming at supporting the operator's interaction with flexible mobile robot workers. The developed AR suite, integrated with the shopfloor's Digital Twin, provides the operators' a) virtual interfaces to easily program the mobile robots b) information on the process and the production status, c) safety awareness by superimposing the active safety zones around the robots and d) instructions for recovering the system from unexpected events. The application's purpose is to simplify and accelerate the industrial manufacturing process by introducing an easy and intuitive way of interaction with the hardware, without requiring special programming skills or long training from the human operators. The proposed software is developed for the Microsoft's HoloLens Mixed Reality Headset 2, integrated with Robotic Operation System (ROS), and it has been tested in a case study inspired from the automotive industry.
引用
收藏
页码:3 / 29
页数:27
相关论文
共 65 条
[1]   AR-Enhanced Human-Robot-Interaction - Methodologies, Algorithms, Tools [J].
Andersson, Nils ;
Argyrou, Angelos ;
Nagele, Frank ;
Ubis, Fernando ;
Campos, Urko Esnaola ;
de Zarate, Maite Ortiz ;
Wilterdink, Robert .
6TH CIRP CONFERENCE ON ASSEMBLY TECHNOLOGIES AND SYSTEMS (CATS), 2016, 44 :193-198
[2]  
[Anonymous], Mixed Reality Toolkit
[3]  
[Anonymous], 2021, Unity
[4]  
[Anonymous], 2021, SAFETY LASER SCANNER
[5]   Effects of augmented reality glasses on the cognitive load of assembly operators in the automotive industry [J].
Atici-Ulusu, Hilal ;
Ikiz, Yagmur Dila ;
Taskapilioglu, Ozlem ;
Gunduz, Tulin .
INTERNATIONAL JOURNAL OF COMPUTER INTEGRATED MANUFACTURING, 2021, 34 (05) :487-499
[6]   A survey of augmented reality [J].
Azuma, RT .
PRESENCE-VIRTUAL AND AUGMENTED REALITY, 1997, 6 (04) :355-385
[7]   A Survey on Digital Twin: Definitions, Characteristics, Applications, and Design Implications [J].
Barricelli, Barbara Rita ;
Casiraghi, Elena ;
Fogli, Daniela .
IEEE ACCESS, 2019, 7 :167653-167671
[8]   Enabling Flexibility in Manufacturing by Integrating Shopfloor and Process Perception for Mobile Robot Workers [J].
Bavelos, Angelos Christos ;
Kousi, Niki ;
Gkournelos, Christos ;
Lotsaris, Konstantinos ;
Aivaliotis, Sotiris ;
Michalos, George ;
Makris, Sotiris .
APPLIED SCIENCES-BASEL, 2021, 11 (09)
[9]   Intuitive Robot Programming Using Augmented Reality [J].
Blankemeyer, Sebastian ;
Wiemann, Rolf ;
Posniak, Lukas ;
Pregizer, Christoph ;
Raatz, Annika .
7TH CIRP CONFERENCE ON ASSEMBLY TECHNOLOGIES AND SYSTEMS (CATS 2018), 2018, 76 :155-160
[10]  
Blum T, 2012, INT SYM MIX AUGMENT, P271, DOI 10.1109/ISMAR.2012.6402569