Kinesthetic Teaching in Robotics: a Mixed Reality Approach

被引:0
作者
Maccio, Simone [1 ]
Shaaban, Mohamad [1 ]
Carfi, Alessandro [1 ]
Mastrogiovanni, Fulvio [1 ]
机构
[1] Univ Genoa, Dept Informat Bioengn Robot & Syst Engn, Via Opera Pia 13, I-16145 Genoa, Italy
来源
2024 33RD IEEE INTERNATIONAL CONFERENCE ON ROBOT AND HUMAN INTERACTIVE COMMUNICATION, ROMAN 2024 | 2024年
关键词
Human-Robot Interaction; Mixed Reality; Kinesthetic Teaching; Software Architecture; AUGMENTED REALITY;
D O I
10.1109/RO-MAN60168.2024.10731463
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As collaborative robots become more common in manufacturing scenarios and adopted in hybrid human-robot teams, we should develop new interaction and communication strategies to ensure smooth collaboration between agents. In this paper, we propose a novel communicative interface that uses Mixed Reality as a medium to perform Kinesthetic Teaching (KT) on any robotic platform. We evaluate our proposed approach in a user study involving multiple subjects and two different robots, comparing traditional physical KT with holographic-based KT through user experience questionnaires and task-related metrics.
引用
收藏
页码:1610 / 1617
页数:8
相关论文
共 50 条
[31]   New teaching and learning experience with mixed reality technologies [J].
Liu, Wei ;
Cheok, Adrian David ;
Mei-Ling, Charissa Kim ;
Theng, Yin-Leng .
INTERNATIONAL JOURNAL OF ARTS AND TECHNOLOGY, 2008, 1 (02) :173-197
[32]   Mixed Reality as a Teaching Tool for Medical Students in Neurosurgery [J].
Silvero Isidre, Arturo ;
Friederichs, Hendrik ;
Muether, Michael ;
Gallus, Marco ;
Stummer, Walter ;
Holling, Markus .
MEDICINA-LITHUANIA, 2023, 59 (10)
[33]   A remote access mixed reality teaching ward round [J].
Bala, Laksha ;
Kinross, James ;
Martin, Guy ;
Koizia, Louis J. ;
Kooner, Angad S. ;
Shimshon, Gideon J. ;
Hurkxkens, Thomas J. ;
Pratt, Philip J. ;
Sam, Amir H. .
CLINICAL TEACHER, 2021, 18 (04) :386-390
[34]   A Novel Robot Teaching System Based on Mixed Reality [J].
Xu, Yang ;
Yang, Chenguang ;
Liu, Xiaofeng ;
Li, Zhijun .
2018 3RD IEEE INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS AND MECHATRONICS (IEEE ICARM), 2018, :250-255
[35]   Mixed Reality Environment and High-Dimensional Continuification Control for Swarm Robotics [J].
Maffettone, Gian Carlo ;
Liguori, Lorenzo ;
Palermo, Eduardo ;
di Bernardo, Mario ;
Porfiri, Maurizio .
IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, 2024, 32 (06) :2484-2491
[36]   Remote HRI and Mixed Reality, an Ontology [J].
Carolina Cani, D. L. ;
Breyer, Felipe B. ;
Kelner, Judith .
DESIGN, USER EXPERIENCE, AND USABILITY: TECHNOLOGICAL CONTEXTS, PT III, 2016, 9748 :249-257
[37]   Teaching with Disruptive Technology: The Use of Augmented, Virtual, and Mixed Reality (HoloLens) for Disease Education [J].
Stromberga, Zane ;
Phelps, Charlotte ;
Smith, Jessica ;
Moro, Christian .
BIOMEDICAL VISUALISATION, VOL 9, 2021, 1317 :147-162
[38]   Augmented reality approach for metabolic pathways teaching [J].
Vega Garzon, Juan Carlos ;
Magrini, Marcio Luiz ;
da Costa, Caetano ;
Galembeck, Eduardo .
REVISTA DE ENSINO DE BIOQUIMICA, 2014, 12 (02) :129-143
[39]   Teaching Marker-based Augmented Reality in a PBL Based Online Robotics Competition [J].
Sarkar, Abhinav ;
Arya, Kavi .
2020 IEEE 20TH INTERNATIONAL CONFERENCE ON ADVANCED LEARNING TECHNOLOGIES (ICALT 2020), 2020, :338-340
[40]   Mixed reality LVC simulation: A new approach to study pedestrian behaviour [J].
Chen, Minze ;
Yang, Rui ;
Tao, Zhenxiang ;
Zhang, Ping .
BUILDING AND ENVIRONMENT, 2022, 207