Augmented Reality-Based Interface for Bimanual Robot Teleoperation

被引:14
作者
Garcia, Alberto [1 ]
Solanes, J. Ernesto [1 ]
Munoz, Adolfo [1 ]
Gracia, Luis [1 ]
Tornero, Josep [1 ]
机构
[1] Univ Politecn Valencia, Inst Diseno & Fabricac, Valencia 46022, Spain
来源
APPLIED SCIENCES-BASEL | 2022年 / 12卷 / 09期
关键词
robot system; augmented reality; robot teleoperation; DUAL-ARM MANIPULATION; VISION; SYSTEM;
D O I
10.3390/app12094379
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Teleoperation of bimanual robots is being used to carry out complex tasks such as surgeries in medicine. Despite the technological advances, current interfaces are not natural to the users, who spend long periods of time in learning how to use these interfaces. In order to mitigate this issue, this work proposes a novel augmented reality-based interface for teleoperating bimanual robots. The proposed interface is more natural to the user and reduces the interface learning process. A full description of the proposed interface is detailed in the paper, whereas its effectiveness is shown experimentally using two industrial robot manipulators. Moreover, the drawbacks and limitations of the classic teleoperation interface using joysticks are analyzed in order to highlight the benefits of the proposed augmented reality-based interface approach.
引用
收藏
页数:24
相关论文
共 76 条
[1]   A Haptic Shared-Control Architecture for Guided Multi-Target Robotic Grasping [J].
Abi-Farraj, Firas ;
Pacchierotti, Claudio ;
Arenz, Oleg ;
Neumann, Gerhard ;
Giordano, Paolo Robuffo .
IEEE TRANSACTIONS ON HAPTICS, 2020, 13 (02) :270-285
[2]  
[Anonymous], 2009, ACM SIGGRAPH ASIA 2009 Art Gallery & Emerging Technologies: Adaptation, DOI [10.1145/1667146.1667160, DOI 10.1145/1667146.1667160]
[3]  
[Anonymous], 2015, UNITY 3D UI ESSENTIA
[4]   Vision-Based Assisted Tele-Operation of a Dual-Arm Hydraulically Actuated Robot for Pipe Cutting and Grasping in Nuclear Environments [J].
Bandala, Manuel ;
West, Craig ;
Monk, Stephen ;
Montazeri, Allahyar ;
Taylor, C. James .
ROBOTICS, 2019, 8 (02)
[5]  
Bian F., P 2018 IEEE INT C IN, DOI [10.1109/icinfa.2018.8812457, DOI 10.1109/ICINFA.2018.8812457]
[6]   Controlling Ocean One: Human-robot collaboration for deep-sea manipulation [J].
Brantner, Gerald ;
Khatib, Oussama .
JOURNAL OF FIELD ROBOTICS, 2021, 38 (01) :28-51
[7]   A brain-actuated robotic arm system using non-invasive hybrid brain-computer interface and shared control strategy [J].
Cao, Linfeng ;
Li, Guangye ;
Xu, Yang ;
Zhang, Heng ;
Shu, Xiaokang ;
Zhang, Dingguo .
JOURNAL OF NEURAL ENGINEERING, 2021, 18 (04)
[8]   Comparison of Gesture, Gamepad, and Gaze-based Locomotion for VR Worlds [J].
Cardoso, Jorge C. S. .
22ND ACM CONFERENCE ON VIRTUAL REALITY SOFTWARE AND TECHNOLOGY (VRST 2016), 2016, :319-320
[9]   Benchmark for Bimanual Robotic Manipulation of Semi-Deformable Objects [J].
Chatzilygeroudis, Konstantinos ;
Fichera, Bernardo ;
Lauzana, Ilaria ;
Bu, Fanjun ;
Yao, Kunpeng ;
Khadivar, Farshad ;
Billard, Aude .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2020, 5 (02) :2443-2450
[10]   Mode Switching-Based Symmetric Predictive Control Mechanism for Networked Teleoperation Space Robot System [J].
Chen, Haifei ;
Huang, Panfeng ;
Liu, Zhengxiong .
IEEE-ASME TRANSACTIONS ON MECHATRONICS, 2019, 24 (06) :2706-2717