A Novel Robot Teaching System Based on Mixed Reality

被引:0
作者
Xu, Yang [1 ]
Yang, Chenguang [1 ]
Liu, Xiaofeng [2 ]
Li, Zhijun [1 ]
机构
[1] South China Univ Technol, Sch Automat Sci & Engn, Key Lab Autonomous Syst & Networked Control, Guangzhou 510641, Guangdong, Peoples R China
[2] Hohai Univ, Nanjing, Jiangsu, Peoples R China
来源
2018 3RD IEEE INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS AND MECHATRONICS (IEEE ICARM) | 2018年
关键词
Robot Teaching; Mixed Reality; Teaching by Demonstration; Extreme Learning Machine; EXTREME LEARNING-MACHINE;
D O I
暂无
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we have developed a robot teaching system where the robot learns the point-to-point motions from human demonstrations. In the demonstration phase, the operator's gestures and palm position are used to guide the robot to complete the task. At the same time, the scene of robots and its work environment, and the virtual model of the palms are integrated into Unity. Then the mixed reality scene is transferred to a virtual reality(VR) helmet, which provides operator real-lime visual feedback. In the learning and reproduction phase, the Extreme Learning Machine(ELM) is used to generate a new trajectory from the training data. The experimental result shows that the robot teaching system based on mixed reality has more realistic and natural interaction. And the learning algorithm based on ELM has a good fitting ability.
引用
收藏
页码:250 / 255
页数:6
相关论文
共 21 条
[1]  
[Anonymous], 2016, ADV TECHNOLOGIES MOD
[2]  
[Anonymous], 2017, NEUROCOMPUTING
[3]  
Calinon S., 2009, Robot programming by demonstration-a probabilistic approach, robot programming by demonstration-a probabilistic approach
[4]   On learning, representing, and generalizing a task in a humanoid robot [J].
Calinon, Sylvain ;
Guenter, Florent ;
Billard, Aude .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2007, 37 (02) :286-298
[5]  
Chen CZ, 2017, 2017 2ND INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS AND MECHATRONICS (ICARM), P523, DOI 10.1109/ICARM.2017.8273217
[6]  
Chessa M., 2016, HUMAN COMPUTER INTER
[7]  
Desai ParthRajesh., 2014, INT J ENG TRENDS TEC, V13
[8]  
Hodson H.L., 2013, NEW SCI, V218, P21
[9]   Extreme learning machine: Theory and applications [J].
Huang, Guang-Bin ;
Zhu, Qin-Yu ;
Siew, Chee-Kheong .
NEUROCOMPUTING, 2006, 70 (1-3) :489-501
[10]   Extreme Learning Machine for Regression and Multiclass Classification [J].
Huang, Guang-Bin ;
Zhou, Hongming ;
Ding, Xiaojian ;
Zhang, Rui .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2012, 42 (02) :513-529