Human motion prediction for human-robot collaboration

被引:124
作者
Liu, Hongyi [1 ]
Wang, Lihui [1 ]
机构
[1] KTH Royal Inst Technol, Dept Prod Engn, Stockholm, Sweden
关键词
Human-robot collaboration; Human motion prediction; Assembly;
D O I
10.1016/j.jmsy.2017.04.009
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
In human-robot collaborative manufacturing, industrial robots would work alongside human workers who jointly perform the assigned tasks seamlessly. A human-robot collaborative manufacturing system is more customised and flexible than conventional manufacturing systems. In the area of assembly, a practical human-robot collaborative assembly system should be able to predict a human worker's intention and assist human during assembly operations. In response to the requirement, this research proposes a new human-robot collaborative system design. The primary focus of the paper is to model product assembly tasks as a sequence of human motions. Existing human motion recognition techniques are applied to recognise the human motions. Hidden Markov model is used in the motion sequence to generate a motion transition probability matrix. Based on the result, human motion prediction becomes possible. The predicted human motions are evaluated and applied in task-level human-robot collaborative assembly. (C) 2017 The Society of Manufacturing Engineers. Published by Elsevier Ltd. All rights reserved.
引用
收藏
页码:287 / 294
页数:8
相关论文
共 34 条
[1]  
Bascetta L, 2011, IEEE INT C INT ROBOT, P2971, DOI 10.1109/IROS.2011.6048287
[2]   Advances in 3D data acquisition and processing for industrial applications [J].
Bi, Z. M. ;
Wang, Lihui .
ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2010, 26 (05) :403-413
[3]   Hidden Markov model for human to computer interaction: a study on human hand gesture recognition [J].
Bilal, Sara ;
Akmeliawati, Rini ;
Shafie, Amir A. ;
Salami, Momoh Jimoh E. .
ARTIFICIAL INTELLIGENCE REVIEW, 2013, 40 (04) :495-516
[4]  
Coupete E., 2016, Proceedings of the 3rd International Symposium on Movement and Computing, Thessaloniki, GA, Greece, July 5-6, P1
[5]  
Ding HL, 2017, ADV SOC SCI EDUC HUM, V101, P1
[6]   Learning hierarchical spatio-temporal pattern for human activity prediction [J].
Ding, Wenwen ;
Liu, Kai ;
Cheng, Fei ;
Zhang, Jin .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2016, 35 :103-111
[7]  
Feng KP, 2013, 2013 2ND INTERNATIONAL SYMPOSIUM ON INSTRUMENTATION AND MEASUREMENT, SENSOR NETWORK AND AUTOMATION (IMSNA), P936, DOI 10.1109/IMSNA.2013.6743432
[8]   On Planning and Task Achievement Modalities for Human-Robot Collaboration [J].
Fiore, Michelangelo ;
Clodic, Aurelie ;
Alami, Rachid .
EXPERIMENTAL ROBOTICS, 2016, 109 :293-306
[9]   RETRACTED: Static hand gesture recognition using neural networks (Retracted article. See vol.47,pg.561,2017) [J].
Hasan, Haitham ;
Abdul-Kareem, S. .
ARTIFICIAL INTELLIGENCE REVIEW, 2014, 41 (02) :147-181
[10]  
Hawkins KP, 2013, IEEE-RAS INT C HUMAN, P499, DOI 10.1109/HUMANOIDS.2013.7030020