A human digital twin approach for fatigue-aware task planning in human-robot collaborative assembly

被引:3
作者
You, Yingchao [1 ]
Cai, Boliang [1 ]
Pham, Duc Truong [2 ]
Liu, Ying [1 ]
Ji, Ze [1 ]
机构
[1] Univ Cardiff, Sch Engn, Cardiff, Wales
[2] UNIV BIRMINGHAM, Mech Engn, BIRMINGHAM, England
关键词
Physical fatigue; Human digital twin; Human-robot collaboration; Human-centric manufacturing; Ergonomics;
D O I
10.1016/j.cie.2024.110774
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Human-robot collaboration (HRC) has emerged as a pivotal paradigm in manufacturing, integrating the strengths of both human and robot capabilities. Neglecting human physical fatigue may adversely affect worker health and, in extreme cases, may lead to musculoskeletal disorders. However, human fatigue has rarely been considered for decision-making in HRC manufacturing systems. Integrating adaptive decision-making to optimise human fatigue in HRC manufacturing systems is crucial. Nonetheless, real-time perception and estimation of human fatigue and decision-making informed by human fatigue face considerable challenges. To address these challenges, this paper introduces a human digital twin method, a bidirectional communication system for physical fatigue assessment and reduction in human-robot collaborative assembly tasks. The methodology encompasses an IK-BiLSTM-AM-based surrogate model, which consists of inverse kinematics analysis (IK), bidirectional long short-term memory (BiLSTM), and attention mechanism (AM), for real-time muscle force estimation integrated with a muscle force-fatigue model for muscle fatigue assessment. An And-Or graph and optimisation model-based HRC task planner is also developed to alleviate physical fatigue via task allocation. The efficacy of this approach has been validated through proof-of-concept assembly experiments involving multiple subjects. The results show that the IK-BiLSTM-AM model achieves a minimum of 8% greater accuracy in muscle force estimation than the baseline methods. The 12-subject assessment results indicate that the task planner effectively reduces the physical fatigue of workers while performing collaborative assembly tasks.
引用
收藏
页数:12
相关论文
共 34 条
[1]   Simulation-based biomechanical assessment of unpowered exoskeletons for running [J].
Aftabi, Hamidreza ;
Nasiri, Rezvan ;
Ahmadabadi, Majid Nili .
SCIENTIFIC REPORTS, 2021, 11 (01)
[2]   Physiological indicators of task demand, fatigue, and cognition in future digital manufacturing environments [J].
Argyle, Elizabeth M. ;
Marinescu, Adrian ;
Wilson, Max L. ;
Lawson, Glyn ;
Sharples, Sarah .
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES, 2021, 145
[3]   Digital twin driven human-robot collaborative assembly [J].
Bilberg, Arne ;
Malik, Ali Ahmad .
CIRP ANNALS-MANUFACTURING TECHNOLOGY, 2019, 68 (01) :499-502
[4]   Machine learning for rapid estimation of lower extremity muscle and joint loading during activities of daily living [J].
Burton, William S. ;
Myers, Casey A. ;
Rullkoetter, Paul J. .
JOURNAL OF BIOMECHANICS, 2021, 123
[5]   Human-Aware Robot Task Planning Based on a Hierarchical Task Model [J].
Cheng, Yujiao ;
Sun, Liting ;
Tomizuka, Masayoshi .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (02) :1136-1143
[6]   OpenSim Moco: Musculoskeletal optimal control [J].
Dembia, Christopher L. ;
Bianco, Nicholas A. ;
Falisse, Antoine ;
Hicks, Jennifer L. ;
Delp, Scott L. .
PLOS COMPUTATIONAL BIOLOGY, 2020, 16 (12)
[7]   Inertial Sensor-to-Segment Calibration for Accurate 3D Joint Angle Calculation for Use in OpenSim [J].
Di Raimondo, Giacomo ;
Vanwanseele, Benedicte ;
van der Have, Arthur ;
Emmerzaal, Jill ;
Willems, Miel ;
Killen, Bryce Adrian ;
Jonkers, Ilse .
SENSORS, 2022, 22 (09)
[8]  
Han K, 2021, ADV NEUR IN
[9]   Endurance time is joint-specific: A modelling and meta-analysis investigation [J].
Law, Laura A. Frey ;
Avin, Keith G. .
ERGONOMICS, 2010, 53 (01) :109-129
[10]   Sequence Planning Considering Human Fatigue for Human-Robot Collaboration in Disassembly [J].
Li, Kai ;
Liu, Quan ;
Xu, Wenjun ;
Liu, Jiayi ;
Zhou, Zude ;
Feng, Hao .
11TH CIRP CONFERENCE ON INDUSTRIAL PRODUCT-SERVICE SYSTEMS, 2019, 83 :95-104