Online human motion analysis in industrial context: A review

被引:16
作者
Benmessabih, Toufik [1 ]
Slama, Rim [1 ]
Havard, Vincent [2 ]
Baudry, David [2 ]
机构
[1] CESI, LINEACT, F-69100 Lyon, France
[2] CESI, LINEACT, F-76800 Rouen, France
关键词
Industry; 4.0/5.0; Online human motion analysis; Data acquisition technologies; Benchmarks; Deep learning; Human-robot collaboration; HUMAN ACTION RECOGNITION; DATASET; INFORMATION; ENVIRONMENT; ACCURATE; ROBOTS; TASKS; POSE;
D O I
10.1016/j.engappai.2024.107850
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Human motion analysis plays a crucial role in industry 4.0 and, more recently, in industry 5.0 where humancentered applications are becoming increasingly important, demonstrating its potential for enhancing safety, ergonomics and productivity. Considering this opportunity, an increasing number of studies are proposing works on the analysis of human motion in an industrial context, taking advantage of the rise of artificial intelligence technologies and sensor technologies. The objective of this work is to provide a review of recent studies exploring these technologies in the analysis of human movement while specifically considering industrial context. First, a taxonomy of key human motion analysis applications is proposed, presenting statistical insights to reveal trends and highlighting lacks in current research. Furthermore, this work identifies benchmark datasets acquired in various industrial case studies and associated sensors. Many recommendations for selecting optimal sensors and valuable benchmarks are proposed. Then, the paper outlines the current trend of utilizing hybrid deep learning methodologies in human movement analysis while underscoring the performance and limitations of these proposed methods, considering industrial constraints such as real-time recognition and frugality. Finally, challenges and future works are highlighted, focusing on the opportunities to address problems related to the complex industrial environment in order to achieve reliable performances.
引用
收藏
页数:24
相关论文
共 140 条
[41]   Vision-based holistic scene understanding towards proactive human-robot collaboration [J].
Fan, Junming ;
Zheng, Pai ;
Li, Shufei .
ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2022, 75
[42]   Intuitive Spatial Tactile Feedback for Better Awareness about Robot Trajectory during Human-Robot Collaboration [J].
Grushko, Stefan ;
Vysocky, Ales ;
Heczko, Dominik ;
Bobovsky, Zdenko .
SENSORS, 2021, 21 (17)
[43]   Digital twin and virtual reality: a co-simulation environment for design and assessment of industrial workstations [J].
Havard, Vincent ;
Jeanne, Benoit ;
Lacomblez, Marc ;
Baudry, David .
PRODUCTION AND MANUFACTURING RESEARCH-AN OPEN ACCESS JOURNAL, 2019, 7 (01) :472-489
[44]  
Hedegaard L, 2023, PATTERN RECOGNITION, V140, DOI arXiv:2203.11009
[45]   Collision Detection for Industrial Collaborative Robots: A Deep Learning Approach [J].
Heo, Young Jin ;
Kim, Dayeon ;
Lee, Woongyong ;
Kim, Hyoungkyun ;
Park, Jonghoon ;
Chung, Wan Kyun .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2019, 4 (02) :740-746
[46]   Hierarchical Human Action Recognition to Measure the Performance of Manual Labor [J].
Hernandez, Jefferson ;
Valarezo, Gabriela ;
Cobos, Richard ;
Kim, Joo Wang ;
Palacios, Ricardo ;
Abad, Andres G. .
IEEE ACCESS, 2021, 9 :103110-103119
[47]   Human-robot collaboration in industrial environments: A literature review on non-destructive disassembly* [J].
Hjorth, Sebastian ;
Chrysostomou, Dimitrios .
ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2022, 73
[48]   Challenges and opportunities in human robot collaboration context of Industry 4.0-a state of the art review [J].
Inkulu, Anil Kumar ;
Bahubalendruni, M. V. A. Raju ;
Dara, Ashok ;
K., SankaranarayanaSamy .
INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION, 2022, 49 (02) :226-239
[49]   HRI30: An Action Recognition Dataset for Industrial Human-Robot Interaction [J].
Iodice, Francesco ;
De Momi, Elena ;
Ajoudani, Arash .
2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, :4941-4947
[50]   HAMLET: A Hierarchical Multimodal Attention-based Human Activity Recognition Algorithm [J].
Islam, Md Mofijul ;
Iqbal, Tariq .
2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, :10285-10292