Online human motion analysis in industrial context: A review

被引:14
作者
Benmessabih, Toufik [1 ]
Slama, Rim [1 ]
Havard, Vincent [2 ]
Baudry, David [2 ]
机构
[1] CESI, LINEACT, F-69100 Lyon, France
[2] CESI, LINEACT, F-76800 Rouen, France
关键词
Industry; 4.0/5.0; Online human motion analysis; Data acquisition technologies; Benchmarks; Deep learning; Human-robot collaboration; HUMAN ACTION RECOGNITION; DATASET; INFORMATION; ENVIRONMENT; ACCURATE; ROBOTS; TASKS; POSE;
D O I
10.1016/j.engappai.2024.107850
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Human motion analysis plays a crucial role in industry 4.0 and, more recently, in industry 5.0 where humancentered applications are becoming increasingly important, demonstrating its potential for enhancing safety, ergonomics and productivity. Considering this opportunity, an increasing number of studies are proposing works on the analysis of human motion in an industrial context, taking advantage of the rise of artificial intelligence technologies and sensor technologies. The objective of this work is to provide a review of recent studies exploring these technologies in the analysis of human movement while specifically considering industrial context. First, a taxonomy of key human motion analysis applications is proposed, presenting statistical insights to reveal trends and highlighting lacks in current research. Furthermore, this work identifies benchmark datasets acquired in various industrial case studies and associated sensors. Many recommendations for selecting optimal sensors and valuable benchmarks are proposed. Then, the paper outlines the current trend of utilizing hybrid deep learning methodologies in human movement analysis while underscoring the performance and limitations of these proposed methods, considering industrial constraints such as real-time recognition and frugality. Finally, challenges and future works are highlighted, focusing on the opportunities to address problems related to the complex industrial environment in order to achieve reliable performances.
引用
收藏
页数:24
相关论文
共 140 条
[1]   Asymmetric Identification Model for Human-Robot Contacts via Supervised Learning [J].
Abu Al-Haija, Qasem ;
Al-Saraireh, Ja'afer .
SYMMETRY-BASEL, 2022, 14 (03)
[2]   Graph Convolutional Neural Network for Human Action Recognition: A Comprehensive Survey [J].
Ahmad T. ;
Jin L. ;
Zhang X. ;
Lai S. ;
Tang G. ;
Lin L. .
IEEE Transactions on Artificial Intelligence, 2021, 2 (02) :128-145
[3]   STAR-Transformer: A Spatio-temporal Cross Attention Transformer for Human Action Recognition [J].
Ahn, Dasom ;
Kim, Sangwon ;
Hong, Hyunsu ;
Ko, Byoung Chul .
2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, :3319-3328
[4]   SPD Siamese Neural Network for Skeleton-based Hand Gesture Recognition [J].
Akremi, Mohamed Sanim ;
Slama, Rim ;
Tabia, Hedi .
PROCEEDINGS OF THE 17TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISAPP), VOL 4, 2022, :394-402
[5]   Action Recognition in Manufacturing Assembly using Multimodal Sensor Fusion [J].
Al-Amin, Md. ;
Tao, Wenjin ;
Doell, David ;
Lingard, Ravon ;
Yin, Zhaozheng ;
Leu, Ming C. ;
Qin, Ruwen .
25TH INTERNATIONAL CONFERENCE ON PRODUCTION RESEARCH MANUFACTURING INNOVATION: CYBER PHYSICAL MANUFACTURING, 2019, 39 :158-167
[6]   Leveraging GANs for data scarcity of COVID-19: Beyond the hype [J].
Ali, Hazrat ;
Gronlund, Christer ;
Shah, Zubair .
2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW, 2023, :659-667
[7]   Is Industry 5.0 a Human-Centred Approach? A Systematic Review [J].
Alves, Joel ;
Lima, Tania M. ;
Gaspar, Pedro D. D. .
PROCESSES, 2023, 11 (01)
[8]   A Mixed-Perception Approach for Safe Human-Robot Collaboration in Industrial Automation [J].
Amin, Fatemeh Mohammadi ;
Rezayati, Maryam ;
van de Venn, Hans Wernher ;
Karimpour, Hossein .
SENSORS, 2020, 20 (21) :1-20
[9]   Human Activity Recognition: Review, Taxonomy and Open Challenges [J].
Arshad, Muhammad Haseeb ;
Bilal, Muhammad ;
Gani, Abdullah .
SENSORS, 2022, 22 (17)
[10]   Physical Human Activity Recognition Using Wearable Sensors [J].
Attal, Ferhat ;
Mohammed, Samer ;
Dedabrishvili, Mariam ;
Chamroukhi, Faicel ;
Oukhellou, Latifa ;
Amirat, Yacine .
SENSORS, 2015, 15 (12) :31314-31338