RGB-D Human Posture Analysis for Ergonomic Studies using Deep Convolutional Neural Network

被引:0
作者
Abobakr, Ahmed [1 ]
Nahavandi, Darius [1 ]
Iskander, Julie [1 ]
Hossny, Mohammed [1 ]
Nahavandi, Saeid [1 ]
Smets, Marty [2 ]
机构
[1] Deakin Univ, IISRI, Geelong, Vic, Australia
[2] Ford Motor Co, Dearborn, MI 48121 USA
来源
2017 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC) | 2017年
关键词
Kinect; RGB-D; deep learning; ConvNet; CNN; AlexNet; ergonomics; RULA and pose estimation; SIMULATION; EXPOSURE; OPENSIM; SYSTEM;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Human posture analysis is a task of utmost importance for several disciplines. For ergonomists, extracting postural information such as joint angles is necessary to evaluating ergonomic assessment metrics. This allows the early identification of potential work-related musculoskeletal disorders in manufacturing industries, and thus providing adequate interventions. In this paper, we present a holistic posture analysis system that estimates body joint angles from an input depth image. The proposed method utilizes the low cost Kinect sensor for data acquisition and a deep convolutional neural network model for joint angles regression. Further, we rely on learning from synthetic training images to allow simulating several physical tasks by different workers and obtain a highly generalizable learning model. The corresponding ground truth joint angles have been generated using a novel inverse kinematic stage. The proposed method achieves high joint angels prediction rate by recording an average MAE of 4.67 deg and RMSE of 6.64 deg.
引用
收藏
页码:2885 / 2890
页数:6
相关论文
共 32 条
[1]  
Abobakr A, 2016, IEEE SYS MAN CYBERN, P3281, DOI 10.1109/SMC.2016.7844740
[2]  
[Anonymous], DIG IM COMP TECHN AP
[3]  
[Anonymous], IEEE C SYST MAN CYB
[4]  
[Anonymous], IEEE C DIG IM COMP T
[5]  
[Anonymous], APPL ERGONOMICS
[6]   An adaptable system for RGB-D based human body detection and pose. estimation [J].
Buys, Koen ;
Cagniart, Cedric ;
Baksheev, Anatoly ;
De Laet, Tinne ;
De Schutter, Joris ;
Pantofaru, Caroline .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2014, 25 (01) :39-52
[7]   Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields [J].
Cao, Zhe ;
Simon, Tomas ;
Wei, Shih-En ;
Sheikh, Yaser .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1302-1310
[8]  
Couprie C., 2013, P INT C LEARN REPR
[9]   Ergonomic methods for assessing exposure to risk factors for work-related musculoskeletal disorders [J].
David, GC .
OCCUPATIONAL MEDICINE-OXFORD, 2005, 55 (03) :190-199
[10]   OpenSim: open-source software to create and analyze dynamic Simulations of movement [J].
Delp, Scott L. ;
Anderson, Frank C. ;
Arnold, Allison S. ;
Loan, Peter ;
Habib, Ayman ;
John, Chand T. ;
Guendelman, Eran ;
Thelen, Darryl G. .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2007, 54 (11) :1940-1950