Capture of 3D Human Motion Pose in Virtual Reality Based on Video Recognition

被引:3
|
作者
Fu, Qiang [1 ]
Zhang, Xingui [2 ]
Xu, Jinxiu [3 ]
Zhang, Haimin [1 ]
机构
[1] Henan Inst Sci & Technol, Inst Phys Culture, Xinxiang 453003, Henan, Peoples R China
[2] Tsinghua Univ, Dept Sports, Beijing 100084, Peoples R China
[3] Xinxiang Med Univ, Sanquan Coll, Xinxiang 453003, Henan, Peoples R China
关键词
INERTIAL SENSORS; MODULATION; REHABILITATION;
D O I
10.1155/2020/8857748
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Motion pose capture technology can effectively solve the problem of difficulty in defining character motion in the process of 3D animation production and greatly reduce the workload of character motion control, thereby improving the efficiency of animation development and the fidelity of character motion. Motion gesture capture technology is widely used in virtual reality systems, virtual training grounds, and real-time tracking of the motion trajectories of general objects. This paper proposes an attitude estimation algorithm adapted to be embedded. The previous centralized Kalman filter is divided into two-step Kalman filtering. According to the different characteristics of the sensors, they are processed separately to isolate the cross-influence between sensors. An adaptive adjustment method based on fuzzy logic is proposed. The acceleration, angular velocity, and geomagnetic field strength of the environment are used as the input of fuzzy logic to judge the motion state of the carrier and then adjust the covariance matrix of the filter. The adaptive adjustment of the sensor is converted to the recognition of the motion state. For the study of human motion posture capture, this paper designs a verification experiment based on the existing robotic arm in the laboratory. The experiment shows that the studied motion posture capture method has better performance. The human body motion gesture is designed for capturing experiments, and the capture results show that the obtained pose angle information can better restore the human body motion. A visual model of human motion posture capture was established, and after comparing and analyzing with the real situation, it was found that the simulation approach reproduced the motion process of human motion well. For the research of human motion recognition, this paper designs a two-classification model and human daily behaviors for experiments. Experiments show that the accuracy of the two-category human motion gesture capture and recognition has achieved good results. The experimental effect of SVC on the recognition of two classifications is excellent. In the case of using all optimization algorithms, the accuracy rate is higher than 90%, and the final recognition accuracy rate is also higher than 90%. In terms of recognition time, the time required for human motion gesture capture and recognition is less than 2 s.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Motion Capture Research: 3D Human Pose Recovery Based on RGB Video Sequences
    Min, Xin
    Sun, Shouqian
    Wang, Honglie
    Zhang, Xurui
    Li, Chao
    Zhang, Xianfu
    APPLIED SCIENCES-BASEL, 2019, 9 (17):
  • [2] A review of 3D human pose estimation algorithms for markerless motion capture
    Desmarais, Yann
    Mottet, Denis
    Slangen, Pierre
    Montesinos, Philippe
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2021, 212
  • [3] MARKERLESS HUMAN MOTION CAPTURE AND POSE RECOGNITION
    Huo, Feifei
    Hendriks, Emile
    Paclik, Pavel
    Oomes, A. H. J.
    2009 10TH INTERNATIONAL WORKSHOP ON IMAGE ANALYSIS FOR MULTIMEDIA INTERACTIVE SERVICES, 2009, : 13 - +
  • [4] A 3D Hand Motion Capture Device with Haptic Feedback for Virtual Reality Applications
    Torres-Sanchez, Javier
    Tedesco, Salvatore
    O'Flynn, Brendan
    2018 IEEE GAMES, ENTERTAINMENT, MEDIA CONFERENCE (GEM), 2018, : 232 - 238
  • [5] Video-Based 3D Human Pose Estimation Research
    Tao, Siting
    Zhang, Zhi
    2022 IEEE 17TH CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS (ICIEA), 2022, : 485 - 490
  • [6] Research on Virtual Reality Arm Motion Capture and Recognition
    Cai, Shubin
    Deng, Dihui
    Li, Jianqiang
    Wen, Jinchun
    Chen, Chaoqin
    Ming, Zhong
    2019 IEEE 4TH INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS AND MECHATRONICS (ICARM 2019), 2019, : 738 - 743
  • [7] 3D object recognition for Virtual Reality based Digital Twins
    Ashkir, Ilyas
    Roullier, Benjamin D.
    Mcquade, Frank
    Anjum, Ashiq
    8TH IEEE/ACM INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING, APPLICATIONS AND TECHNOLOGIES, BDCAT 2021, 2021, : 9 - 17
  • [8] Automatic reconstruction of 3D human motion pose from uncalibrated monocular video sequences based on markerless human motion tracking
    Zou, Beiji
    Chen, Shu
    Shi, Cao
    Providence, Umugwaneza Marie
    PATTERN RECOGNITION, 2009, 42 (07) : 1559 - 1571
  • [9] Combining 3D flow fields with silhouette-based human motion capture for immersive video
    Theobalt, C
    Carranza, J
    Magnor, MA
    Seidel, HP
    GRAPHICAL MODELS, 2004, 66 (06) : 333 - 351
  • [10] HULC: 3D HUman Motion Capture with Pose Manifold SampLing and Dense Contact Guidance
    Shimada, Soshi
    Golyanik, Vladislav
    Li, Zhi
    Perez, Patrick
    Xu, Weipeng
    Theobalt, Christian
    COMPUTER VISION, ECCV 2022, PT XXII, 2022, 13682 : 516 - 533