Capture of 3D Human Motion Pose in Virtual Reality Based on Video Recognition

被引:3
|
作者
Fu, Qiang [1 ]
Zhang, Xingui [2 ]
Xu, Jinxiu [3 ]
Zhang, Haimin [1 ]
机构
[1] Henan Inst Sci & Technol, Inst Phys Culture, Xinxiang 453003, Henan, Peoples R China
[2] Tsinghua Univ, Dept Sports, Beijing 100084, Peoples R China
[3] Xinxiang Med Univ, Sanquan Coll, Xinxiang 453003, Henan, Peoples R China
关键词
INERTIAL SENSORS; MODULATION; REHABILITATION;
D O I
10.1155/2020/8857748
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Motion pose capture technology can effectively solve the problem of difficulty in defining character motion in the process of 3D animation production and greatly reduce the workload of character motion control, thereby improving the efficiency of animation development and the fidelity of character motion. Motion gesture capture technology is widely used in virtual reality systems, virtual training grounds, and real-time tracking of the motion trajectories of general objects. This paper proposes an attitude estimation algorithm adapted to be embedded. The previous centralized Kalman filter is divided into two-step Kalman filtering. According to the different characteristics of the sensors, they are processed separately to isolate the cross-influence between sensors. An adaptive adjustment method based on fuzzy logic is proposed. The acceleration, angular velocity, and geomagnetic field strength of the environment are used as the input of fuzzy logic to judge the motion state of the carrier and then adjust the covariance matrix of the filter. The adaptive adjustment of the sensor is converted to the recognition of the motion state. For the study of human motion posture capture, this paper designs a verification experiment based on the existing robotic arm in the laboratory. The experiment shows that the studied motion posture capture method has better performance. The human body motion gesture is designed for capturing experiments, and the capture results show that the obtained pose angle information can better restore the human body motion. A visual model of human motion posture capture was established, and after comparing and analyzing with the real situation, it was found that the simulation approach reproduced the motion process of human motion well. For the research of human motion recognition, this paper designs a two-classification model and human daily behaviors for experiments. Experiments show that the accuracy of the two-category human motion gesture capture and recognition has achieved good results. The experimental effect of SVC on the recognition of two classifications is excellent. In the case of using all optimization algorithms, the accuracy rate is higher than 90%, and the final recognition accuracy rate is also higher than 90%. In terms of recognition time, the time required for human motion gesture capture and recognition is less than 2 s.
引用
收藏
页数:17
相关论文
共 50 条
  • [21] Unsupervised 3D Pose Estimation for Hierarchical Dance Video Recognition
    Hu, Xiaodan
    Ahuja, Narendra
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 10995 - 11004
  • [22] Recognition Method with Deep Contrastive Learning and Improved Transformer for 3D Human Motion Pose
    Liu, Datian
    Yang, Haitao
    Lei, Zhang
    INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2023, 16 (01)
  • [23] Recognition Method with Deep Contrastive Learning and Improved Transformer for 3D Human Motion Pose
    Datian Liu
    Haitao Yang
    Zhang Lei
    International Journal of Computational Intelligence Systems, 16
  • [24] 3D modelling based on virtual reality
    Zhaparov, M. K.
    Nassen, Y.
    2016 6th International Conference - Cloud System and Big Data Engineering (Confluence), 2016, : 399 - 402
  • [25] Enhancing silhouette-based human motion capture with 3D motion fields
    Theobalt, C
    Carranza, J
    Magnor, MA
    Seidel, HP
    11TH PACIFIC CONFERENCE ON COMPUTER GRAPHICS AND APPLICATIONS, PROCEEDINGS, 2003, : 185 - 193
  • [26] Gait Recognition from Markerless 3D Motion Capture
    Rainey, James
    Bustard, John
    McLoone, Sean
    2019 INTERNATIONAL CONFERENCE ON BIOMETRICS (ICB), 2019,
  • [27] VIRTUAL REALITY VIDEO QUALITY ASSESSMENT BASED ON 3D CONVOLUTIONAL NEURAL NETWORKS
    Wu, Pei
    Ding, Wenxin
    You, Zhixiang
    An, Ping
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 3187 - 3191
  • [28] 3D Video-based Motion Capture using Convolutional Neural Networks
    ShangGuan, Huyuan
    Mukundan, Ramakrishnan
    2017 INTERNATIONAL CONFERENCE ON IMAGE AND VISION COMPUTING NEW ZEALAND (IVCNZ), 2017,
  • [29] Augmented Reality with Human Body Interaction Based on Monocular 3D Pose Estimation
    Lin, Huei-Yung
    Chen, Ting-Wen
    ADVANCED CONCEPTS FOR INTELLIGENT VISION SYSTEMS, PT I, 2010, 6474 : 321 - 331
  • [30] CAPTURE, REPRESENTATION, AND RENDERING OF 3D AUDIO FOR VIRTUAL AND AUGMENTED REALITY
    Tashev, Ivan J.
    INTERNATIONAL JOURNAL ON INFORMATION TECHNOLOGIES AND SECURITY, 2019, 11 : 49 - 62