A Time Reversal Symmetry Based Real-time Optical Motion Capture Missing Marker Recovery Method

被引:0
作者
Weng, Dongdong [1 ]
Wang, Yihan [1 ]
Li, Dong [1 ]
机构
[1] Beijing Inst Technol, Sch Opt & Photon, Beijing Engn Res Ctr Mixed Real & Adv Display, Beijing, Peoples R China
来源
2022 IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES ABSTRACTS AND WORKSHOPS (VRW 2022) | 2022年
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Human-centered computing; Human computer interaction(HCI); Interaction paradigms; Virtual reality;
D O I
10.1109/VRW55335.2022.00237
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a deep learning model based on time reversal symmetry for real-time recovery of continuous missing marker sequences in optical motion capture. This paper firstly uses time reversal symmetry of human motion as a constraint of the model. BiLSTM is used to describe the constraint and extract the bidirectional spatiotemporal features. This paper proposes a weight position loss function for model training, which describes the effect of different joints on the pose. Compared with the existing methods, the experimental results show that the proposed method has higher accuracy and good real-time performance.
引用
收藏
页码:763 / 764
页数:2
相关论文
共 50 条
[41]   An IoT and machine learning enhanced framework for real-time digital human modeling and motion simulation [J].
Huang, Haiping ;
Zhao, Lingjun ;
Wu, Yisheng .
COMPUTER COMMUNICATIONS, 2023, 212 :78-89
[42]   Recycling a Landmark Dataset for Real-time Facial Capture and Animation with Low Cost HMD Integrated Cameras [J].
Dos Santos Brito, Caio Jose ;
Mitchell, Kenny .
17TH ACM SIGGRAPH INTERNATIONAL CONFERENCE ON VIRTUAL-REALITY CONTINUUM AND ITS APPLICATIONS IN INDUSTRY (VRCAI 2019), 2019,
[43]   Real-Time Avatar-Based Feedback to Enhance the Symmetry of Spatiotemporal Parameters After Stroke: Instantaneous Effects of Different Avatar Views [J].
Liu, Le Yu ;
Sangani, Samir ;
Patterson, Kara K. ;
Fung, Joyce ;
Lamontagne, Anouk .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2020, 28 (04) :878-887
[44]   Real-Time Viewport-Aware Optical Flow Estimation in 360-degree Videos for Visually-Induced Motion Sickness Mitigation [J].
Cao, Zekun ;
Kopper, Regis .
25TH SYMPOSIUM ON VIRTUAL AND AUGMENTED REALITY, SVR 2023, 2023, :210-218
[45]   Real-time and precise insect flight control system based on virtual reality [J].
Zheng, Nenggan ;
Jin, Mengjie ;
Hong, Hui ;
Huang, Lei ;
Gu, Zonghua ;
Li, Hong .
ELECTRONICS LETTERS, 2017, 53 (06) :387-U18
[46]   Interactive serious game for shoulder rehabilitation based on real-time hand tracking [J].
Viglialoro, Rosanna M. ;
Condino, Sara ;
Turini, Giuseppe ;
Mamone, Virginia ;
Carbone, Marina ;
Ferrari, Vincenzo ;
Ghelarducci, Giulia ;
Ferrari, Mauro ;
Gesi, Marco .
TECHNOLOGY AND HEALTH CARE, 2020, 28 (04) :403-414
[47]   Influence of Color on Asthenopia of VR Based on Real-Time Teleoperating Lunar Rover [J].
Jiang, Ao ;
Zhang, Jinglin ;
Zhao, Yan ;
Fan, Hao ;
Yu, Kun ;
Zhou, Haihai .
HCI INTERNATIONAL 2024-LATE BREAKING PAPERS, HCII 2024, PT IV, 2025, 15377 :69-78
[48]   LINEAR STATIC, REAL-TIME FINITE ELEMENT COMPUTATIONS BASED ON ELEMENT MASKS [J].
Graf, Holger ;
Stork, Andre .
PROCEEDINGS OF THE ASME WORLD CONFERENCE ON INNOVATIVE VIRTUAL REALITY - 2011, 2011, :87-+
[49]   Task Scheduling of Real-Time Traffic Information Processing Based on Digital Twins [J].
Liu, Yang ;
Yang, Ang ;
Zeng, Qingcheng ;
Sun, Yuhui ;
Gao, Jing ;
Lv, Zhihan .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (11) :13171-13179
[50]   Real-Time Learning and Recognition of Assembly Activities Based on Virtual Reality Demonstration [J].
Zhang, Ning ;
Qi, Tao ;
Zhao, Yongjia .
SENSORS, 2021, 21 (18)