Generating reconstructable collaborative virtual environments via graph matching for mixed reality remote collaboration

被引:0
作者
Lu, Yaguang [1 ]
Hu, Yong [1 ,2 ]
Feng, Huiyan [1 ]
Duan, Pengshuai [1 ]
Shen, Xukun [1 ,2 ]
机构
[1] Beihang Univ, State Key Lab Virtual Real Technol & Syst, Beijing 100191, Peoples R China
[2] Beihang Univ, Sch New Media Art & Design, Beijing 100191, Peoples R China
关键词
Mixed reality; Remote collaboration; Heterogeneous spaces; Graph matching; Redirected walking; REDIRECTED WALKING; TELEPRESENCE;
D O I
10.1007/s00371-024-03761-0
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Generating reconstructable collaborative virtual environments (RCVEs) addresses the spatial heterogeneity challenge in mixed reality (MR) remote collaboration. Existing methods partition remote spaces into discrete areas, aligning them with local spaces. However, disparities in structural and semantic configurations hinder continuous avatar movement. This paper proposes a graph matching-based approach to constrain the spatial topological relationships among discrete areas during RCVEs alignment. An artificial potential fields-based avatar mapping method, named APFBAM, is introduced to rapidly capture and redirect avatars in heterogeneous spaces. Experiments using reconstructed virtual scenes from real-world data demonstrate the effectiveness of these methods in MR remote collaboration. The results indicate that users perceive minimal impact on their experience despite spatial structural differences, validating the approach's suitability for enabling flexible and scalable MR remote collaboration.
引用
收藏
页码:5935 / 5947
页数:13
相关论文
共 45 条
[1]   3D Semantic Parsing of Large-Scale Indoor Spaces [J].
Armeni, Iro ;
Sener, Ozan ;
Zamir, Amir R. ;
Jiang, Helen ;
Brilakis, Ioannis ;
Fischer, Martin ;
Savarese, Silvio .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1534-1543
[2]   Multi-User Redirected Walking and Resetting Using Artificial Potential Fields [J].
Bachmann, Eric R. ;
Hodgson, Eric ;
Hoffbauer, Cole ;
Messinger, Justin .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2019, 25 (05) :2022-2031
[3]  
Bachmann ER, 2013, P IEEE VIRT REAL ANN, P89, DOI 10.1109/VR.2013.6549377
[4]   Immersive Group-to-Group Telepresence [J].
Beck, Stephan ;
Kunert, Andre ;
Kulik, Alexander ;
Froehlich, Bernd .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2013, 19 (04) :616-625
[5]   CLIP2Scene: Towards Label-efficient 3D Scene Understanding by CLIP [J].
Chen, Runnan ;
Liu, Youquan ;
Kong, Lingdong ;
Zhu, Xinge ;
Ma, Yuexin ;
Li, Yikang ;
Hou, Yuenan ;
Qiao, Yu ;
Wang, Wenping .
2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, :7020-7030
[6]   PLA: Language-Driven Open-Vocabulary 3D Scene Understanding [J].
Ding, Runyu ;
Yang, Jihan ;
Xue, Chuhui ;
Zhang, Wenqing ;
Bai, Song ;
Qi, Xiaojuan .
2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, :7010-7019
[7]   Dynamic Density-based Redirected Walking Towards Multi-user Virtual Environments [J].
Dong, Tianyang ;
Shen, Yue ;
Gao, Tieqi ;
Fan, Jing .
2021 IEEE VIRTUAL REALITY AND 3D USER INTERFACES (VR), 2021, :626-634
[8]   Smooth Assembled Mappings for Large-Scale Real Walking [J].
Dong, Zhi-Chao ;
Fu, Xiao-Ming ;
Zhang, Chi ;
Wu, Kang ;
Liu, Ligang .
ACM TRANSACTIONS ON GRAPHICS, 2017, 36 (06)
[9]   A Mixed Reality Telepresence System for Collaborative Space Operation [J].
Fairchild, Allen J. ;
Campion, Simon P. ;
Garcia, Arturo S. ;
Wolff, Robin ;
Fernando, Terrence ;
Roberts, David J. .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2017, 27 (04) :814-827
[10]  
Fan R., 2023, VISUAL COMPUT, V40, P1