Generating reconstructable collaborative virtual environments via graph matching for mixed reality remote collaboration

被引:0
作者
Lu, Yaguang [1 ]
Hu, Yong [1 ,2 ]
Feng, Huiyan [1 ]
Duan, Pengshuai [1 ]
Shen, Xukun [1 ,2 ]
机构
[1] Beihang Univ, State Key Lab Virtual Real Technol & Syst, Beijing 100191, Peoples R China
[2] Beihang Univ, Sch New Media Art & Design, Beijing 100191, Peoples R China
关键词
Mixed reality; Remote collaboration; Heterogeneous spaces; Graph matching; Redirected walking; REDIRECTED WALKING; TELEPRESENCE;
D O I
10.1007/s00371-024-03761-0
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Generating reconstructable collaborative virtual environments (RCVEs) addresses the spatial heterogeneity challenge in mixed reality (MR) remote collaboration. Existing methods partition remote spaces into discrete areas, aligning them with local spaces. However, disparities in structural and semantic configurations hinder continuous avatar movement. This paper proposes a graph matching-based approach to constrain the spatial topological relationships among discrete areas during RCVEs alignment. An artificial potential fields-based avatar mapping method, named APFBAM, is introduced to rapidly capture and redirect avatars in heterogeneous spaces. Experiments using reconstructed virtual scenes from real-world data demonstrate the effectiveness of these methods in MR remote collaboration. The results indicate that users perceive minimal impact on their experience despite spatial structural differences, validating the approach's suitability for enabling flexible and scalable MR remote collaboration.
引用
收藏
页码:5935 / 5947
页数:13
相关论文
共 45 条
[21]  
Lang YN, 2019, 2019 26TH IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES (VR), P767, DOI [10.1109/VR.2019.8798018, 10.1109/vr.2019.8798018]
[22]  
Lehment NH, 2014, INT SYM MIX AUGMENT, P201, DOI 10.1109/ISMAR.2014.6948428
[23]  
Li YJ, 2019, PR MACH LEARN RES, V97
[24]  
Maimone A, 2013, P IEEE VIRT REAL ANN, P23, DOI 10.1109/VR.2013.6549352
[25]   PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understanding [J].
Mo, Kaichun ;
Zhu, Shilin ;
Chang, Angel X. ;
Yi, Li ;
Tripathi, Subarna ;
Guibas, Leonidas J. ;
Su, Hao .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :909-918
[26]   15 Years of Research on Redirected Walking in Immersive Virtual Environments [J].
Nilsson, Niels Christian ;
Peck, Tabitha ;
Bruder, Gerd ;
Hodgson, Eric ;
Serafin, Stefania ;
Whitton, Mary ;
Rosenberg, Evan Suma ;
Steinicke, Frank .
IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2018, 38 (02) :44-56
[27]   Holoportation: Virtual 3D Teleportation in Real-time [J].
Orts-Escolano, Sergio ;
Rhemann, Christoph ;
Fanello, Sean ;
Chang, Wayne ;
Kowdle, Adarsh ;
Degtyarev, Yury ;
Kim, David ;
Davidson, Philip ;
Khamis, Sameh ;
Dou, Mingsong ;
Tankovich, Vladimir ;
Loop, Charles ;
Cai, Qin ;
Chou, Philip ;
Mennicken, Sarah ;
Valentin, Julien ;
Pradeep, Vivek ;
Wang, Shenlong ;
Kang, Sing Bing ;
Kohli, Pushmeet ;
Lutchyn, Yuliya ;
Keskin, Cem ;
Izadit, Shahram .
UIST 2016: PROCEEDINGS OF THE 29TH ANNUAL SYMPOSIUM ON USER INTERFACE SOFTWARE AND TECHNOLOGY, 2016, :741-754
[28]   Evaluation of Reorientation Techniques and Distractors for Walking in Large Virtual Environments [J].
Peck, Tabitha C. ;
Fuchs, Henry ;
Whitton, Mary C. .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2009, 15 (03) :383-394
[29]   Room2Room: Enabling Life-Size Telepresence in a Projected Augmented Reality Environment [J].
Pejsa, Tomislav ;
Kantor, Julian ;
Benko, Hrvoje ;
Ofek, Eyal ;
Wilson, Andrew .
ACM CONFERENCE ON COMPUTER-SUPPORTED COOPERATIVE WORK AND SOCIAL COMPUTING (CSCW 2016), 2016, :1716-1725
[30]   Teleportation in Virtual Reality; A Mini-Review [J].
Prithul, Aniruddha ;
Adhanom, Isayas Berhe ;
Folmer, Eelke .
FRONTIERS IN VIRTUAL REALITY, 2021, 2