Generating reconstructable collaborative virtual environments via graph matching for mixed reality remote collaboration

被引:0
作者
Lu, Yaguang [1 ]
Hu, Yong [1 ,2 ]
Feng, Huiyan [1 ]
Duan, Pengshuai [1 ]
Shen, Xukun [1 ,2 ]
机构
[1] Beihang Univ, State Key Lab Virtual Real Technol & Syst, Beijing 100191, Peoples R China
[2] Beihang Univ, Sch New Media Art & Design, Beijing 100191, Peoples R China
关键词
Mixed reality; Remote collaboration; Heterogeneous spaces; Graph matching; Redirected walking; REDIRECTED WALKING; TELEPRESENCE;
D O I
10.1007/s00371-024-03761-0
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Generating reconstructable collaborative virtual environments (RCVEs) addresses the spatial heterogeneity challenge in mixed reality (MR) remote collaboration. Existing methods partition remote spaces into discrete areas, aligning them with local spaces. However, disparities in structural and semantic configurations hinder continuous avatar movement. This paper proposes a graph matching-based approach to constrain the spatial topological relationships among discrete areas during RCVEs alignment. An artificial potential fields-based avatar mapping method, named APFBAM, is introduced to rapidly capture and redirect avatars in heterogeneous spaces. Experiments using reconstructed virtual scenes from real-world data demonstrate the effectiveness of these methods in MR remote collaboration. The results indicate that users perceive minimal impact on their experience despite spatial structural differences, validating the approach's suitability for enabling flexible and scalable MR remote collaboration.
引用
收藏
页码:5935 / 5947
页数:13
相关论文
共 50 条
[11]   CoVAR: Mixed-Platform Remote Collaborative Augmented and Virtual Realities System with Shared Collaboration Cues [J].
Piumsomboon, Thammathip ;
Dey, Arindam ;
Ens, Barrett ;
Lee, Gun ;
Billinghurst, Mark .
ADJUNCT PROCEEDINGS OF THE 2017 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY (ISMAR-ADJUNCT), 2017, :218-219
[12]   Real-time Visual Representations for Mobile Mixed Reality Remote Collaboration [J].
Gao, Lei ;
Bai, Huidong ;
He, Weiping ;
Billinghurst, Mark ;
Lindeman, Robert W. .
SA'18: SIGGRAPH ASIA 2018 VIRTUAL & AUGMENTED REALITY, 2018,
[13]   The combination of visual communication cues in mixed reality remote collaboration [J].
Kim, Seungwon ;
Lee, Gun ;
Billinghurst, Mark ;
Huang, Weidong .
JOURNAL ON MULTIMODAL USER INTERFACES, 2020, 14 (04) :321-335
[14]   Blended Whiteboard: Physicality and Reconfigurability in Remote Mixed Reality Collaboration [J].
Gronbaek, Jens Emil ;
Esquivel, Juan Sanchez ;
Leiva, German ;
Velloso, Eduardo ;
Gellersen, Hans ;
Pfeuffer, Ken .
PROCEEDINGS OF THE 2024 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYTEMS, CHI 2024, 2024,
[15]   The combination of visual communication cues in mixed reality remote collaboration [J].
Seungwon Kim ;
Gun Lee ;
Mark Billinghurst ;
Weidong Huang .
Journal on Multimodal User Interfaces, 2020, 14 :321-335
[16]   Mini-Me: An Adaptive Avatar for Mixed Reality Remote Collaboration [J].
Piumsomboon, Thammathip ;
Lee, Gun A. ;
Hart, Jonathon D. ;
Ens, Barrett ;
Lindeman, Robert W. ;
Thomas, Bruce H. ;
Billinghurst, Mark .
PROCEEDINGS OF THE 2018 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI 2018), 2018,
[17]   The effects of spatial auditory and visual cues on mixed reality remote collaboration [J].
Jing Yang ;
Prasanth Sasikumar ;
Huidong Bai ;
Amit Barde ;
Gábor Sörös ;
Mark Billinghurst .
Journal on Multimodal User Interfaces, 2020, 14 :337-352
[18]   The effects of spatial auditory and visual cues on mixed reality remote collaboration [J].
Yang, Jing ;
Sasikumar, Prasanth ;
Bai, Huidong ;
Barde, Amit ;
Soros, Gabor ;
Billinghurst, Mark .
JOURNAL ON MULTIMODAL USER INTERFACES, 2020, 14 (04) :337-352
[19]   A novel mixed reality remote collaboration system with adaptive generation of instructions [J].
Zhang, Xiangyu ;
Bai, Xiaoliang ;
Zhang, Shusheng ;
He, Weiping ;
Wang, Shuxia ;
Yan, Yuxiang ;
Wang, Peng ;
Liu, Liwei .
COMPUTERS & INDUSTRIAL ENGINEERING, 2024, 194
[20]   AVICol: Adaptive Visual Instruction for Remote Collaboration Using Mixed Reality [J].
Wang, Lili ;
Li, Xiangyu ;
Wu, Jian ;
Zhou, Dong ;
Sio Kei, Im ;
Popescu, Voicu .
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION, 2025, 41 (02) :1260-1279