Generating reconstructable collaborative virtual environments via graph matching for mixed reality remote collaboration

被引:0
作者
Lu, Yaguang [1 ]
Hu, Yong [1 ,2 ]
Feng, Huiyan [1 ]
Duan, Pengshuai [1 ]
Shen, Xukun [1 ,2 ]
机构
[1] Beihang Univ, State Key Lab Virtual Real Technol & Syst, Beijing 100191, Peoples R China
[2] Beihang Univ, Sch New Media Art & Design, Beijing 100191, Peoples R China
关键词
Mixed reality; Remote collaboration; Heterogeneous spaces; Graph matching; Redirected walking; REDIRECTED WALKING; TELEPRESENCE;
D O I
10.1007/s00371-024-03761-0
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Generating reconstructable collaborative virtual environments (RCVEs) addresses the spatial heterogeneity challenge in mixed reality (MR) remote collaboration. Existing methods partition remote spaces into discrete areas, aligning them with local spaces. However, disparities in structural and semantic configurations hinder continuous avatar movement. This paper proposes a graph matching-based approach to constrain the spatial topological relationships among discrete areas during RCVEs alignment. An artificial potential fields-based avatar mapping method, named APFBAM, is introduced to rapidly capture and redirect avatars in heterogeneous spaces. Experiments using reconstructed virtual scenes from real-world data demonstrate the effectiveness of these methods in MR remote collaboration. The results indicate that users perceive minimal impact on their experience despite spatial structural differences, validating the approach's suitability for enabling flexible and scalable MR remote collaboration.
引用
收藏
页码:5935 / 5947
页数:13
相关论文
共 50 条
[31]   Imitative Collaboration: A mirror-neuron inspired mixed reality collaboration method with remote hands and local replicas [J].
Zhang, Zhenning ;
Pan, Zhigeng ;
Li, Weiqing ;
Su, Zhiyong .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2022, 88
[32]   Mixed Reality Remote Collaboration Combining 360 Video and 3D Reconstruction [J].
Teo, Theophilus ;
Lawrence, Louise ;
Lee, Gun A. ;
Billinghurst, Mark ;
Adcock, Matt .
CHI 2019: PROCEEDINGS OF THE 2019 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, 2019,
[33]   Visualizing Hand Force with Wearable Muscle Sensing for Enhanced Mixed Reality Remote Collaboration [J].
Kim, Hyung-il ;
Yoon, Boram ;
Oh, Seo Young ;
Woo, Woontack .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2023, 29 (11) :4611-4621
[34]   Development of a Remote Collaboration System for Interactive Communication with Building Information Model in Mixed Reality [J].
Cho, Jaehong ;
Kim, Sungpyo ;
Kim, Namyoung ;
Kang, Sanghyeok .
APPLIED SCIENCES-BASEL, 2022, 12 (17)
[35]   A User Study on Mixed Reality Remote Collaboration with Eye Gaze and Hand Gesture Sharing [J].
Bai, Huidong ;
Sasikumar, Prasanth ;
Yang, Jing ;
Billinghurst, Mark .
PROCEEDINGS OF THE 2020 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI'20), 2020,
[36]   HoloBots: Augmenting Holographic Telepresence with Mobile Robots for Tangible Remote Collaboration in Mixed Reality [J].
Ihara, Keiichi ;
Faridan, Mehrad ;
Ichikawa, Ayumi ;
Kawaguchi, Ikkaku ;
Suzuki, Ryo .
PROCEEDINGS OF THE 36TH ANNUAL ACM SYMPOSIUM ON USER INTERFACE SOFTWARE AND TECHNOLOGY, UIST 2023, 2023,
[37]   A Virtual Reality Whiteboard System for Remote Collaboration Using Natural Handwriting [J].
Wang, Jiangkun ;
Jing, Lei .
ELECTRONICS, 2022, 11 (24)
[38]   UnMapped: Leveraging Experts' Situated Experiences to Ease Remote Guidance in Collaborative Mixed Reality [J].
Johnson, Janet G. ;
Sharkey, Tommy ;
Butarbutar, Iramuali Cynthia ;
Xiong, Danica ;
Huang, Ruijie ;
Sy, Lauren ;
Weibel, Nadir .
PROCEEDINGS OF THE 2023 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI 2023), 2023,
[39]   The Critical Role of Stereopsis in Virtual and Mixed Reality Learning Environments [J].
Wainman, Bruce ;
Pukas, Giancarlo ;
Wolak, Liliana ;
Mohanraj, Sylvia ;
Lamb, Jason ;
Norman, Geoffrey R. .
ANATOMICAL SCIENCES EDUCATION, 2020, 13 (03) :398-405
[40]   WWoW: World Without Walls Immersive Mixed Reality with Virtual Co-location, Natural Interactions, and Remote Collaboration [J].
Guntha, Ramesh ;
Hariharan, Balaji ;
Rangan, P. Venkat .
INTELLIGENT TECHNOLOGIES FOR INTERACTIVE ENTERTAINMENT, INTETAIN 2016, 2017, 178 :209-219