Distributed collaborative inspections through smart infrastructure metaverse

被引:3
作者
Al-Sabbag, Zaid Abbas [1 ]
Yeum, Chul Min [1 ]
Narasimhan, Sriram [2 ]
机构
[1] Univ Waterloo, Dept Civil & Environm Engn, Waterloo, ON, Canada
[2] Univ Calif Los Angeles, Dept Civil & Environm Engn, Los Angeles, CA USA
基金
加拿大自然科学与工程研究理事会;
关键词
Visual inspection; Human-machine collaboration; Mixed reality; Virtual reality; Metaverse; Panoramic image localization; DAMAGE DETECTION; VIRTUAL-REALITY; LOCALIZATION; FEATURES;
D O I
10.1016/j.autcon.2024.105503
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
We propose a real-time distributed collaborative system where on- and off -site inspectors perform synchronous structural inspections; called Smart Infrastructure Metaverse . Mixed Reality (MR) headsets are equipped with a holographic display that allows on -site inspectors to visualize digitized information overlaid on the structure. On the other hand, Virtual Reality (VR) headsets allow remote inspectors to visualize and interact with a prebuilt 3D point cloud map. The MR inspectors execute inspection tasks such as adding annotations or taking measurements via MR interfaces, while the VR inspectors also perform the same tasks in a virtual environment, while the scene of the structure is viewed through 360 degrees panoramic images aligned with the pre -built map using a proposed multi -shot localization algorithm. An experimental study has demonstrated the feasibility of SIM on a railroad bridge where two on -site MR inspectors and one remote VR inspector perform a visual inspection.
引用
收藏
页数:15
相关论文
共 83 条
[71]  
Theta, 2022, RICOH THETA X
[72]  
Unity, 2021, Unity real-time development platform | 3D, 2D, VR and AR engine
[73]  
Vaccarini M., 2022, Building Information Modeling - A Sustainable Approach and Emerging Technologies, DOI [10.5772/intechopen.106186, DOI 10.5772/INTECHOPEN.106186]
[74]   Global Localization from Monocular SLAM on a Mobile Phone [J].
Ventura, Jonathan ;
Arth, Clemens ;
Reitmayr, Gerhard ;
Schmalstieg, Dieter .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2014, 20 (04) :531-539
[75]   Using virtual reality technology for aircraft visual inspection training: presence and comparison studies [J].
Vora, J ;
Nair, S ;
Gramopadhye, AK ;
Duchowski, AT ;
Melloy, BJ ;
Kanki, B .
APPLIED ERGONOMICS, 2002, 33 (06) :559-570
[76]   AR/MR Remote Collaboration on Physical Tasks: A Review [J].
Wang, Peng ;
Bai, Xiaoliang ;
Billinghurst, Mark ;
Zhang, Shusheng ;
Zhang, Xiangyu ;
Wang, Shuxia ;
He, Weiping ;
Yan, Yuxiang ;
Ji, Hongyu .
ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2021, 72
[77]  
Won C, 2020, Arxiv, DOI [arXiv:2003.08056, 10.48550/arXiv.2003.08056, DOI 10.48550/ARXIV.2003.08056]
[78]   Application of Virtual Reality Method in Aircraft Maintenance Service-Taking Dornier 228 as an Example [J].
Wu, Wen-Chung ;
Van-Hoan Vu .
APPLIED SCIENCES-BASEL, 2022, 12 (14)
[79]   Image-based camera localization: an overview [J].
Wu, Yihong ;
Tang, Fulin ;
Li, Heping .
VISUAL COMPUTING FOR INDUSTRY BIOMEDICINE AND ART, 2018, 1 (01)
[80]   Enhancing wisdom manufacturing as industrial metaverse for industry and society 5.0 [J].
Yao, Xifan ;
Ma, Nanfeng ;
Zhang, Jianming ;
Wang, Kesai ;
Yang, Erfu ;
Faccio, Maurizio .
JOURNAL OF INTELLIGENT MANUFACTURING, 2024, 35 (01) :235-255