Distributed collaborative inspections through smart infrastructure metaverse

被引:0
作者
Al-Sabbag, Zaid Abbas [1 ]
Yeum, Chul Min [1 ]
Narasimhan, Sriram [2 ]
机构
[1] Univ Waterloo, Dept Civil & Environm Engn, Waterloo, ON, Canada
[2] Univ Calif Los Angeles, Dept Civil & Environm Engn, Los Angeles, CA USA
基金
加拿大自然科学与工程研究理事会;
关键词
Visual inspection; Human-machine collaboration; Mixed reality; Virtual reality; Metaverse; Panoramic image localization; DAMAGE DETECTION; VIRTUAL-REALITY; LOCALIZATION; FEATURES;
D O I
10.1016/j.autcon.2024.105503
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
We propose a real-time distributed collaborative system where on- and off -site inspectors perform synchronous structural inspections; called Smart Infrastructure Metaverse . Mixed Reality (MR) headsets are equipped with a holographic display that allows on -site inspectors to visualize digitized information overlaid on the structure. On the other hand, Virtual Reality (VR) headsets allow remote inspectors to visualize and interact with a prebuilt 3D point cloud map. The MR inspectors execute inspection tasks such as adding annotations or taking measurements via MR interfaces, while the VR inspectors also perform the same tasks in a virtual environment, while the scene of the structure is viewed through 360 degrees panoramic images aligned with the pre -built map using a proposed multi -shot localization algorithm. An experimental study has demonstrated the feasibility of SIM on a railroad bridge where two on -site MR inspectors and one remote VR inspector perform a visual inspection.
引用
收藏
页数:15
相关论文
共 83 条
[51]  
Meta Meta., 2023, Meta
[52]  
Microsoft, 2021, Microsoft mesh
[53]  
Microsoft, 2020, HoloLens 2 hardware
[54]   What is the metaverse? Definitions, technologies and the community of inquiry [J].
Ng, Davy Tsz Kit .
AUSTRALASIAN JOURNAL OF EDUCATIONAL TECHNOLOGY, 2022, 38 (04) :190-205
[55]  
OmniCV, 2020, OmniCV
[56]  
Ong S., 2021, Beginning Windows Mixed Reality Programming: For HoloLens and Mixed Reality Headsets, P175
[57]   Augmented reality and mixed reality behavior navigation system for telexistence remote assistance [J].
Oyama, Eimei ;
Tokoi, Kohei ;
Suzuki, Ryo ;
Nakamura, Sousuke ;
Shiroma, Naoji ;
Watanabe, Norifumi ;
Agah, Arvin ;
Okada, Hiroyuki ;
Omori, Takashi .
ADVANCED ROBOTICS, 2021, 35 (20) :1223-1241
[58]   Effect of marker position and size on the registration accuracy of HoloLens in a non-clinical setting with implications for high-precision surgical tasks [J].
Perez-Pachon, Laura ;
Sharma, Parivrudh ;
Brech, Helena ;
Gregory, Jenny ;
Lowe, Terry ;
Poyade, Matthieu ;
Groning, Flora .
INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2021, 16 (06) :955-966
[59]   Linear N-point camera pose determination [J].
Quan, L ;
Lan, ZD .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1999, 21 (08) :774-780
[60]   Evaluation of Mixed Reality Support for Bridge Inspectors Using BIM Data Digital Prototype for a Manual Task with a Long-Lasting Tradition [J].
Riedlinger U. ;
Klein F. ;
Hill M. ;
Lambracht C. ;
Nieborowski S. ;
Holst R. ;
Bahlau S. ;
Oppermann L. .
i-com, 2022, 21 (02) :253-267