Distributed collaborative inspections through smart infrastructure metaverse

被引：2
作者：
Al-Sabbag, Zaid Abbas [1 ]
Yeum, Chul Min [1 ]
Narasimhan, Sriram [2 ]
机构：
[1] Univ Waterloo, Dept Civil & Environm Engn, Waterloo, ON, Canada
[2] Univ Calif Los Angeles, Dept Civil & Environm Engn, Los Angeles, CA USA
来源：
AUTOMATION IN CONSTRUCTION | 2024年 / 165卷
基金：
加拿大自然科学与工程研究理事会;
关键词：
Visual inspection; Human-machine collaboration; Mixed reality; Virtual reality; Metaverse; Panoramic image localization; DAMAGE DETECTION; VIRTUAL-REALITY; LOCALIZATION; FEATURES;
D O I：
10.1016/j.autcon.2024.105503
中图分类号：
TU [建筑科学];
学科分类号：
0813 ;
摘要：
We propose a real-time distributed collaborative system where on- and off -site inspectors perform synchronous structural inspections; called Smart Infrastructure Metaverse . Mixed Reality (MR) headsets are equipped with a holographic display that allows on -site inspectors to visualize digitized information overlaid on the structure. On the other hand, Virtual Reality (VR) headsets allow remote inspectors to visualize and interact with a prebuilt 3D point cloud map. The MR inspectors execute inspection tasks such as adding annotations or taking measurements via MR interfaces, while the VR inspectors also perform the same tasks in a virtual environment, while the scene of the structure is viewed through 360 degrees panoramic images aligned with the pre -built map using a proposed multi -shot localization algorithm. An experimental study has demonstrated the feasibility of SIM on a railroad bridge where two on -site MR inspectors and one remote VR inspector perform a visual inspection.
引用
收藏
页数：15
相关论文
共 83 条
[61]  
Rublee E, 2011, IEEE I CONF COMP VIS, P2564, DOI 10.1109/ICCV.2011.6126544
[62]  
Sarlin PE, 2020, Arxiv, DOI [arXiv:1911.11763, DOI 10.48550/ARXIV.1911.11763]
[63]   From Coarse to Fine: Robust Hierarchical Localization at Large Scale [J].
Sarlin, Paul-Edouard ;
Cadena, Cesar ;
Siegwart, Roland ;
Dymczyk, Marcin .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :12708-12717
[64]  
Sattler T, 2011, IEEE I CONF COMP VIS, P667, DOI 10.1109/ICCV.2011.6126302
[65]  
Schäfer A, 2021, Arxiv, DOI arXiv:2102.05998
[66]  
Seeman Mattias., 2007, 2007 IEEE International Workshop on Safety, Security and Rescue Robotics, P1, DOI [10.1109/SSRR.2007.4381282, DOI 10.1109/SSRR.2007.4381282]
[67]  
Shan TX, 2021, Arxiv, DOI [arXiv:2104.10831, DOI 10.48550/ARXIV.2104.10831]
[68]  
Simek K., 2013, Dissecting the Camera Matrix, Part 3: The Intrinsic Matrix
[69]   Advances in Computer Vision-Based Civil Infrastructure Inspection and Monitoring [J].
Spencer, Billie F., Jr. ;
Hoskere, Vedhus ;
Narazaki, Yasutaka .
ENGINEERING, 2019, 5 (02) :199-222
[70]  
Sun JM, 2021, Arxiv, DOI arXiv:2104.00680
123456789