Distributed collaborative inspections through smart infrastructure metaverse

被引:0
作者
Al-Sabbag, Zaid Abbas [1 ]
Yeum, Chul Min [1 ]
Narasimhan, Sriram [2 ]
机构
[1] Univ Waterloo, Dept Civil & Environm Engn, Waterloo, ON, Canada
[2] Univ Calif Los Angeles, Dept Civil & Environm Engn, Los Angeles, CA USA
基金
加拿大自然科学与工程研究理事会;
关键词
Visual inspection; Human-machine collaboration; Mixed reality; Virtual reality; Metaverse; Panoramic image localization; DAMAGE DETECTION; VIRTUAL-REALITY; LOCALIZATION; FEATURES;
D O I
10.1016/j.autcon.2024.105503
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
We propose a real-time distributed collaborative system where on- and off -site inspectors perform synchronous structural inspections; called Smart Infrastructure Metaverse . Mixed Reality (MR) headsets are equipped with a holographic display that allows on -site inspectors to visualize digitized information overlaid on the structure. On the other hand, Virtual Reality (VR) headsets allow remote inspectors to visualize and interact with a prebuilt 3D point cloud map. The MR inspectors execute inspection tasks such as adding annotations or taking measurements via MR interfaces, while the VR inspectors also perform the same tasks in a virtual environment, while the scene of the structure is viewed through 360 degrees panoramic images aligned with the pre -built map using a proposed multi -shot localization algorithm. An experimental study has demonstrated the feasibility of SIM on a railroad bridge where two on -site MR inspectors and one remote VR inspector perform a visual inspection.
引用
收藏
页数:15
相关论文
共 83 条
[1]  
AASHTO, 2019, Manual for bridge element inspection
[2]   Enabling human-machine collaboration in infrastructure inspections through mixed reality [J].
Al-Sabbag, Zaid Abbas ;
Yeum, Chul Min ;
Narasimhan, Sriram .
ADVANCED ENGINEERING INFORMATICS, 2022, 53
[3]   Interactive defect quantification through extended reality [J].
Al-Sabbag, Zaid Abbas ;
Yeum, Chul Min ;
Narasimhan, Sriram .
ADVANCED ENGINEERING INFORMATICS, 2022, 51
[4]   Structural crack detection using deep convolutional neural networks [J].
Ali, Raza ;
Chuah, Joon Huang ;
Abu Talip, Mohamad Sofian ;
Mokhtar, Norrima ;
Shoaib, Muhammad Ali .
AUTOMATION IN CONSTRUCTION, 2022, 133
[5]  
Arandjelovic R, 2016, Arxiv, DOI arXiv:1511.07247
[6]  
Arth C., 2011, 2011 IEEE International Symposium on Mixed and Augmented Reality, P37, DOI 10.1109/ISMAR.2011.6092368
[7]  
Arth C, 2012, INT C PATT RECOG, P2152
[8]   Wide Area Localization on Mobile Phones [J].
Arth, Clemens ;
Wagner, Daniel ;
Klopschitz, Manfred ;
Irschara, Arnold ;
Schmalstieg, Dieter .
2009 8TH IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY - SCIENCE AND TECHNOLOGY, 2009, :73-82
[9]  
Beltrán J, 2022, Arxiv, DOI [arXiv:2101.04431, DOI 10.48550/ARXIV.2101.04431, 10.1109/TITS.2022.3155228]
[10]   The Use of Augmented Reality and Virtual Reality in Ergonomic Applications for Education, Aviation, and Maintenance [J].
Brown, Christopher ;
Hicks, Jamison ;
Rinaudo, Christina H. ;
Burch, Reuben .
ERGONOMICS IN DESIGN, 2023, 31 (04) :23-31