Hybrid approach for alignment of a pre-processed three-dimensional point cloud, video, and CAD model using partial point cloud in retrofitting applications

被引:7
作者
Patil, Ashok Kumar [1 ]
Kumar, G. Ajay [1 ]
Kim, Tae-Hyoung [2 ]
Chai, Young Ho [1 ]
机构
[1] Chung Ang Univ, Grad Sch Adv Imaging Sci Multimedia & Film, Seoul 156756, South Korea
[2] Chung Ang Univ, Dept Mech Engn, Seoul, South Korea
来源
INTERNATIONAL JOURNAL OF DISTRIBUTED SENSOR NETWORKS | 2018年 / 14卷 / 03期
关键词
Laser scanner; point cloud alignment; retrofitting; building information modeling; virtual reality; LiDAR; registration; OBJECT MAPS; REGISTRATION;
D O I
10.1177/1550147718766452
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Acquiring the three-dimensional point cloud data of a scene using a laser scanner and the alignment of the point cloud data within a real-time video environment view of a camera is a very new concept and is an efficient method for constructing, monitoring, and retrofitting complex engineering models in heavy industrial plants. This article presents a novel prototype framework for virtual retrofitting applications. The workflow includes an efficient 4-in-1 alignment, beginning with the coordination of pre-processed three-dimensional point cloud data using a partial point cloud from LiDAR and alignment of the pre-processed point cloud within the video scene using a frame-by-frame registering method. Finally, the proposed approach can be utilized in pre-retrofitting applications by pre-generated three-dimensional computer-aided design models virtually retrofitted with the help of a synchronized point cloud, and a video scene is efficiently visualized using a wearable virtual reality device. The prototype method is demonstrated in a real-world setting, using the partial point cloud from LiDAR, pre-processed point cloud data, and video from a two-dimensional camera.
引用
收藏
页数:13
相关论文
共 27 条
[11]  
Endres F, 2012, IEEE INT CONF ROBOT, P1691, DOI 10.1109/ICRA.2012.6225199
[12]   Registration with the Point Cloud Library A Modular Framework for Aligning in 3-D [J].
Holz, Dirk ;
Ichim, Alexandru-Eugen ;
Tombari, Federico ;
Rusu, Radu B. ;
Behnke, Sven .
IEEE ROBOTICS & AUTOMATION MAGAZINE, 2015, 22 (04) :110-124
[13]   Visual Odometry and Mapping for Autonomous Flight Using an RGB-D Camera [J].
Huang, Albert S. ;
Bachrach, Abraham ;
Henry, Peter ;
Krainin, Michael ;
Maturana, Daniel ;
Fox, Dieter ;
Roy, Nicholas .
ROBOTICS RESEARCH, ISRR, 2017, 100
[14]   A LiDAR and IMU Integrated Indoor Navigation System for UAVs and Its Application in Real-Time Pipeline Classification [J].
Kumar, G. Ajay ;
Patil, Ashok Kumar ;
Patil, Rekha ;
Park, Seong Sill ;
Chai, Young Ho .
SENSORS, 2017, 17 (06)
[15]  
Litomisky Krystof., 2012, Consumer rgb-d cameras and their applications, P20
[16]  
Low Kok lim, 2004, TECHNICAL REPORT, P3
[17]   SPACESKETCH: Shape modeling with 3D meshes and control curves in stereoscopic environments [J].
Nam, Sanghun ;
Chai, Youngho .
COMPUTERS & GRAPHICS-UK, 2012, 36 (05) :526-533
[18]   The Design of 3D Laser Range Finder for Robot Navigation and Mapping in Industrial Environment with Point Clouds Preprocessing [J].
Olivka, Petr ;
Mihola, Milan ;
Novak, Petr ;
Kot, Tomas ;
Babjak, Jan .
MODELLING AND SIMULATION FOR AUTONOMOUS SYSTEMS, MESAS 2016, 2016, 9991 :371-383
[19]   An adaptive approach for the reconstruction and modeling of as-built 3D pipelines from point clouds [J].
Patil, Ashok Kumar ;
Holi, Pavitra ;
Lee, Sang Keun ;
Chai, Young Ho .
AUTOMATION IN CONSTRUCTION, 2017, 75 :65-78
[20]   Aligning Point Cloud Views using Persistent Feature Histograms [J].
Rusu, Radu Bogdan ;
Blodow, Nico ;
Marton, Zoltan Csaba ;
Beetz, Michael .
2008 IEEE/RSJ INTERNATIONAL CONFERENCE ON ROBOTS AND INTELLIGENT SYSTEMS, VOLS 1-3, CONFERENCE PROCEEDINGS, 2008, :3384-3391