3D Indoor Scene Reconstruction and Change Detection for Robotic Sensing and Navigation

被引:5
|
作者
Liu, Ruixu [1 ]
Asari, Vijayan K. [1 ]
机构
[1] Univ Dayton, 300 Coll Pk, Dayton, OH 45469 USA
来源
MOBILE MULTIMEDIA/IMAGE PROCESSING, SECURITY, AND APPLICATIONS 2017 | 2017年 / 10221卷
关键词
3D reconstruction; point-cloud; ICP; bag-of-word; ORB; Octomap; change detection;
D O I
10.1117/12.2262831
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
A new methodology for 3D change detection which can support effective robot sensing and navigation in a reconstructed indoor environment is presented in this paper. We register the RGB-D images acquired with an untracked camera into a globally consistent and accurate point-cloud model. This paper introduces a robust system that detects camera position for multiple RGB video frames by using both photo-metric error and feature based method. It utilizes the iterative closest point (ICP) algorithm to establish geometric constraints between the point-cloud as they become aligned. For the change detection part, a bag-of-word (DBoW) model is used to match the current frame with the previous key frames based on RGB images with Oriented FAST and Rotated BRIEF (ORB) feature. Then combine the key-frame translation and ICP to align the current point-cloud with reconstructed 3D scene to localize the robot position. Meanwhile, camera position and orientation are used to aid robot navigation. After preprocessing the data, we create an Octomap Model to detect the scene change measurements. The experimental evaluations performed to evaluate the capability of our algorithm show that the robot's location and orientation are accurately determined and provide promising results for change detection indicating all the object changes with very limited false alarm rate.
引用
收藏
页数:7
相关论文
共 50 条
  • [41] 3D Reconstruction of Indoor Scenes via Image Registration
    Ce Li
    Bing Lu
    Yachao Zhang
    Hao Liu
    Yanyun Qu
    Neural Processing Letters, 2018, 48 : 1281 - 1304
  • [42] 3D Reconstruction of Indoor Environment Using the Kinect Sensor
    Zhang, Jing
    Huang, Qian
    Peng, Xiang
    2015 FIFTH INTERNATIONAL CONFERENCE ON INSTRUMENTATION AND MEASUREMENT, COMPUTER, COMMUNICATION AND CONTROL (IMCCC), 2015, : 537 - 540
  • [43] Deep monocular 3D reconstruction for assisted navigation in bronchoscopy
    Marco Visentini-Scarzanella
    Takamasa Sugiura
    Toshimitsu Kaneko
    Shinichiro Koto
    International Journal of Computer Assisted Radiology and Surgery, 2017, 12 : 1089 - 1099
  • [44] 3D Reconstruction of Indoor Scenes via Image Registration
    Li, Ce
    Lu, Bing
    Zhang, Yachao
    Liu, Hao
    Qu, Yanyun
    NEURAL PROCESSING LETTERS, 2018, 48 (03) : 1281 - 1304
  • [45] Differential Information Aided 3-D Registration for Accurate Navigation and Scene Reconstruction
    Wu, Jin
    Zhang, Shuyang
    Zhu, Yilong
    Geng, Ruoyu
    Fu, Zhongtao
    Ma, Fulong
    Liu, Ming
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 9249 - 9254
  • [46] Deep monocular 3D reconstruction for assisted navigation in bronchoscopy
    Visentini-Scarzanella, Marco
    Sugiura, Takamasa
    Kaneko, Toshimitsu
    Koto, Shinichiro
    INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2017, 12 (07) : 1089 - 1099
  • [47] Time-of-Flight Camera Calibration for Improved 3D Reconstruction of Indoor Scenes
    Xie, Meng
    Cooperstock, Jeremy R.
    2014 SEVENTH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN (ISCID 2014), VOL 2, 2014,
  • [48] Semantics-and-Primitives-Guided Indoor 3D Reconstruction from Point Clouds
    Wang, Tengfei
    Wang, Qingdong
    Ai, Haibin
    Zhang, Li
    REMOTE SENSING, 2022, 14 (19)
  • [49] 3D Scene Reconstruction from Multiple Spherical Stereo Pairs
    Hansung Kim
    Adrian Hilton
    International Journal of Computer Vision, 2013, 104 : 94 - 116
  • [50] Outdoor Scene 3D Reconstruction from Multiple Point Cloud
    Hui, Chen
    Yan, Feng
    Sun Jinzhong
    Jian, Yang
    Cui Chenggang
    TENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING (ICGIP 2018), 2019, 11069