A Novel Evaluation Method for SLAM-Based 3D Reconstruction of Lumen Panoramas

被引:1
作者
Yu, Xiaoyu [1 ,2 ]
Zhao, Jianbo [2 ]
Wu, Haibin [2 ]
Wang, Aili [2 ]
机构
[1] Univ Elect Sci & Technol China, Zhongshan Inst, Coll Electron & Informat, Zhongshan 528402, Peoples R China
[2] Harbin Univ Sci & Technol, Heilongjiang Prov Key Lab Laser Spect Technol & Ap, Harbin 150080, Peoples R China
关键词
monocular vision; simultaneous localization and mapping; 3D reconstruction; accuracy evaluation;
D O I
10.3390/s23167188
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Laparoscopy is employed in conventional minimally invasive surgery to inspect internal cavities by viewing two-dimensional images on a monitor. This method has a limited field of view and provides insufficient information for surgeons, increasing surgical complexity. Utilizing simultaneous localization and mapping (SLAM) technology to reconstruct laparoscopic scenes can offer more comprehensive and intuitive visual feedback. Moreover, the precision of the reconstructed models is a crucial factor for further applications of surgical assistance systems. However, challenges such as data scarcity and scale uncertainty hinder effective assessment of the accuracy of endoscopic monocular SLAM reconstructions. Therefore, this paper proposes a technique that incorporates existing knowledge from calibration objects to supplement metric information and resolve scale ambiguity issues, and it quantifies the endoscopic reconstruction accuracy based on local alignment metrics. The experimental results demonstrate that the reconstructed models restore realistic scales and enable error analysis for laparoscopic SLAM reconstruction systems. This suggests that for the evaluation of monocular SLAM three-dimensional (3D) reconstruction accuracy in minimally invasive surgery scenarios, our proposed scheme for recovering scale factors is viable, and our evaluation outcomes can serve as criteria for measuring reconstruction precision.
引用
收藏
页数:15
相关论文
共 15 条
  • [1] Balasuriya B.L.E.A., 2016, P 2016 MOR ENG RES C
  • [2] Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age
    Cadena, Cesar
    Carlone, Luca
    Carrillo, Henry
    Latif, Yasir
    Scaramuzza, Davide
    Neira, Jose
    Reid, Ian
    Leonard, John J.
    [J]. IEEE TRANSACTIONS ON ROBOTICS, 2016, 32 (06) : 1309 - 1332
  • [3] BundleFusion: Real-Time Globally Consistent 3D Reconstruction Using On-the-Fly Surface Reintegration
    Dai, Angela
    Niessner, Matthias
    Zollhofer, Michael
    Izadi, Shahram
    Theobalt, Christian
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2017, 36 (03):
  • [4] Robocentric visual-inertial odometry
    Huai, Zheng
    Huang, Guoquan
    [J]. INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2022, 41 (07) : 667 - 689
  • [5] Dense Depth Estimation in Monocular Endoscopy With Self-Supervised Learning Methods
    Liu, Xingtong
    Sinha, Ayushi
    Ishii, Masaru
    Hager, Gregory D.
    Reiter, Austin
    Taylor, Russell H.
    Unberath, Mathias
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (05) : 1438 - 1447
  • [6] Live Tracking and Dense Reconstruction for Handheld Monocular Endoscopy
    Mahmoud, Nader
    Collins, Toby
    Hostettler, Alexandre
    Soler, Luc
    Doignon, Christophe
    Martinez Montiel, Jose Maria
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (01) : 79 - 89
  • [7] EndoSLAM dataset and an unsupervised monocular visual odometry and depth estimation approach for endoscopic videos
    Ozyoruk, Kutsev Bengisu
    Gokceler, Guliz Irem
    Bobrow, Taylor L.
    Coskun, Gulfize
    Incetan, Kagan
    Almalioglu, Yasin
    Mahmood, Faisal
    Curto, Eva
    Perdigoto, Luis
    Oliveira, Marina
    Sahin, Hasan
    Araujo, Helder
    Alexandrino, Henrique
    Durr, Nicholas J.
    Gilbert, Hunter B.
    Turan, Mehmet
    [J]. MEDICAL IMAGE ANALYSIS, 2021, 71
  • [8] Peng X., 2021, P 2021 IEEE RSJ INT
  • [9] Qin T, 2019, Arxiv, DOI arXiv:1901.03638
  • [10] Endo-Depth-and-Motion: Reconstruction and Tracking in Endoscopic Videos Using Depth Networks and Photometric Constraints
    Recasens, David
    Lamarca, Jose
    Facil, Jose M.
    Montiel, J. M. M.
    Civera, Javier
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (04) : 7225 - 7232