Video-based 3D reconstruction, laparoscope localization and deformation recovery for abdominal minimally invasive surgery: a survey

被引:52
作者
Lin, Bingxiong [1 ]
Sun, Yu [1 ]
Qian, Xiaoning [2 ]
Goldgof, Dmitry [1 ]
Gitlin, Richard [3 ]
You, Yuncheng [4 ]
机构
[1] Univ S Florida, Dept Comp Sci & Engn, Tampa, FL USA
[2] Texas A&M Univ, Dept Elect & Comp Engn, College Stn, TX USA
[3] Univ S Florida, Dept Elect Engn, Tampa, FL USA
[4] Univ S Florida, Dept Math & Stat, Tampa, FL USA
基金
美国国家科学基金会;
关键词
visual SLAM; surface reconstruction; tissue deformation; feature detection; feature tracking; laparoscopy; pose estimation; camera tracking; MEDICAL IMAGE REGISTRATION; STRUCTURE-FROM-MOTION; GUIDED NEUROSURGERY; OPTICAL TECHNIQUES; REAL; TRACKING; SURFACE; INSTRUMENTS; STEREO; SHAPE;
D O I
10.1002/rcs.1661
中图分类号
R61 [外科手术学];
学科分类号
摘要
Background The intra-operative three-dimensional (3D) structure of tissue organs and laparoscope motion are the basis for many tasks in computer-assisted surgery (CAS), such as safe surgical navigation and registration of pre-operative and intra-operative data for soft tissues. Methods This article provides a literature review on laparoscopic video-based intra-operative techniques of 3D surface reconstruction, laparoscope localization and tissue deformation recovery for abdominal minimally invasive surgery (MIS). Results This article introduces a classification scheme based on the motions of a laparoscope and the motions of tissues. In each category, comprehensive discussion is provided on the evolution of both classic and state-of-the-art methods. Conclusions Video-based approaches have many advantages, such as providing intra-operative information without introducing extra hardware to the current surgical platform. However, an extensive discussion on this important topic is still lacking. This survey paper is therefore beneficial for researchers in this field. Copyright (C) 2015 John Wiley & Sons, Ltd.
引用
收藏
页码:158 / 178
页数:21
相关论文
共 34 条
[21]   Monocular Video Frame Optimization Through Feature-Based Parallax Analysis for 3D Pipe Reconstruction [J].
Xu, Zhihua ;
Lu, Xingzheng ;
Wang, Wenliang ;
Xu, Ershaui ;
Qin, Rongjun ;
Niu, Yiru ;
Qiao, Xu ;
Yang, Feng ;
Yan, Rui .
PHOTOGRAMMETRIC ENGINEERING AND REMOTE SENSING, 2022, 88 (07) :469-478
[22]   A review of deep learning-based localization, mapping and 3D reconstruction for endoscopy [J].
Zhong, Jiawei ;
Ren, Hongliang ;
Chen, Qin ;
Zhang, Hui .
JOURNAL OF MICRO AND BIO ROBOTICS, 2025, 21 (01)
[23]   A Monocular Fisheye Video-Based 2D to 3D Pose Lift Technique with Multiperson Spatial Context Integration [J].
Hassan, Iqbal ;
Nahid, Nazmun ;
Inoue, Sozo .
COMPANION OF THE 2024 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING, UBICOMP COMPANION 2024, 2024, :475-480
[24]   Dense soft tissue 3D reconstruction refined with super-pixel segmentation for robotic abdominal surgery [J].
Veronica Penza ;
Jesús Ortiz ;
Leonardo S. Mattos ;
Antonello Forgione ;
Elena De Momi .
International Journal of Computer Assisted Radiology and Surgery, 2016, 11 :197-206
[25]   A Survey on Model Based Approaches for 2D and 3D Visual Human Pose Recovery [J].
Perez-Sala, Xavier ;
Escalera, Sergio ;
Angulo, Cecilio ;
Gonzalez, Jordi .
SENSORS, 2014, 14 (03) :4189-4210
[26]   Drone-NeRF: Efficient NeRF based 3D scene reconstruction for large-scale drone survey [J].
Jia, Zhihao ;
Wang, Bing ;
Chen, Changhao .
IMAGE AND VISION COMPUTING, 2024, 143
[27]   Multi-view 3D reconstruction based on deep learning: A survey and comparison of methods [J].
Wu, Juhao ;
Wyman, Omar ;
Tang, Yadong ;
Pasini, Damiano ;
Wang, Wenlong .
NEUROCOMPUTING, 2024, 582
[28]   Autonomous MAV-based Indoor Chimney Inspection with 3D Laser Localization and Textured Surface Reconstruction [J].
Quenzel, Jan ;
Nieuwenhuisen, Matthias ;
Droeschel, David ;
Beul, Marius ;
Houben, Sebastian ;
Behnke, Sven .
JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2019, 93 (1-2) :317-335
[29]   Autonomous MAV-based Indoor Chimney Inspection with 3D Laser Localization and Textured Surface Reconstruction [J].
Jan Quenzel ;
Matthias Nieuwenhuisen ;
David Droeschel ;
Marius Beul ;
Sebastian Houben ;
Sven Behnke .
Journal of Intelligent & Robotic Systems, 2019, 93 :317-335
[30]   Fast 3D Map Reconstruction Using Dense Visual Simultaneous Localization and Mapping Based on Unmanned Aerial Vehicle [J].
Peng, Siyuan ;
Huang, Fang ;
Tao, Jian ;
Tie, Bo ;
Lu, Jun ;
Zhang, Xiaodong .
IGARSS 2018 - 2018 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2018, :5712-5715