An enhanced marker pattern that achieves improved accuracy in surgical tool tracking

被引:17
作者
Cartucho, Joao [1 ]
Wang, Chiyu [1 ]
Huang, Baoru [1 ]
Elson, Dan S. [1 ]
Darzi, Ara [1 ]
Giannarou, Stamatia [1 ]
机构
[1] Imperial Coll London, Hamlyn Ctr Robot Surg, London SW7 2AZ, England
关键词
Surgical tool tracking; pose estimation; cylindrical marker; POSE ESTIMATION;
D O I
10.1080/21681163.2021.1997647
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
In computer assisted interventions (CAI), surgical tool tracking is crucial for applications such as surgical navigation, surgical skill assessment, visual servoing, and augmented reality. Tracking of cylindrical surgical tools can be achieved by printing and attaching a marker to their shaft. However, the tracking error of existing cylindrical markers is still in the millimetre range, which is too large for applications such as neurosurgery requiring sub-millimetre accuracy. To achieve tool tracking with sub-millimetre accuracy, we designed an enhanced marker pattern, which is captured on images from a monocular laparoscopic camera. The images are used as input for a tracking method which is described in this paper. Our tracking method was compared to the state-of-the-art, on simulation and ex vivo experiments. This comparison shows that our method outperforms the current state-of-the-art. Our marker achieves a mean absolute error of 0.28 [mm] and 0.45 [degrees] on ex vivo data, and 0.47 [mm] and 1.46 [degrees] on simulation. Our tracking method is real-time and runs at 55 frames per second for 720 x 576 image resolution.
引用
收藏
页码:400 / 408
页数:9
相关论文
共 26 条
[1]  
Allan M., 2021, ARXIV PREPRINT ARXIV
[2]   VisionBlender: a tool to efficiently generate computer vision datasets for robotic surgery [J].
Cartucho, Joao ;
Tukra, Samyakh ;
Li, Yunpeng ;
Elson, Daniel S. ;
Giannarou, Stamatia .
COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING-IMAGING AND VISUALIZATION, 2021, 9 (04) :331-338
[3]   CAM-Convs: Camera-Aware Multi-Scale Convolutions for Single-View Depth [J].
Facil, Jose M. ;
Ummenhofer, Benjamin ;
Zhou, Huizhong ;
Montesano, Luis ;
Brox, Thomas ;
Civera, Javier .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :11818-11827
[4]   Real-Time 6DOF Pose Estimation of Endoscopic Instruments Using Printable Markers [J].
Gadwe, Aniket ;
Ren, Hongliang .
IEEE SENSORS JOURNAL, 2019, 19 (06) :2338-2346
[5]   Vision-based deformation recovery for intraoperative force estimation of tool-tissue interaction for neurosurgery [J].
Giannarou, Stamatia ;
Ye, Menglong ;
Gras, Gauthier ;
Leibrandt, Konrad ;
Marcus, Hani J. ;
Yang, Guang-Zhong .
INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2016, 11 (06) :929-936
[6]  
Hao R, 2018, IEEE INT C INT ROBOT, P1298, DOI 10.1109/IROS.2018.8594471
[7]   Tracking and visualization of the sensing area for a tethered laparoscopic gamma probe [J].
Huang, Baoru ;
Tsai, Ya-Yen ;
Cartucho, Joao ;
Vyas, Kunal ;
Tuch, David ;
Giannarou, Stamatia ;
Elson, Daniel S. .
INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2020, 15 (08) :1389-1397
[8]   Metrics for 3D Rotations: Comparison and Analysis [J].
Huynh, Du Q. .
JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2009, 35 (02) :155-164
[9]   Exploring public opinion about liability and responsibility in surgical robotics [J].
Jamjoom, Aimun A. B. ;
Jamjoom, Ammer M. A. ;
Marcus, Hani J. .
NATURE MACHINE INTELLIGENCE, 2020, 2 (04) :194-196
[10]   Robust, Intrinsic Tracking of a Laparoscopic Ultrasound Probe for Ultrasound-Augmented Laparoscopy [J].
Jayarathne, Uditha L. ;
Chen, Elvis C. S. ;
Moore, John ;
Peters, Terry M. .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (02) :460-469