ColibriDoc: An Eye-in-Hand Autonomous Trocar Docking System

被引:0
作者
Dehghani, Shervin [1 ]
Sommersperger, Michael [1 ]
Yang, Junjie [2 ]
Salehi, Mehrdad [1 ]
Busam, Benjamin [1 ]
Huang, Kai [3 ]
Gehlbach, Peter [4 ]
Iordachita, Iulian [5 ]
Navab, Nassir [6 ,7 ]
Nasseri, M. Ali [1 ,2 ]
机构
[1] Tech Univ Munich, Dept Comp Sci, D-85748 Munich, Germany
[2] Tech Univ Munich, Augenklin & Poliklin, Klinikum Rechts Isar, Munich, Germany
[3] Sun Yat Sen Univ, Key Lab Machine Intelligence & Adv Comp, Guangzhou, Peoples R China
[4] Johns Hopkins Univ Hosp, Wilmer Eye Inst, Baltimore, MD USA
[5] Johns Hopkins Univ, Lab Computat Sensing & Robot, Baltimore, MD USA
[6] Tech Univ Munich, Chair Comp Aided Med Procedures Augmented Real, D-85748 Munich, Germany
[7] Johns Hopkins Univ, Whiting Sch Engn, Baltimore, MD USA
来源
2022 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA 2022 | 2022年
基金
美国国家卫生研究院;
关键词
Medical Robots and Systems; Surgical Robotics: Planning; Computer Vision for Medical Robotics;
D O I
10.1109/ICRA46639.2022.9811364
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Retinal surgery is a complex medical procedure that requires exceptional expertise and dexterity. For this purpose, several robotic platforms are currently under development to enable or improve the outcome of microsurgical tasks. Since the control of such robots is often designed for navigation inside the eye in proximity to the retina, successful trocar docking and insertion of the instrument into the eye represents an additional cognitive effort, and is therefore one of the open challenges in robotic retinal surgery. For this purpose, we present a platform for autonomous trocar docking that combines computer vision and a robotic setup. Inspired by the Cuban Colibri (hummingbird) aligning its beak to a flower using only vision, we mount a camera onto the endeffector of a robotic system. By estimating the position and pose of the trocar, the robot is able to autonomously align and navigate the instrument towards the Trocar Entry Point (TEP) and finally perform the insertion. Our experiments show that the proposed method is able to accurately estimate the position and pose of the trocar and achieve repeatable autonomous docking. The aim of this work is to reduce the complexity of the robotic setup prior to the surgical task and therefore, increase the intuitiveness of the system integration into clinical workflow.
引用
收藏
页码:7717 / 7723
页数:7
相关论文
共 31 条
  • [1] Birch J., Towards localisation of remote centre of motion and trocar in vitreoretinal surgery, P33
  • [2] Cutting-edge advances in therapy for the posterior segment of the eye: Solid lipid nanoparticles and nanostructured lipid carriers
    de Oliveira, Isabela Fernandes
    Barbosa, Eduardo Jose
    Camasmie Peters, Maria Christina
    Bazan Henostroza, Mirla Anali
    Yukuyama, Megumi Nishitani
    Neto, Edson dos Santos
    Lobenberg, Raimar
    Bou-Chacra, Nadia
    [J]. INTERNATIONAL JOURNAL OF PHARMACEUTICS, 2020, 589
  • [3] Dong L, 2016, IEEE INT CONF ROBOT, P4109, DOI 10.1109/ICRA.2016.7487602
  • [4] Flandin G., 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065), P2741, DOI 10.1109/ROBOT.2000.846442
  • [5] Gijbels A, 2014, P IEEE RAS-EMBS INT, P144, DOI 10.1109/BIOROB.2014.6913767
  • [6] Visual Sensory Signals Dominate Tactile Cues during Docked Feeding in Hummingbirds
    Goller, Benjamin
    Segre, Paolo S.
    Middleton, Kevin M.
    Dickinson, Michael H.
    Altshuler, Douglas L.
    [J]. FRONTIERS IN NEUROSCIENCE, 2017, 11
  • [7] Hummingbirds control hovering flight by stabilizing visual motion
    Goller, Benjamin
    Altshuler, Douglas L.
    [J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2014, 111 (51) : 18375 - 18380
  • [8] Gruijthuijsen Caspar, 2018, IEEE Robotics and Automation Letters, V3, P2071, DOI 10.1109/LRA.2018.2809495
  • [9] Deep Residual Learning for Image Recognition
    He, Kaiming
    Zhang, Xiangyu
    Ren, Shaoqing
    Sun, Jian
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 770 - 778
  • [10] HAND-EYE CALIBRATION
    HORAUD, R
    DORNAIKA, F
    [J]. INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 1995, 14 (03) : 195 - 210