Manipulating Soft Tissues by Deep Reinforcement Learning for Autonomous Robotic Surgery

被引:37
作者
Ngoc Duy Nguyen [1 ]
Thanh Nguyen [1 ]
Nahavandi, Saeid [1 ]
Bhatti, Asim [1 ]
Guest, Glenn [2 ]
机构
[1] Deakin Univ, Inst Intelligent Syst Res & Innovat IISRI, Geelong, Vic, Australia
[2] Deakin Univ, Fac Hlth, Geelong, Vic, Australia
来源
2019 13TH ANNUAL IEEE INTERNATIONAL SYSTEMS CONFERENCE (SYSCON) | 2019年
关键词
pattern cutting; soft tissue; deep learning; rein-forcement learning; tensioning; surgical robotics;
D O I
10.1109/syscon.2019.8836924
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In robotic surgery, pattern cutting through a deformable material is a challenginp, research field. The cutting procedure requires a robot to concurrently manipulate a scissor and a gripper to cut through a predefined contour trajectory on the deformable sheet. The gripper ensures the cutting accuracy by nailing a point on the sheet and continuously tensioning the pinch point to different directions while the scissor is in action. The goal is to find a pinch point and a corresponding tensioning policy to minimize damage to the material and increase cutting accuracy measured by the symmetric difference between the predefined contour and the cut contour. Previous study considers finding one fixed pinch point during the course of cutting, which is inaccurate and unsafe when the contour trajectory is complex. In this paper, we examine the soft tissue cutting task by using multiple pinch points, which imitates human operations while cutting. This approach, however, does not require the use of a multi-gripper robot. We use a deep reinforcement learning algorithm to find an optimal tensioning policy of a pinch point. Simulation results show that the multi-point approach outperforms the state-of-the-art method in soft pattern cutting task with respect to both accuracy and reliability.
引用
收藏
页数:7
相关论文
共 40 条
[1]  
Billard A., 2008, Handbook of robotics, V59
[2]  
Chen J, 2016, 2016 EIGHTH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTATIONAL INTELLIGENCE (ICACI), P378, DOI 10.1109/ICACI.2016.7449855
[3]  
Crawford N. R., 2017, U.S. Patent Application, Patent No. [15/609,334, 15609334]
[4]   Variable Admittance Control Based on Fuzzy Reinforcement Learning for Minimally Invasive Surgery Manipulator [J].
Du, Zhijiang ;
Wang, Wei ;
Yan, Zhiyuan ;
Dong, Wei ;
Wang, Weidong .
SENSORS, 2017, 17 (04)
[5]  
Duan Y, 2016, PR MACH LEARN RES, V48
[6]   Developing a comprehensive, proficiency-based training program for robotic surgery [J].
Dulan, Genevieve ;
Rege, Robert V. ;
Hogg, Deborah C. ;
Gilberg-Fisher, Kristine M. ;
Arain, Nabeel A. ;
Tesfay, Seifu T. ;
Scott, Daniel J. .
SURGERY, 2012, 152 (03) :477-488
[7]  
Nguyen ND, 2018, Arxiv, DOI arXiv:1804.01874
[8]   An over-view of robot assisted surgery curricula and the status of their validation [J].
Fisher, Rebecca A. ;
Dasgupta, Prokar ;
Mottrie, Alex ;
Volpe, Alessandro ;
Khan, Mohammed S. ;
Challacombe, Ben ;
Ahmed, Kamran .
INTERNATIONAL JOURNAL OF SURGERY, 2015, 13 :115-123
[9]   Impact of Soft Tissue Heterogeneity on Augmented Reality for Liver Surgery [J].
Haouchine, Nazim ;
Cotin, Stephane ;
Peterlik, Igor ;
Dequidt, Jeremie ;
Lopez, Mario Sanz ;
Kerrien, Erwan ;
Berger, Marie-Odile .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2015, 21 (05) :584-597
[10]   Surgical robotics beyond enhanced dexterity instrumentation: a survey of machine learning techniques and their role in intelligent and autonomous surgical actions [J].
Kassahun, Yohannes ;
Yu, Bingbin ;
Tibebu, Abraham Temesgen ;
Stoyanov, Danail ;
Giannarou, Stamatia ;
Metzen, Jan Hendrik ;
Vander Poorten, Emmanuel .
INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2016, 11 (04) :553-568