DNN-Based Force Estimation in Hyper-Redundant Manipulators

被引:3
作者
Choi, Sunwoong [1 ]
Moon, Yonghwan [1 ,2 ]
Kim, Jeongryul [1 ]
Kim, Keri [1 ,3 ]
机构
[1] Korea Inst Sci & Technol, Seoul 02792, South Korea
[2] Korea Univ, Seoul 02841, South Korea
[3] Univ Sci & Technol, Daejeon 34113, South Korea
关键词
Hyper-redundant manipulator; Minimally invasive surgery; Surgical robot; Force estimation; Machine learning; INVASIVE SURGERY; FEEDBACK; PLATFORM;
D O I
10.1007/s12541-024-01030-7
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Hyper-redundant manipulators (HRMs) have been applied to many robotic surgery platforms because they can be bent in various directions as they consist of many rigid segments and are operated in a cable-driven manner, allowing remote placement of actuators. However, due to the long kinematic chain and wire stretching when subjected to force, HRMs have disadvantages, including inaccurate positioning and difficulty in building physics-based models. These constraints pose challenges in realizing force feedback using HRMs. In this paper, we present a deep neural network (DNN) based estimation system for the external force exerted on the distal end of the HRMs using tensions and fixed positions of the cables as input data, which can be measured outside the human body. To generate a training dataset for DNN, a physics-based HRM model considering external forces, cable tensions, cable friction, and cable extension was developed. We also proposed the iterative optimization algorithm for the optimal configuration of the HRM. The training dataset was produced through simulation using the physics-based HRM model, and then the DNN-based force estimation model was trained. The HRM prototype was fabricated to verify the reliability of the training dataset and evaluate the performance of the DNN-based force estimation model. The estimated magnitude and angle errors of the external force were 4.8% and 10.4% on average, respectively. This demonstrates the feasibility of measuring the external force without force/torque sensors, which can help realize force feedback in HRMs.
引用
收藏
页码:2111 / 2123
页数:13
相关论文
共 30 条
[1]   Toward Force Estimation in Robot-Assisted Surgery using Deep Learning with Vision and Robot State [J].
Chua, Zonghe ;
Jarc, Anthony M. ;
Okamura, Allison M. .
2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, :12335-12341
[2]   Highly articulated robotic probe for minimally invasive surgery [J].
Degani, Amir ;
Choset, Howie ;
Wolf, Alon ;
Zenati, Marco A. .
2006 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), VOLS 1-10, 2006, :4167-+
[3]   Haptics in robot-assisted surgery: Challenges and benefits [J].
Enayati N. ;
De Momi E. ;
Ferrigno G. .
IEEE Reviews in Biomedical Engineering, 2016, 9 :49-65
[4]   A Deep Learning Force Estimator System for Intracardiac Catheters [J].
Fekri, Pedram ;
Nourani, Hamid Reza ;
Razban, Masoud ;
Dargahi, Javad ;
Zadeh, Mehrdad ;
Arshi, Ahmadreza .
2021 IEEE INTERNATIONAL SYMPOSIUM ON MEDICAL MEASUREMENTS AND APPLICATIONS (IEEE MEMEA 2021), 2021,
[5]   Y-Net: A Deep Convolutional Architecture for 3D Estimation of Contact Forces in Intracardiac Catheters [J].
Fekri, Pedram ;
Khodashenas, Hamidreza ;
Lachapelle, Kevin ;
Cecere, Renzo ;
Zadeh, Mehrdad ;
Dargahi, Javad .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (02) :3592-3599
[6]   A learning-based tip contact force estimation method for tendon-driven continuum manipulator [J].
Feng, Fan ;
Hong, Wuzhou ;
Xie, Le .
SCIENTIFIC REPORTS, 2021, 11 (01)
[7]  
Fontanelli GA, 2017, IEEE INT C INT ROBOT, P1464, DOI 10.1109/IROS.2017.8205948
[8]  
Guthart G. S., 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065), P618, DOI 10.1109/ROBOT.2000.844121
[9]  
Haghighipanah M, 2015, IEEE INT C INT ROBOT, P2030, DOI 10.1109/IROS.2015.7353646
[10]   Raven-II: An Open Platform for Surgical Robotics Research [J].
Hannaford, Blake ;
Rosen, Jacob ;
Friedman, Diana W. ;
King, Hawkeye ;
Roan, Phillip ;
Cheng, Lei ;
Glozman, Daniel ;
Ma, Ji ;
Kosari, Sina Nia ;
White, Lee .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2013, 60 (04) :954-959