Soft Wearable Haptic Display and Flexible 3D Force Sensor for Teleoperated Surgical Systems

被引:6
作者
Thai, Mai Thanh [1 ,2 ]
Davies, James [1 ]
Nguyen, Chi Cong [1 ]
Phan, Phuoc Thien [1 ]
Hoang, Trung Thien [1 ]
Ji, Adrienne [1 ]
Zhu, Kefan [1 ]
Sharma, Bibhu [1 ]
Nicotra, Emanuele [1 ]
Vo-Doan, Tat Thang [3 ]
Phan, Hoang-Phuong [4 ,5 ]
Lovell, Nigel Hamilton [1 ,4 ]
Do, Thanh Nho [1 ,4 ]
机构
[1] UNSW Sydney, Fac Engn, Grad Sch Biomed Engn, Kensington Campus, Sydney, NSW 2052, Australia
[2] VinUniv, Coll Engn & Comp Sci, Hanoi, Vietnam
[3] Univ Queensland, Sch Mech & Min Engn, St Lucia, Qld 4072, Australia
[4] UNSW Sydney, Tyree Inst Hlth Engn, Sydney, NSW 2052, Australia
[5] UNSW Sydney, Fac Engn, Sch Mech & Mfg Engn, Kensington Campus, Sydney, NSW 2052, Australia
来源
ADVANCED SENSOR RESEARCH | 2024年 / 3卷 / 01期
关键词
3D force sensor; endoscopic surgery; feedforward control; soft robotics; telesurgery; wearable haptic display; TACTILE SENSOR; DESIGN; FEEDBACK; DEVICE;
D O I
10.1002/adsr.202300105
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Haptic (touch) is important for effective interaction with the surroundings. In teleoperated surgical systems, its absence leads to reduced perception, making delicate tasks difficult and resulting in unexpected damage to surrounding tissues. To enhance safety, a force-feedback system and haptic device are needed. However, existing haptic prototypes are associated with rigid, bulky, and heavy components, making effective communication with the skin problematic. This paper presents a teleoperated endoscopic surgical system with an integrated 3D force sensor and real-time haptic feedback. A surgical robotic arm is remotely controlled by a soft haptic glove incorporated 3-axis cutaneous device and a finger kinesthetic module. The 3D force sensor is constructed from hydraulic filament soft sensors that can induce pressure change under strain. To enable precise motion, the haptic glove is operated by a feedforward controller and a master-slave architecture. Experiments with human subjects (n = 15) show that cutaneous and kinesthetic feedback significantly improves the user's performance (9.4 out of 10) compared to no haptic feedback (2.27 out of 10). Finally, subjects rank the new system as highly wearable, comfortable, and effective, which is expected to bridge a gap in the surgical field and support the future development of advanced teleoperated systems. This work introduces a teleoperated surgical system with integrated 3D force sensor and a soft wearable haptic display. The new system is expected to bridge a gap in the field of wearable haptic devices and support the future development of remote surgery. image
引用
收藏
页数:15
相关论文
共 66 条
[1]   Three-Dimensional Skin Deformation as Force Substitution: Wearable Device Design and Performance During Haptic Exploration of Virtual Environments [J].
Benjamin, Samuel ;
Okamura, Allison M. .
IEEE TRANSACTIONS ON HAPTICS, 2017, 10 (03) :418-430
[2]   Flexible Active Skin: Large Reconfigurable Arrays of Individually Addressed Shape Memory Polymer Actuators [J].
Besse, Nadine ;
Rosset, Samuel ;
Zarate, Juan Jose ;
Shea, Herbert .
ADVANCED MATERIALS TECHNOLOGIES, 2017, 2 (10)
[3]   CONTROL OF PNEUMATIC MUSCLE ACTUATORS [J].
CALDWELL, DG ;
MEDRANOCERDA, GA ;
GOODWIN, M .
IEEE CONTROL SYSTEMS MAGAZINE, 1995, 15 (01) :40-48
[4]  
Chathuranga D. S., 2016, 2016 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS)
[5]   Machine Learning for Soft Robotic Sensing and Control [J].
Chin, Keene ;
Hellebrekers, Tess ;
Majidi, Carmel .
ADVANCED INTELLIGENT SYSTEMS, 2020, 2 (06)
[6]  
Chinello F., 2015, 2015 IEEE Int. Conf. on Advanced Intelligent Mechatronics (AIM)
[7]   A Modular Wearable Finger Interface for Cutaneous and Kinesthetic Interaction: Control and Evaluation [J].
Chinello, Francesco ;
Malvezzi, Monica ;
Prattichizzo, Domenico ;
Pacchierotti, Claudio .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2020, 67 (01) :706-716
[8]   Design and Evaluation of a Wearable Skin Stretch Device for Haptic Guidance [J].
Chinello, Francesco ;
Pacchierotti, Claudio ;
Bimbo, Joao ;
Tsagarakis, Nikos G. ;
Prattichizzo, Domenico .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2018, 3 (01) :524-531
[9]  
Choi H, 2017, IEEE INT SYMP CIRC S
[10]   Biomedical applications of soft robotics [J].
Cianchetti, Matteo ;
Laschi, Cecilia ;
Menciassi, Arianna ;
Dario, Paolo .
NATURE REVIEWS MATERIALS, 2018, 3 (06) :143-153