Soft Wearable Haptic Display and Flexible 3D Force Sensor for Teleoperated Surgical Systems

被引:7
作者
Thai, Mai Thanh [1 ,2 ]
Davies, James [1 ]
Nguyen, Chi Cong [1 ]
Phan, Phuoc Thien [1 ]
Hoang, Trung Thien [1 ]
Ji, Adrienne [1 ]
Zhu, Kefan [1 ]
Sharma, Bibhu [1 ]
Nicotra, Emanuele [1 ]
Vo-Doan, Tat Thang [3 ]
Phan, Hoang-Phuong [4 ,5 ]
Lovell, Nigel Hamilton [1 ,4 ]
Do, Thanh Nho [1 ,4 ]
机构
[1] UNSW Sydney, Fac Engn, Grad Sch Biomed Engn, Kensington Campus, Sydney, NSW 2052, Australia
[2] VinUniv, Coll Engn & Comp Sci, Hanoi, Vietnam
[3] Univ Queensland, Sch Mech & Min Engn, St Lucia, Qld 4072, Australia
[4] UNSW Sydney, Tyree Inst Hlth Engn, Sydney, NSW 2052, Australia
[5] UNSW Sydney, Fac Engn, Sch Mech & Mfg Engn, Kensington Campus, Sydney, NSW 2052, Australia
来源
ADVANCED SENSOR RESEARCH | 2024年 / 3卷 / 01期
关键词
3D force sensor; endoscopic surgery; feedforward control; soft robotics; telesurgery; wearable haptic display; TACTILE SENSOR; DESIGN; FEEDBACK; DEVICE;
D O I
10.1002/adsr.202300105
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Haptic (touch) is important for effective interaction with the surroundings. In teleoperated surgical systems, its absence leads to reduced perception, making delicate tasks difficult and resulting in unexpected damage to surrounding tissues. To enhance safety, a force-feedback system and haptic device are needed. However, existing haptic prototypes are associated with rigid, bulky, and heavy components, making effective communication with the skin problematic. This paper presents a teleoperated endoscopic surgical system with an integrated 3D force sensor and real-time haptic feedback. A surgical robotic arm is remotely controlled by a soft haptic glove incorporated 3-axis cutaneous device and a finger kinesthetic module. The 3D force sensor is constructed from hydraulic filament soft sensors that can induce pressure change under strain. To enable precise motion, the haptic glove is operated by a feedforward controller and a master-slave architecture. Experiments with human subjects (n = 15) show that cutaneous and kinesthetic feedback significantly improves the user's performance (9.4 out of 10) compared to no haptic feedback (2.27 out of 10). Finally, subjects rank the new system as highly wearable, comfortable, and effective, which is expected to bridge a gap in the surgical field and support the future development of advanced teleoperated systems. This work introduces a teleoperated surgical system with integrated 3D force sensor and a soft wearable haptic display. The new system is expected to bridge a gap in the field of wearable haptic devices and support the future development of remote surgery. image
引用
收藏
页数:15
相关论文
共 66 条
[11]   A Flexible 3D Force Sensor with In-Situ Tunable Sensitivity [J].
Davies, James ;
Mai Thanh Thai ;
Trung Thien Hoang ;
Chi Cong Nguyen ;
Phuoc Thien Phan ;
Zhu, Kefan ;
Dang Bao Nhi Tran ;
Van Anh Ho ;
Hung Manh La ;
Quang Phuc Ha ;
Lovell, Nigel Hamilton ;
Thanh Nho Do .
2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA, 2023, :581-587
[12]   A Stretchable Filament Sensor with Tunable Sensitivity for Wearable Robotics and Healthcare Applications [J].
Davies, James ;
Thai, Mai Thanh ;
Hoang, Trung Thien ;
Nguyen, Chi Cong ;
Phan, Phuoc Thien ;
Phan, Hoang-Phuong ;
Lovell, Nigel H. ;
Do, Thanh Nho .
ADVANCED MATERIALS TECHNOLOGIES, 2023, 8 (06)
[13]   Pneumatic and hydraulic microactuators: a review [J].
De Volder, Michael ;
Reynaerts, Dominiek .
JOURNAL OF MICROMECHANICS AND MICROENGINEERING, 2010, 20 (04)
[14]   Haptics in robot-assisted surgery: Challenges and benefits [J].
Enayati N. ;
De Momi E. ;
Ferrigno G. .
IEEE Reviews in Biomedical Engineering, 2016, 9 :49-65
[15]  
Focchi M., 2010, 2010 IEEE/RSJ Int. conf. on intelligent robots and systems
[16]   Haptigami: A Fingertip Haptic Interface With Vibrotactile and 3-DoF Cutaneous Force Feedback [J].
Giraud, Frederic H. ;
Joshi, Sagar ;
Paik, Jamie .
IEEE TRANSACTIONS ON HAPTICS, 2022, 15 (01) :131-141
[17]   A Pneumatic Tactile Sensor for Co-Operative Robots [J].
Gong, Daoxiong ;
He, Rui ;
Yu, Jianjun ;
Zuo, Guoyu .
SENSORS, 2017, 17 (11)
[18]  
Guinan AL, 2013, 2013 WORLD HAPTICS CONFERENCE (WHC), P13, DOI 10.1109/WHC.2013.6548377
[19]   3D-Printed Soft Sensors for Adaptive Sensing with Online and Offline Tunable Stiffness [J].
He, Liang ;
Herzig, Nicolas ;
Nanayakkara, Thrishantha ;
Maiolino, Perla .
SOFT ROBOTICS, 2022, 9 (06) :1062-1073
[20]   Magnetically Engineered Conductivity of Soft Liquid Metal Composites for Robotic, Wearable Electronic, and Medical Applications [J].
Hoang, Trung Thien ;
Phan, Phuoc Thien ;
Thai, Mai Thanh ;
Davies, James ;
Nguyen, Chi Cong ;
Phan, Hoang-Phuong ;
Lovell, Nigel Hamilton ;
Do, Thanh Nho .
ADVANCED INTELLIGENT SYSTEMS, 2022, 4 (12)