Magnification and localization of vessels in robotic surgical videos based on accuracy High-Order Phase-Based Video Magnification

被引:0
作者
Yang, Yuanzhao [1 ]
Jiang, Qi [1 ]
机构
[1] Shandong Univ, Sch Control Sci & Engn, Jinan 250061, Peoples R China
关键词
Robotic surgery; Neurovascular bundle; Computer vision; Endoscopic video processing; High-Order Phase-Based Video Magnification; IMAGE QUALITY ASSESSMENT;
D O I
10.1016/j.bspc.2024.106575
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Robotic surgery, known for its minimally invasive benefits, faster recovery, and fewer complications, faces challenges in identifying blood vessels and neurovascular bundles during surgery, risking intraoperative injuries. Existing methods encounter limitations like alignment errors and additional hardware requirements. Addressing these challenges, we propose the Accuracy High -Order Phase -Based Video Magnification (AH-PVM) method. The process involves three stages: initially determining the main frequency of tiny pulsations using dense optical flow and k -means clustering, followed by spatial-temporal decomposition through a complex steerable pyramid for fine frequency analysis. Introducing a Gaussian third -order derivative filter magnifies high -order phase motion signals, emphasizing subtle motion features. Finally, a bilateral filter applies video time -domain filtering, removing noise, enhancing video quality, and preserving pulsation details. Experiments on vascular pulsation magnification in robotic surgical videos demonstrate improved magnification with reduced distortion and artifacts. Motion details align more closely with heart beat characteristics compared to conventional methods. Objective metrics and subjective evaluations consistently show the method's performance in terms of structural similarity, noise suppression, and error control. This work explores the feasibility and robustness of applying video magnification methods to identify vessels and neurovascular bundles in different robotic surgeries. The innovation of the method lies in achieving precise capture and enhancement of pulsations, providing a reliable computer vision tool for accurate observation of vascular micro -pulsations during robotic surgery. This approach is expected to enhance the safety and efficacy of minimally invasive surgery.
引用
收藏
页数:8
相关论文
共 33 条
[1]  
Amir-Khalili A, 2013, LECT NOTES COMPUT SC, V8090, P182, DOI 10.1007/978-3-642-40843-4_20
[2]   Multispectral bilateral video fusion [J].
Bennett, Eric P. ;
Mason, John L. ;
McMillan, Leonard .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2007, 16 (05) :1185-1194
[3]   The algorithm of stereo vision and shape from shading based on endoscope imaging [J].
Cao, Ziyi ;
Wang, Yaxiang ;
Zheng, Wenfeng ;
Yin, Lirong ;
Tang, Yushan ;
Miao, Wang ;
Liu, Shan ;
Yang, Bo .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2022, 76
[4]   Safety-aware robotic steering of a flexible endoscope for nasotracheal intubation [J].
Deng, Zhen ;
Jiang, Peijie ;
Guo, Yuxin ;
Zhang, Shengzhan ;
Hu, Ying ;
Zheng, Xiaochun ;
He, Bingwei .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 82
[5]   Robotically Surgical Vessel Localization Using Robust Hybrid Video Motion Magnification [J].
Fan, Wenkang ;
Zheng, Zhuohui ;
Zeng, Wankang ;
Chen, Yinran ;
Zeng, Hui-Qing ;
Shi, Hong ;
Luo, Xiongbiao .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (02) :1567-1573
[6]   Gaze gesture based human robot interaction for laparoscopic surgery [J].
Fujii, Kenko ;
Gras, Gauthier ;
Salerno, Antonino ;
Yang, Guang-Zhong .
MEDICAL IMAGE ANALYSIS, 2018, 44 :196-214
[7]  
Hamarneh G, 2014, MID EAST CONF BIO, P159, DOI 10.1109/MECBME.2014.6783230
[8]   DETERMINING OPTICAL-FLOW [J].
HORN, BKP ;
SCHUNCK, BG .
ARTIFICIAL INTELLIGENCE, 1981, 17 (1-3) :185-203
[9]   The multiscale directional bilateral filter and its application to multisensor image fusion [J].
Hu, Jianwen ;
Li, Shutao .
INFORMATION FUSION, 2012, 13 (03) :196-206
[10]   Remote control of a robotic prosthesis arm with six-degree-of-freedom for ultrasonic scanning and three-dimensional imaging [J].
Huang, Qinghua ;
Lan, Jiulong .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2019, 54