Navigate biopsy with ultrasound under augmented reality device: Towards higher system performance

被引:3
作者
Li H. [1 ]
Yan W. [2 ]
Zhao J. [1 ]
Ji Y. [2 ]
Qian L. [3 ]
Ding H. [1 ]
Zhao Z. [4 ,5 ]
Wang G. [1 ]
机构
[1] Biomedical Engineering, Tsinghua University, Shuang Qing Road, Beijing, Beijing
[2] School of Medicine, Tsinghua University, Shuang Qing Road, Beijing, Beijing
[3] Medivis Inc., 920 Broadway, New York, 10010, NY
[4] School of Clinical Medicine, Tsinghua University, Shuang Qing Road, Beijing, Beijing
[5] Orthopedics & Sports Medicine Center, Beijing Tsinghua Changgung Hospital, Li Tang Road, Beijing, Beijing
基金
中国国家自然科学基金;
关键词
Augmented reality; Locatable ultrasound; Surgical navigation; Tumor biopsy;
D O I
10.1016/j.compbiomed.2024.108453
中图分类号
学科分类号
摘要
Purpose: Biopsies play a crucial role in determining the classification and staging of tumors. Ultrasound is frequently used in this procedure to provide real-time anatomical information. Using augmented reality (AR), surgeons can visualize ultrasound data and spatial navigation information seamlessly integrated with real tissues. This innovation facilitates faster and more precise biopsy operations. Methods: We have developed an augmented reality biopsy navigation system characterized by low display latency and high accuracy. Ultrasound data is initially read by an image capture card and streamed to Unity via net communication. In Unity, navigation information is rendered and transmitted to the HoloLens 2 device using holographic remoting. Concurrently, a retro-reflective tool tracking method is implemented on the HoloLens 2, enabling the simultaneous tracking of the ultrasound probe and biopsy needle. Distinct navigation information is provided during in-plane and out-of-plane punctuation. To evaluate the effectiveness of our system, we conducted a study involving ten participants, assessing puncture accuracy and biopsy time in comparison to traditional methods. Results: Ultrasound image was streamed from the ultrasound device to augmented reality headset with 122.49±11.61ms latency, while only 16.22±11.25ms was taken after data acquisition from image capture card. Navigation accuracy reached 1.23±0.68mm in the image plane and 0.95±0.70mm outside the image plane, within a depth range of 200 millimeters. Remarkably, the utilization of our system led to 98% and 95% success rate in out-of-plane and in-plane biopsy, among ten participants with little ultrasound experience. Conclusion: To sum up, this paper introduces an AR-based ultrasound biopsy navigation system characterized by high navigation accuracy and minimal latency. The system provides distinct visualization contents during in-plane and out-of-plane operations according to their different characteristics. Use case study in this paper proved that our system can help young surgeons perform biopsy faster and more accurately. © 2024 Elsevier Ltd
引用
收藏
相关论文
共 34 条
[1]  
Baratella E., Cernic S., Minelli P., Furlan G., Crimi F., Rocco S., Ruaro B., Cova M.A., Accuracy of CT-guided core-needle biopsy in diagnosis of thoracic lesions suspicious for primitive malignancy of the lung: A five-year retrospective analysis, Tomography, 8, 6, pp. 2828-2838, (2022)
[2]  
Kim D.Y., Sun J.S., Kim E.Y., Park K.J., You S., Diagnostic accuracy and safety of CT-guided percutaneous lung biopsy with a coaxial cutting needle for the diagnosis of lung cancer in patients with UIP pattern, Sci. Rep., 12, 1, (2022)
[3]  
Walter U., Ultrasound-guided medical procedures: A growing field with new opportunities, Ultraschall Medizin-Eur. J. Ultrasound, 43, 4, pp. 327-331, (2022)
[4]  
Schonewille A.M., Tracked 3D Ultrasound Navigated Liver Biopsy Procedure with Registered Tomographic Scans, (2022)
[5]  
Huang G.-T., Sheu J.-C., Yang P.-M., Lee H.-S., Wang T.-H., Chen D.-S., Ultrasound-guided cutting biopsy for the diagnosis of hepatocellular carcinoma—A study based on 420 patients, J. Hepatol., 25, 3, pp. 334-338, (1996)
[6]  
Houssami N., Ciatto S., Turner R.M., Cody H.S., Macaskill P., Preoperative ultrasound-guided needle biopsy of axillary nodes in invasive breast cancer: meta-analysis of its accuracy and utility in staging the axilla, Ann. Surg., 254, 2, pp. 243-251, (2011)
[7]  
Chira R.I., Chira A., Manzat-Saplacan R.M., Nagy G., Bintintan A., Mircea P.A., Valean S., Ultrasound-guided bone lesions biopsies-A systematic review, Med. Ultrason., 19, 3, pp. 302-309, (2017)
[8]  
Meiser V.C., Kreysa H., Guntinas-Lichius O., Volk G.F., Comparison of in-plane and out-of-plane needle insertion with vs. without needle guidance, Eur. Arch. Oto-Rhino-Laryngol., 273, pp. 2697-2705, (2016)
[9]  
Choi S.H., Han K.H., Yoon J.H., Moon H.J., Son E.J., Youk J.H., Kim E.-K., Kwak J.Y., Factors affecting inadequate sampling of ultrasound-guided fine-needle aspiration biopsy of thyroid nodules, Clin. Endocrinol., 74, 6, pp. 776-782, (2011)
[10]  
England J.R., Fischbeck T., Tchelepi H., The value of needle-guidance technology in ultrasound-guided percutaneous procedures performed by radiology residents: A comparison of freehand, in-plane, fixed-angle, and electromagnetic needle tracking techniques, J. Ultrasound Med., 38, 2, pp. 399-405, (2019)