Augmented Reality-Assisted Ultrasound Breast Biopsy

被引:17
作者
Costa, Nuno [1 ,2 ,3 ]
Ferreira, Luis [1 ]
de Araujo, Augusto R. V. F. [1 ,4 ]
Oliveira, Bruno [1 ,2 ,3 ,5 ,6 ]
Torres, Helena R. R. [1 ,2 ,3 ,5 ,6 ]
Morais, Pedro [1 ]
Alves, Victor [2 ,3 ]
Vilaca, Joao L. [1 ]
机构
[1] IPCA, 2Ai Sch Technol, P-4750810 Barcelos, Portugal
[2] Univ Minho, Algoritmi Ctr, Sch Engn, P-4800058 Guimaraes, Portugal
[3] LASI Associate Lab Intelligent Syst, P-4800058 Guimaraes, Portugal
[4] Univ Fed Fluminense UFF, Inst Comp, BR-24210310 Niteroi, Brazil
[5] Univ Minho, Sch Med, Life & Hlth Sci Res Inst ICVS, P-4710057 Braga, Portugal
[6] ICVS, 3Bs, PT Govt Associate Lab, P-4710057 Braga Guimaraes, Portugal
关键词
ultrasound; breast biopsy; augmented reality; convolutional neural networks; lesion segmentation; SEGMENTATION; SYSTEM;
D O I
10.3390/s23041838
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Breast cancer is the most prevalent cancer in the world and the fifth-leading cause of cancer-related death. Treatment is effective in the early stages. Thus, a need to screen considerable portions of the population is crucial. When the screening procedure uncovers a suspect lesion, a biopsy is performed to assess its potential for malignancy. This procedure is usually performed using real-time Ultrasound (US) imaging. This work proposes a visualization system for US breast biopsy. It consists of an application running on AR glasses that interact with a computer application. The AR glasses track the position of QR codes mounted on an US probe and a biopsy needle. US images are shown in the user's field of view with enhanced lesion visualization and needle trajectory. To validate the system, latency of the transmission of US images was evaluated. Usability assessment compared our proposed prototype with a traditional approach with different users. It showed that needle alignment was more precise, with 92.67 +/- 2.32 degrees in our prototype versus 89.99 +/- 37.49 degrees in a traditional system. The users also reached the lesion more accurately. Overall, the proposed solution presents promising results, and the use of AR glasses as a tracking and visualization device exhibited good performance.
引用
收藏
页数:14
相关论文
共 37 条
[1]  
A H., 2013, Reports in Medical Imaging, V2013, P29, DOI DOI 10.2147/RMI.S33464
[2]  
[Anonymous], WHO GLOBOCAN DATABAS
[3]   Augmented Reality Guided Needle Biopsy of Soft Tissue: A Pilot Study [J].
Asgar-Deen, David ;
Carriere, Jay ;
Wiebe, Ericka ;
Peiris, Lashan ;
Duha, Aalo ;
Tavakoli, Mahdi .
FRONTIERS IN ROBOTICS AND AI, 2020, 7
[4]   Transfer Learning in Breast Cancer Diagnoses via Ultrasound Imaging [J].
Ayana, Gelan ;
Dese, Kokeb ;
Choe, Se-woon .
CANCERS, 2021, 13 (04) :1-16
[5]   Ultrasound-GuidedBreast Biopsies Basic and New Techniques [J].
Bhatt, Asha A. ;
Whaley, Dana H. ;
Lee, Christine U. .
JOURNAL OF ULTRASOUND IN MEDICINE, 2021, 40 (07) :1427-1443
[6]   Image-guided breast biopsy and localisation: recommendations for information to women and referring physicians by the European Society of Breast Imaging [J].
Bick, Ulrich ;
Trimboli, Rubina M. ;
Athanasiou, Alexandra ;
Balleyguier, Corinne ;
Baltzer, Pascal A. T. ;
Bernathova, Maria ;
Borbely, Krisztina ;
Brkljacic, Boris ;
Carbonaro, Luca A. ;
Clauser, Paola ;
Cassano, Enrico ;
Colin, Catherine ;
Esen, Gul ;
Evans, Andrew ;
Fallenberg, Eva M. ;
Fuchsjaeger, Michael H. ;
Gilbert, Fiona J. ;
Helbich, Thomas H. ;
Heywang-Koebrunner, Sylvia H. ;
Herranz, Michel ;
Kinkel, Karen ;
Kilburn-Toppin, Fleur ;
Kuhl, Christiane K. ;
Lesaru, Mihai ;
Lobbes, Marc B. I. ;
Mann, Ritse M. ;
Martincich, Laura ;
Panizza, Pietro ;
Pediconi, Federica ;
Pijnappel, Ruud M. ;
Pinker, Katja ;
Schiaffino, Simone ;
Sella, Tamar ;
Thomassin-Naggara, Isabelle ;
Tardivon, Anne ;
Van Ongeval, Chantal ;
Wallis, Matthew G. ;
Zackrisson, Sophia ;
Forrai, Gabor ;
Herrero, Julia Camps ;
Sardanelli, Francesco .
INSIGHTS INTO IMAGING, 2020, 11 (01)
[7]   Freehand Versus Guided Breast Biopsy: Comparison of Accuracy, Needle Motion, and Biopsy Time in a Tissue Model [J].
Bluvol, Nathan ;
Kornecki, Anat ;
Shaikh, Allison ;
Fernandez, David Del Rey ;
Taves, Donald H. ;
Fenster, Aaron .
AMERICAN JOURNAL OF ROENTGENOLOGY, 2009, 192 (06) :1720-1725
[8]   In Situ Visualization for 3D Ultrasound-Guided Interventions with Augmented Reality Headset [J].
Cattari, Nadia ;
Condino, Sara ;
Cutolo, Fabrizio ;
Ferrari, Mauro ;
Ferrari, Vincenzo .
BIOENGINEERING-BASEL, 2021, 8 (10)
[9]   Ultrasound training simulator using augmented reality glasses: an accuracy and precision assessment study [J].
Costa, Jose N. ;
Gomes-Fonseca, Joao ;
Valente, Simao ;
Ferreira, Luis ;
Oliveira, Bruno ;
Torres, Helena R. ;
Morais, Pedro ;
Alves, Victor ;
Vilaca, Joao L. .
2022 44TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY, EMBC, 2022, :4461-4464
[10]   Comparative Analysis of Current Deep Learning Networks for Breast Lesion Segmentation in Ultrasound Images [J].
Ferreira, Margarida R. ;
Torres, Helena R. ;
Oliveira, Bruno ;
Gomes-Fonseca, Joao ;
Morais, Pedro ;
Vilaca, Joao L. ;
Novais, Paulo .
2022 44TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY, EMBC, 2022, :3878-3881