Multi-User Surgical Navigation Platform Based on Mixed Reality

被引:0
|
作者
Chiou, Shin-Yan [1 ,2 ,3 ]
Liu, Tao-Ming [4 ]
Liu, Hao-Li [4 ,5 ]
机构
[1] Chang Gung Univ, Coll Engn, Dept Elect Engn, Taoyuan 33302, Taiwan
[2] Keelung Chang Gung Mem Hosp, Dept Neurosurg, Keelung 20401, Taiwan
[3] Dept Tradit Chinese Med, Div Acupuncture & Moxibust, Linkou Chang Gung Mem, Taoyuan 33302, Taiwan
[4] Natl Taiwan Univ, Dept Elect Engn, Taipei 106319, Taiwan
[5] Natl Taiwan Univ, Grad Inst Biomed Elect & Bioinformat, Taipei 10617, Taiwan
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Surgery; Navigation; Three-dimensional displays; Real-time systems; Mixed reality; Ultrasonic imaging; Collaboration; Accuracy; Optical imaging; Visualization; Mixed reality navigation; surgical guidance system; 3D ultrasound visualization; multi-user collaboration; HoloLens; 2; AUGMENTED REALITY; SURGERY;
D O I
10.1109/ACCESS.2024.3486151
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Extended Reality (XR) technology enables visualization of patient data during surgery, with Augmented Reality (AR) systems offering 2D or 3D navigation. However, current systems face limitations such as lack of depth in 2D navigation, restricted single-user functionality in 3D navigation, and limited interoperability between tracking markers and navigation platforms. Additionally, users cannot interact with virtual objects, reducing operational efficiency and intuitiveness. This study addresses these issues by proposing a multi-user Mixed Reality (MR) guidance platform that provides interactive, real-time feedback and enhances collaboration. The platform maps 3D medical models onto real-world objects using 2D marker calibration, supporting focused ultrasound for transcranial brain therapy. Integration with BrainLab and HoloLens 2 achieved a single-user positioning accuracy of 0.576 +/- 0.294mm, with multi-user alignment errors averaging 2.718 +/- 1.335mm. The system maintained a frame rate of 50-60 FPS, demonstrating robust performance and precision.
引用
收藏
页码:162522 / 162535
页数:14
相关论文
共 50 条
  • [31] An Edge Cloud Based Coordination Platform for Multi-user AR Applications
    Balázs Sonkoly
    Bálint György Nagy
    János Dóka
    Zsófia Kecskés-Solymosi
    János Czentye
    Bence Formanek
    Dávid Jocha
    Balázs Péter Gerő
    Journal of Network and Systems Management, 2024, 32
  • [32] An Augmented Reality Platform for Preoperative Surgical Planning
    Teodoro Vite, S.
    Dominguez Velasco, C. F.
    Muscatello, S.
    Padilla Castaneda, M. A.
    De Paolis, L. T.
    6TH INTERNATIONAL CONFERENCE ON ADVANCEMENTS OF MEDICINE AND HEALTH CARE THROUGH TECHNOLOGY, MEDITECH 2018, 2019, 71 : 177 - 182
  • [33] Mixed reality in interventional radiology: a focus on first clinical use of XR90 augmented reality-based visualization and navigation platform
    Finos, Kyle
    Datta, Sanjit
    Sedrakyan, Art
    Milsom, Jeffrey W.
    Pua, Bradley B.
    EXPERT REVIEW OF MEDICAL DEVICES, 2024, 21 (08) : 679 - 688
  • [34] Mixed reality as a novel tool for diagnostic and surgical navigation in orthopaedics
    Andrea Teatini
    Rahul P. Kumar
    Ole Jakob Elle
    Ola Wiig
    International Journal of Computer Assisted Radiology and Surgery, 2021, 16 : 407 - 414
  • [35] Mixed reality as a novel tool for diagnostic and surgical navigation in orthopaedics
    Teatini, Andrea
    Kumar, Rahul P.
    Elle, Ole Jakob
    Wiig, Ola
    INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2021, 16 (03) : 407 - 414
  • [36] NextLens-The Next Generation of Surgical Navigation: Proof of Concept of an Augmented Reality System for Surgical Navigation
    Grunert, Ronny
    Snyderman, Carl-Henry
    Gardner, Paul
    Busse, Michel
    Ahner, Lukas
    Kropla, Fabian
    Moebius, Robert
    Jung, Svenja
    Scholz, Sebastian
    Gueresir, Erdem
    Winkler, Dirk
    JOURNAL OF NEUROLOGICAL SURGERY PART B-SKULL BASE, 2024, 85 (04) : 363 - 369
  • [37] Surgical Navigation System for Hypertensive Intracerebral Hemorrhage Based on Mixed Reality
    Zeyang Zhou
    Zhiyong Yang
    Shan Jiang
    Jie Zhuo
    Tao Zhu
    Shixing Ma
    Journal of Digital Imaging, 2022, 35 (6) : 1530 - 1543
  • [38] Surgical Navigation System for Hypertensive Intracerebral Hemorrhage Based on Mixed Reality
    Zhou, Zeyang
    Yang, Zhiyong
    Jiang, Shan
    Zhuo, Jie
    Zhu, Tao
    Ma, Shixing
    CANCER MANAGEMENT AND RESEARCH, 2022, 14 : 1530 - 1543
  • [39] Accuracy of Mixed Reality Combined With Surgical Navigation Assisted Oral and Maxillofacial Tumor Resection
    Tang, Zu-Nan
    Hu, Lei-Hao
    Soh, Hui Yuh
    Yu, Yao
    Zhang, Wen-Bo
    Peng, Xin
    FRONTIERS IN ONCOLOGY, 2022, 11
  • [40] Collaborative Multi-user Augmented Reality Solutions in the Classroom
    Masneri, Stefano
    Dominguez, Ana
    Sanz, Miguel
    Tamayo, Inigo
    Zorrilla, Mikel
    Larranaga, Mikel
    Arruarte, Ana
    MOBILITY FOR SMART CITIES AND REGIONAL DEVELOPMENT - CHALLENGES FOR HIGHER EDUCATION (ICL2021), VOL 2, 2022, 390 : 1004 - 1011