An accurate 3D augmented reality navigation system with enhanced autostereoscopic display for oral and maxillofacial surgery

被引:5
作者
Han, Boxuan [1 ]
Li, Ruiyang [1 ]
Huang, Tianqi [1 ]
Ma, Longfei [1 ]
Liang, Hanying [1 ]
Zhang, Xinran [1 ]
Liao, Hongen [1 ]
机构
[1] Tsinghua Univ, Dept Biomed Engn, Sch Med, Beijing 100084, Peoples R China
基金
中国国家自然科学基金;
关键词
augmented reality; autostereoscopic display; eye tracking; optical see-through; surgical navigation; SURGICAL NAVIGATION; IMAGE OVERLAY;
D O I
10.1002/rcs.2404
中图分类号
R61 [外科手术学];
学科分类号
摘要
Background Oral and maxillofacial surgery demands high precision navigation to achieve optimal surgical outcomes. Augmented reality (AR) has been a promising solution for intuitive and accurate guidance, whereas existing systems have room for improvement. Methods We propose a high quality and accurate in situ AR navigation system. Enhanced image quality is achieved by deploying eye tracking in lenticular-based autostereoscopic display. Viewpoint tracking and optical tracking are integrated to assure accurate in situ images. Results The proposed system can provide in situ AR images in real-time, with a viewing angle of 59.5 degrees x 49.1 degrees, 3D image resolution of 0.35 x 0.21 mm, and image accuracy of 0.99 +/- 0.70 mm. A maxillary drilling experiment obtains average position error of 1.12 +/- 0.30 mm and localization time of 8.7 +/- 3.9 s, significantly better than conventional 2D navigation system. Conclusions The proposed system can display high-quality AR images and therefore reduce positioning error and operating time.
引用
收藏
页数:12
相关论文
共 50 条
[31]   Review on Augmented Reality in Oral and Cranio-Maxillofacial Surgery: Toward "Surgery-Specific" Head-Up Displays [J].
Badiali, Giovanni ;
Cercenelli, Laura ;
Battaglia, Salvatore ;
Marcelli, Emanuela ;
Marchetti, Claudio ;
Ferrari, Vincenzo ;
Cutolo, Fabrizio .
IEEE ACCESS, 2020, 8 :59015-59028
[32]   3D Natural Interaction for an Augmented Reality System [J].
Mouna, Kenoui ;
Mohamed, Ait Mehdi .
2019 INTERNATIONAL CONFERENCE ON ADVANCED ELECTRICAL ENGINEERING (ICAEE), 2019,
[33]   Augmented reality: 3D image-guided surgery [J].
Archie Hughes-Hallett ;
Philip Pratt ;
James Dilley ;
Justin Vale ;
Ara Darzi ;
Erik Mayer .
Cancer Imaging, 15 (Suppl 1)
[34]   Mixed reality in oral and maxillofacial surgery: a symbiosis of virtual and augmented reality or a pointless technological gadget? [J].
Bartella, Alexander K. ;
Kamal, Mohammad ;
Kuhnt, Thomas ;
Hering, Kathrin ;
Halama, Dirk ;
Pausch, Niels C. ;
Lethaus, Bernd .
INTERNATIONAL JOURNAL OF COMPUTERIZED DENTISTRY, 2021, 24 (01) :65-76
[35]   Augmented reality-enhanced navigation in endoscopic sinus surgery: A prospective, randomized, controlled clinical trial [J].
Linxweiler, Maximilian ;
Pillong, Lukas ;
Kopanja, Dragan ;
Kuehn, Jan P. ;
Wagenpfeil, Stefan ;
Radosa, Julia C. ;
Wang, Jingming ;
Morris, Luc G. T. ;
Al Kadah, Basel ;
Bochen, Florian ;
Koerner, Sandrina ;
Schick, Bernhard .
LARYNGOSCOPE INVESTIGATIVE OTOLARYNGOLOGY, 2020, 5 (04) :621-629
[36]   SPAROGRAM: The Spatial Augmented Reality Holographic Display for 3D visualization and Exhibition [J].
Kim, Minju ;
Lee, Jungjin ;
Whon, Kwangyun .
2014 IEEE VIS INTERNATIONAL WORKSHOP ON 3DVIS (3DVIS), 2014, :81-86
[37]   A novel motionless calibration method for augmented reality surgery navigation system based on optical tracker [J].
Wan, Xinjun ;
Shen, Lizhengyi ;
Fang, Zhiqiang ;
Dong, Shao ;
Zhang, Shilei ;
Lin, Chengzhong .
HELIYON, 2022, 8 (12)
[38]   3D Printing and Virtual Surgical Planning in Oral and Maxillofacial Surgery [J].
Zoabi, Adeeb ;
Redenski, Idan ;
Oren, Daniel ;
Kasem, Adi ;
Zigron, Asaf ;
Daoud, Shadi ;
Moskovich, Liad ;
Kablan, Fares ;
Srouji, Samer .
JOURNAL OF CLINICAL MEDICINE, 2022, 11 (09)
[39]   A multilayer liquid crystal display for autostereoscopic 3D viewing [J].
Gotoda, Hironobu .
STEREOSCOPIC DISPLAYS AND APPLICATIONS XXI, 2010, 7524
[40]   A novel 3D guidance system using augmented reality for percutaneous vertebroplasty [J].
Abe, Yuichiro ;
Sato, Shigenobu ;
Kato, Koji ;
Hyakumachi, Takahiko ;
Yanagibashi, Yasushi ;
Ito, Manabu ;
Abumi, Kuniyoshi .
JOURNAL OF NEUROSURGERY-SPINE, 2013, 19 (04) :492-501