Medical Augmented Reality: Definition, Principle Components, Domain Modeling, and Design-Development-Validation Process

被引:15
作者
Navab, Nassir [1 ]
Martin-Gomez, Alejandro [1 ,2 ]
Seibold, Matthias [1 ,3 ]
Sommersperger, Michael [1 ]
Song, Tianyu [1 ]
Winkler, Alexander [1 ,4 ]
Yu, Kevin [1 ,5 ]
Eck, Ulrich [1 ]
机构
[1] Tech Univ Munich, Comp Aided Med Procedures & Augmented Real, D-85748 Garching, Germany
[2] Johns Hopkins Univ, Lab Computat Sensing & Robot, Baltimore, MD 21218 USA
[3] Univ Zurich, Balgrist Univ Hosp, Res Orthoped Comp Sci, CH-8008 Zurich, Switzerland
[4] Ludwig Maximilians Univ Hosp, Dept Gen Visceral & Transplant Surg, D-80336 Munich, Germany
[5] medPhoton GmbH, A-5020 Salzburg, Austria
关键词
Augmented Reality; Medical Augmented Reality; surgical data science; Artificial Intelligence; multi-modal sensing; computer vision; acoustic sensing; perceptual visualization; sonification; validation; CALIBRATION; USABILITY; CAMERA;
D O I
10.3390/jimaging9010004
中图分类号
TB8 [摄影技术];
学科分类号
0804 ;
摘要
Three decades after the first set of work on Medical Augmented Reality (MAR) was presented to the international community, and ten years after the deployment of the first MAR solutions into operating rooms, its exact definition, basic components, systematic design, and validation still lack a detailed discussion. This paper defines the basic components of any Augmented Reality (AR) solution and extends them to exemplary Medical Augmented Reality Systems (MARS). We use some of the original MARS applications developed at the Chair for Computer Aided Medical Procedures and deployed into medical schools for teaching anatomy and into operating rooms for telemedicine and surgical guidance throughout the last decades to identify the corresponding basic components. In this regard, the paper is not discussing all past or existing solutions but only aims at defining the principle components and discussing the particular domain modeling for MAR and its design-development-validation process, and providing exemplary cases through the past in-house developments of such solutions.
引用
收藏
页数:21
相关论文
共 74 条
[1]  
[Anonymous], 2022, arXiv
[2]  
[Anonymous], INT YEAR LIGHT IBNAL
[3]  
[Anonymous], 1 TRUE SCI
[4]   A survey of augmented reality [J].
Azuma, RT .
PRESENCE-VIRTUAL AND AUGMENTED REALITY, 1997, 6 (04) :355-385
[5]   Merging virtual objects with the real world: seeing ultrasound imagery within the patient [J].
Bajura, Michael ;
Fuchs, Henry ;
Ohbuchi, Ryutarou .
Computer Graphics (ACM), 1992, 26 (02) :203-210
[6]   Presence and reality judgment in virtual environments:: A unitary construct? [J].
Baños, RM ;
Botella, C ;
Garcia-Palacios, A ;
Villa, H ;
Perpiña, C ;
Alcañiz, M .
CYBERPSYCHOLOGY & BEHAVIOR, 2000, 3 (03) :327-335
[7]   Enhancement of Anatomical Education Using Augmented Reality: An Empirical Study of Body Painting [J].
Barmaki, Roghayeh ;
Yu, Kevin ;
Pearlman, Rebecca ;
Shingles, Richard ;
Bork, Felix ;
Osgood, Greg M. ;
Navab, Nassir .
ANATOMICAL SCIENCES EDUCATION, 2019, 12 (06) :599-609
[8]  
Bichlmeier C, 2007, P 6 IEEE ACM INT S M, P129
[9]  
Bichlmeier C, 2007, LECT NOTES COMPUT SC, V4791, P434
[10]   The Virtual Mirror: A New Interaction Paradigm for Augmented Reality Environments [J].
Bichlmeier, Christoph ;
Heining, Sandro Michael ;
Feuerstein, Marco ;
Navab, Nassir .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2009, 28 (09) :1498-1510