Magnoramas: Magnifying Dioramas for Precise Annotations in Asymmetric 3D Teleconsultation

被引:26
作者
Yu, Kevin [1 ]
Winkler, Alexander [2 ]
Pankratz, Frieder [3 ]
Lazarovici, Marc [3 ]
Wilhelm, Dirk [1 ]
Eck, Ulrich [2 ]
Roth, Daniel [2 ]
Navab, Nassir [2 ]
机构
[1] TUM, Hosp Recht Isar, Res Grp MITI, Munich, Germany
[2] TUM, Chair Comp Aided, Med Procedures, Munich, Germany
[3] LMU, Inst Emergency Med, Munich, Germany
来源
2021 IEEE VIRTUAL REALITY AND 3D USER INTERFACES (VR) | 2021年
关键词
Interaction techniques; medical information system; virtual reality; TELEPRESENCE; EMBODIMENT; SENSE;
D O I
10.1109/VR50410.2021.00062
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
When users create hand-drawn annotations in Virtual Reality they often reach their physical limits in terms of precision, especially if the region to be annotated is small. One intuitive solution employs magnification beyond natural scale. However, scaling the whole environment results in wrong assumptions about the coherence between physical and virtual space. In this paper, we introduce Magnoramas, a novel interaction method for selecting and extracting a region of interest that the user can subsequently scale and transform inside the virtual space. Our technique enhances the user's capabilities to perform supernaturally precise virtual annotations on virtual objects. We explored our technique in a user study within a simplified clinical scenario of a teleconsultation-supported craniectomy procedure that requires accurate annotations on a human head. Teleconsultation was performed asymmetrically between a remote expert in Virtual Reality that collaborated with a local user through Augmented Reality. The remote expert operates inside a reconstructed environment, captured from RGB-D sensors at the local site, and is embodied by an avatar to establish co-presence. The results show that Magnoramas significantly improve the precision of annotations while preserving usability and perceived presence measures compared to the baseline method. By hiding the 3D reconstruction while keeping the Magnorama, users can intentionally choose to lower their perceived social presence and focus on their tasks.
引用
收藏
页码:392 / 401
页数:10
相关论文
共 67 条
[1]  
Andrew M., 2011, International Conference on Artificial reality and telexistance, P4
[2]  
[Anonymous], 2010, 7 SKETCH BAS INT MOD, DOI DOI 10.5555/1923363.1923387
[3]   Experimental Evaluation of Sketching on Surfaces in VR [J].
Arora, Rahul ;
Kazi, Rubaiat Habib ;
Anderson, Fraser ;
Grossman, Tovi ;
Singh, Karan ;
Fitzmaurice, George .
PROCEEDINGS OF THE 2017 ACM SIGCHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI'17), 2017, :5643-5654
[4]  
Bacim F, 2009, 3DUI : IEEE SYMPOSIUM ON 3D USER INTERFACES 2009, PROCEEDINGS, P67
[5]  
Barrera-Machuca Mayra D., 2020, UIST '20: 33rd Annual ACM Symposium on User Interface Software and Technology, P73, DOI 10.1145/3379350.3416190
[6]   Immersive Group-to-Group Telepresence [J].
Beck, Stephan ;
Kunert, Andre ;
Kulik, Alexander ;
Froehlich, Bernd .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2013, 19 (04) :616-625
[7]   The MagicBook: a transitional AR interface [J].
Billinghurst, M ;
Kato, H ;
Poupyrev, I .
COMPUTERS & GRAPHICS-UK, 2001, 25 (05) :745-753
[8]   Don't Panic: Recursive Interactions in a Miniature Metaworld [J].
Bluff, Andrew .
17TH ACM SIGGRAPH INTERNATIONAL CONFERENCE ON VIRTUAL-REALITY CONTINUUM AND ITS APPLICATIONS IN INDUSTRY (VRCAI 2019), 2019,
[9]  
Brooke J., 1996, Usability Evaluation In Industry, V189, P189
[10]  
Chenechal Le, 2016, 2016 IEEE 3 VR INT W