Duplicated Reality for Co-located Augmented Reality Collaboration

被引:32
作者
Yu, Kevin [1 ]
Eck, Ulrich [3 ]
Pankratz, Frieder [2 ]
Lazarovici, Marc [2 ]
Wilhelm, Dirk [1 ]
Navab, Nassir [3 ]
机构
[1] Tech Univ Munich, Univ Hosp Rechts Isar, Munich, Germany
[2] Ludwig Maximilians Univ Munchen, Inst Emergency Med, Munich, Germany
[3] Tech Univ Munich, Chair Comp Aided Med Procedure, Munich, Germany
关键词
Collaboration; Task analysis; Three-dimensional displays; Real-time systems; Surgery; Annotations; Image reconstruction; User Interaction; Mixed Reality; 3D Reconstruction; RECONSTRUCTION;
D O I
10.1109/TVCG.2022.3150520
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
When two or more users attempt to collaborate in the same space with Augmented Reality, they often encounter conflicting intentions regarding the occupation of the same working area and self-positioning around such without mutual interference. Augmented Reality is a powerful tool for communicating ideas and intentions during a co-assisting task that requires multi-disciplinary expertise. To relax the constraint of physical co-location, we propose the concept of Duplicated Reality, where a digital copy of a 3D region of interest of the users' environment is reconstructed in real-time and visualized in-situ through an Augmented Reality user interface. This enables users to remotely annotate the region of interest while being co-located with others in Augmented Reality. We perform a user study to gain an in-depth understanding of the proposed method compared to an in-situ augmentation, including collaboration, effort, awareness, usability, and the quality of the task. The result indicates almost identical objective and subjective results, except a decrease in the consulting user's awareness of co-located users when using our method. The added benefit from duplicating the working area into a designated consulting area opens up new interaction paradigms to be further investigated for future co-located Augmented Reality collaboration systems.
引用
收藏
页码:2190 / 2200
页数:11
相关论文
共 78 条
[21]   Point-cloud avatars to improve spatial communication in immersive collaborative virtual environments [J].
Gamelin, Guillaume ;
Chellali, Amine ;
Cheikh, Samia ;
Ricca, Aylen ;
Dumas, Cedric ;
Otmane, Samir .
PERSONAL AND UBIQUITOUS COMPUTING, 2021, 25 (03) :467-484
[22]  
Gao L., 2016, SIGGRAPH ASIA 2016 Mobile Graphics and Interactive Applications, P1
[23]  
Grasset R, 2005, INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY, PROCEEDINGS, P90
[24]   Pedicle Subtraction Osteotomy in the Revision Versus Primary Adult Spinal Deformity Patient Is There a Difference in Correction and Complications? [J].
Gupta, Munish C. ;
Ferrero, Emmanuelle ;
Mundis, Gregory ;
Smith, Justin S. ;
Shaffrey, Christopher I. ;
Schwab, Frank ;
Kim, Han Jo ;
Boachie-Adjei, Oheneba ;
Lafage, Virginie ;
Bess, Shay ;
Hostin, Richard ;
Burton, Douglas C. ;
Ames, Christopher P. ;
Kebaish, Khaled ;
Klineberg, Eric .
SPINE, 2015, 40 (22) :E1169-E1175
[25]   Co-surgeons in breast reconstructive microsurgery: What do they bring to the table? [J].
Haddock, Nicholas T. ;
Kayfan, Samar ;
Pezeshk, Ronnie A. ;
Teotia, Sumeet S. .
MICROSURGERY, 2018, 38 (01) :14-20
[26]  
Hart S. G., 2006, P HUM FACT ERG SOC A, V50, P904, DOI DOI 10.1177/154193120605000909
[27]  
Hirose M., MULTISCALE MANIPULAT
[28]  
Huang YT, 2009, INT SYM MIX AUGMENT, P3, DOI 10.1109/ISMAR-AMH.2009.5336752
[29]  
Irlitti A, 2016, ADJUNCT PROCEEDINGS OF THE 2016 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY (ISMAR-ADJUNCT), P31, DOI [10.1109/ISMAR-Adjunct.2016.25, 10.1109/ISMAR-Adjunct.2016.0032]
[30]  
Jun H, 2020, 2020 IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES WORKSHOPS (VRW 2020), P665, DOI [10.1109/VRW50115.2020.00-92, 10.1109/VRW50115.2020.00183]