CollaboVR: A Reconfigurable Framework for Creative Collaboration in Virtual Reality

被引:63
作者
He, Zhenyi [1 ]
Du, Ruofei [2 ]
Perlin, Ken [1 ]
机构
[1] NYU, New York, NY 10003 USA
[2] Google, Mountain View, CA 94043 USA
来源
2020 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY (ISMAR 2020) | 2020年
关键词
Human-centered computing-Human computer interaction (HCI)-Interaction paradigms-Virtual reality; Human-centered computing-Collaborative and social computing-Collaborative and social computing systems and tools;
D O I
10.1109/ISMAR50242.2020.00082
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Writing or sketching on whiteboards is an essential part of collaborative discussions in business meetings, reading groups, design sessions, and interviews. However, prior work in collaborative virtual reality (VR) systems has rarely explored the design space of multi-user layouts and interaction modes with virtual whiteboards. In this paper, we present CollaboVR, a reconfigurable framework for both co-located and geographically dispersed multi-user communication in VR. Our system unleashes users' creativity by sharing freehand drawings, converting 2D sketches into 3D models, and generating procedural animations in real-time. To minimize the computational expense for VR clients, we leverage a cloud architecture in which the computational expensive application (Chalktalk) is hosted directly on the servers, with results being simultaneously streamed to clients. We have explored three custom layouts integrated, mirrored, and projective to reduce visual clutter, increase eye contact, or adapt different use cases. To evaluate CollaboVR, we conducted a within-subject user study with 12 participants. Our findings reveal that users appreciate the custom configurations and real-time interactions provided by CollaboVR. We have open sourced CollaboVR at https://github.com/snowymo/CollaboVR to facilitate future research and development of natural user interfaces and real-time collaborative systems in virtual and augmented reality.
引用
收藏
页码:542 / 554
页数:13
相关论文
共 89 条
[1]  
Albolino S., 2007, COGN TECHNOL WORK, V9, P131, DOI [10.1007/s10111-006-0057-5, DOI 10.1007/S10111-006-0057-5]
[2]  
[Anonymous], 1996, C COMPANION HUMAN FA, DOI [DOI 10.1145/257089.257284, 10.1145/257089.257284]
[3]  
[Anonymous], 2011, APS M
[4]   Immersive Group-to-Group Telepresence [J].
Beck, Stephan ;
Kunert, Andre ;
Kulik, Alexander ;
Froehlich, Bernd .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2013, 19 (04) :616-625
[5]  
Benko H., 2014, P 27 ANN ACM S US IN, P645
[6]   In-Place 3D Sketching for Authoring and Augmenting Mechanical Systems [J].
Bergig, Oriel ;
Hagbi, Nate ;
El-Sana, Jihad ;
Billinghurst, Mark .
2009 8TH IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY - SCIENCE AND TECHNOLOGY, 2009, :87-+
[7]  
Billman D, 2007, CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, VOLS 1 AND 2, P229
[8]   Empirical Study of Non-Reversing Magic Mirrors for Augmented Reality Anatomy Learning [J].
Bork, Felix ;
Barmaki, Roghayeh ;
Eck, Ulrich ;
Yu, Kevin ;
Sandor, Christian ;
Navab, Nassir .
PROCEEDINGS OF THE 2017 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY (ISMAR), 2017, :169-176
[9]  
Brooke J., 1996, USABILITY EVALUATION, P189
[10]   Clusters, Trends, and Outliers: How Immersive Technologies Can Facilitate the Collaborative Analysis of Multidimensional Data [J].
Butscher, Simon ;
Hubenschmid, Sebastian ;
Mueller, Jens ;
Fuchs, Johannes ;
Reiterer, Harald .
PROCEEDINGS OF THE 2018 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI 2018), 2018,