CollaboVR: A Reconfigurable Framework for Creative Collaboration in Virtual Reality

被引:63
作者
He, Zhenyi [1 ]
Du, Ruofei [2 ]
Perlin, Ken [1 ]
机构
[1] NYU, New York, NY 10003 USA
[2] Google, Mountain View, CA 94043 USA
来源
2020 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY (ISMAR 2020) | 2020年
关键词
Human-centered computing-Human computer interaction (HCI)-Interaction paradigms-Virtual reality; Human-centered computing-Collaborative and social computing-Collaborative and social computing systems and tools;
D O I
10.1109/ISMAR50242.2020.00082
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Writing or sketching on whiteboards is an essential part of collaborative discussions in business meetings, reading groups, design sessions, and interviews. However, prior work in collaborative virtual reality (VR) systems has rarely explored the design space of multi-user layouts and interaction modes with virtual whiteboards. In this paper, we present CollaboVR, a reconfigurable framework for both co-located and geographically dispersed multi-user communication in VR. Our system unleashes users' creativity by sharing freehand drawings, converting 2D sketches into 3D models, and generating procedural animations in real-time. To minimize the computational expense for VR clients, we leverage a cloud architecture in which the computational expensive application (Chalktalk) is hosted directly on the servers, with results being simultaneously streamed to clients. We have explored three custom layouts integrated, mirrored, and projective to reduce visual clutter, increase eye contact, or adapt different use cases. To evaluate CollaboVR, we conducted a within-subject user study with 12 participants. Our findings reveal that users appreciate the custom configurations and real-time interactions provided by CollaboVR. We have open sourced CollaboVR at https://github.com/snowymo/CollaboVR to facilitate future research and development of natural user interfaces and real-time collaborative systems in virtual and augmented reality.
引用
收藏
页码:542 / 554
页数:13
相关论文
共 89 条
[11]  
Cavallo M, 2019, 2019 26TH IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES (VR), P145, DOI [10.1109/VR.2019.8797733, 10.1109/vr.2019.8797733]
[12]   Mutual Human Actuation [J].
Cheng, Lung-Pan ;
Marwecki, Sebastian ;
Baudisch, Patrick .
UIST'17: PROCEEDINGS OF THE 30TH ANNUAL ACM SYMPOSIUM ON USER INTERFACE SOFTWARE AND TECHNOLOGY, 2017, :797-805
[13]   Challenges and design considerations for multimodal asynchronous collaboration in VR [J].
Chow K. ;
Coyiuto C. ;
Nguyen C. ;
Yoon D. .
Proceedings of the ACM on Human-Computer Interaction, 2019, 3 (CSCW)
[14]   Investigating face-to-face peer interaction patterns in a collaborative Web discovery task: the benefits of a shared display [J].
Chung, C-W. ;
Lee, C-C. ;
Liu, C-C. .
JOURNAL OF COMPUTER ASSISTED LEARNING, 2013, 29 (02) :188-206
[15]  
Davis N.M., 2013, 9 ARTIFICIAL INTELLI
[16]  
Dervin B., 1992, QUALITATIVE RES INFO
[17]   Geollery: A Mixed Reality Social Media Platform [J].
Du, Ruofei ;
Li, David ;
Varshney, Amitabh .
CHI 2019: PROCEEDINGS OF THE 2019 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, 2019,
[18]  
Du Ruofei., 2016, P 21 INT C WEB3D TEC, P77
[19]  
Elvezio C., 2017, ACM, DOI 10.1145/3089269.3089281
[20]  
Franz J., 2019, P ACM HUMAN COMPUTER, V3, P1, DOI [10.1080/19443994.2013.787953, DOI 10.1080/19443994.2013.787953]