A User Study on Mixed Reality Remote Collaboration with Eye Gaze and Hand Gesture Sharing

被引：144

作者：

Bai, Huidong ^{[1
]}

Sasikumar, Prasanth ^{[1
]}

Yang, Jing ^{[2
]}

Billinghurst, Mark ^{[1
]}

机构：

[1] Univ Auckland, Auckland Bioengn Inst, Auckland, New Zealand

[2] Swiss Fed Inst Technol, Dept Comp Sci, Zurich, Switzerland

来源：

PROCEEDINGS OF THE 2020 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI'20) | 2020年

关键词：

Mixed Reality; Augmented Reality; Virtual Reality; remote collaboration; 3D panorama; scene reconstruction; eye gaze; hand gesture; COMMUNICATION CUES; SEE;

D O I：

10.1145/3313831.3376550

中图分类号：

TP3 [计算技术、计算机技术];

学科分类号：

0812 ;

摘要：

Supporting natural communication cues is critical for people to work together remotely and face-to-face. In this paper we present a Mixed Reality (MR) remote collaboration system that enables a local worker to share a live 3D panorama of his/her surroundings with a remote expert. The remote expert can also share task instructions back to the local worker using visual cues in addition to verbal communication. We conducted a user study to investigate how sharing augmented gaze and gesture cues from the remote expert to the local worker could affect the overall collaboration performance and user experience. We found that by combing gaze and gesture cues, our remote collaboration system could provide a significantly stronger sense of co-presence for both the local and remote users than using the gaze cue alone. The combined cues were also rated significantly higher than the gaze in terms of ease of conveying spatial actions.

引用

页数：13

共 47 条

[1]

Adcock M, 2013, P 12 ACM SIGGRAPH IN, P235, DOI [10.1145/2534329.2534331, DOI 10.1145/2534329.2534331]

[2] A Study of Gestures in a Video-Mediated Collaborative Assembly Task [J].

Alem, Leila ;

Li, Jane .

ADVANCES IN HUMAN-COMPUTER INTERACTION, 2011, 2011

[3]

Andrew M., 2011, International Conference on Artificial reality and telexistance, P4

[4]

[Anonymous], 2014, P 27 ANN ACM S US IN, DOI DOI 10.1145/2642918.2647372

[5]

[Anonymous], 2003, P SIGCHI C HUM FACT, DOI DOI 10.1145/642611.642701

[6]

Bauer M., 1999, Digest of Papers. Third International Symposium on Wearable Computers, P151, DOI 10.1109/ISWC.1999.806696

[7]

Brooke John., 1996, Usability evaluation in industry, V189, P4

[8] Immersive 3D Telepresence [J].

Fuchs, Henry ;

State, Andrei ;

Bazin, Jean-Charles .

COMPUTER, 2014, 47 (07) :46-52

[9]

Fussell S. R., 2000, CSCW 2000. ACM 2000 Conference on Computer Supported Cooperative Work, P21, DOI 10.1145/358916.358947

[10] Gestures over video streams to support remote collaboration on physical tasks [J].

Fussell, SR ;

Setlock, LD ;

Yang, J ;

Ou, JZ ;

Mauer, E ;

Kramer, ADI .

HUMAN-COMPUTER INTERACTION, 2004, 19 (03) :273-309

← 1 2 3 4 5 →