You as a Puppet: Evaluation of Telepresence User Interface for Puppetry

被引:27
作者
Sakashita, Mose [1 ]
Minagawa, Tatsuya [1 ]
Koike, Amy [1 ]
Suzuki, Ippei [1 ]
Kawahara, Keisuke [1 ]
Ochiai, Yoichi [1 ]
机构
[1] Univ Tsukuba, Tsukuba, Ibaraki, Japan
来源
UIST'17: PROCEEDINGS OF THE 30TH ANNUAL ACM SYMPOSIUM ON USER INTERFACE SOFTWARE AND TECHNOLOGY | 2017年
关键词
Animatronics; puppet; telepresence; head-mounted display;
D O I
10.1145/3126594.3126608
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We propose an immersive telepresence system for puppetry that transmits a human performer's body and facial movements into a puppet with audiovisual feedback to the performer. The cameras carried in place of puppet's eyes stream live video to the HMD worn by the performer, so that performers can see the images from the puppet's eyes with their own eyes and have a visual understanding of the puppet's ambience. In conventional methods to manipulate a puppet (a hand-puppet, a string-puppet, and a rod-puppet), there is a need to practice manipulating puppets, and there is difficulty carrying out interactions with the audience. Moreover, puppeteers must be positioned exactly where the puppet is. The proposed system addresses these issues by enabling a human performer to manipulate the puppet remotely using his or her body and facial movements. We conducted several user studies with both beginners and professional puppeteers. The results show that, unlike the conventional method, the proposed system facilitates the manipulation of puppets especially for beginners. Moreover, this system allows performers to enjoy puppetry and fascinate audiences.
引用
收藏
页码:217 / 228
页数:12
相关论文
共 36 条
[1]  
[Anonymous], 2009, P 2009 ACM SIGGRAPHE, DOI [DOI 10.1145/1599470.1599472, 10.1145/1599470.1599472]
[2]  
Blumenthal Eileen., 2005, Puppetry and Puppets: An Illustrated World Survey
[3]  
Bonanni L., 2006, CHI'06 Short Papers, P574
[4]  
Brand M, 1999, COMP GRAPH, P21, DOI 10.1145/311535.311537
[5]  
Fritsche L, 2015, IEEE-RAS INT C HUMAN, P997, DOI 10.1109/HUMANOIDS.2015.7363475
[6]  
Garlen J., 2009, Kermit culture: Critical perspectives on Jim Henson's Muppets
[7]   Measurement of distal EMG Signals using a Wearable Device for Reading Facial Expressions [J].
Gruebler, Anna ;
Suzuki, Kenji .
2010 ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2010, :4594-4597
[8]  
Held RT, 2012, UIST'12: PROCEEDINGS OF THE 25TH ANNUAL ACM SYMPOSIUM ON USER INTERFACE SOFTWARE AND TECHNOLOGY, P423
[9]  
Hunt T., 1982, PUPPETRY EARLY CHILD
[10]   Transformed Human Presence for Puppetry [J].
Kawahara, Keisuke ;
Suzuki, Ippei ;
Sakashita, Mose ;
Suzuki, Kenta ;
Koike, Amy ;
Ochiai, Yoichi .
13TH INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTER ENTERTAINMENT TECHNOLOGY (ACE 2016), 2016,