The mutual influence of an instructor's eye gaze and facial expression in video lectures

被引:23
作者
Pi, Zhongling [1 ]
Zhang, Yi [2 ]
Zhu, Fangfang [2 ]
Chen, Louqi [2 ]
Guo, Xin [2 ]
Yang, Jiumin [2 ]
机构
[1] Shaanxi Normal Univ, Key Lab Modern Teaching Technol, Minist Educ, Xian, Peoples R China
[2] Cent China Normal Univ, Fac Artificial Intelligence Educ, 152 Luoyu Rd, Wuhan 430079, Hubei, Peoples R China
基金
中国国家自然科学基金;
关键词
Video lectures; instructor presence; eye gaze; facial expression; learning performance; MODELING EXAMPLES; VISUAL-ATTENTION; SOCIAL PRESENCE; CONTACT; DIRECTION; EMOTION; FACE; GENDER; MEMORY; SENSITIVITY;
D O I
10.1080/10494820.2021.1940213
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
This study tested the mutual effects of the instructor's eye gaze and facial expression on students' eye movements (i.e. first fixation time to the slides, percentage dwell time on the slides, and percentage dwell time on the instructor), parasocial interaction, and learning performance in pre-recorded video lectures. Students (N = 118 undergraduate and graduate students) were assigned to watch one of four videos in a 2 (gaze: direct, guided) x 2 (facial expression: surprised, neutral) between-groups design. Contrary to our hypotheses, eye movement data showed that students who watched the video lecture with the instructor's guided gaze and surprised face showed longer first fixation time to the slides and lower dwell time on the slides; these students also had lower learning scores. Instructor eye gaze and facial expression did not influence students' ratings of parasocial interaction. Our results suggest that in reference to social cues during video lectures with slides, "more" is not necessarily "better." The findings have practical implications for designing pre-recorded slide-based video lectures: An instructor is cautioned against using multiple social cues simultaneously, especially in video lectures in which the instructor and the visual learning materials compete for students' attention.
引用
收藏
页码:3664 / 3681
页数:18
相关论文
共 43 条
[21]   Neural oscillations and learning performance vary with an instructor's gestures and visual materials in video lectures [J].
Pi, Zhongling ;
Zhang, Yabo ;
Yu, Qiuchen ;
Zhang, Yi ;
Yang, Jiumin ;
Zhao, Qingbai .
BRITISH JOURNAL OF EDUCATIONAL TECHNOLOGY, 2022, 53 (01) :93-113
[22]   Fearful Gaze Cueing: Gaze Direction and Facial Expression Independently Influence Overt Orienting Responses in 12-Month-Olds [J].
Matsunaka, Reiko ;
Hiraki, Kazuo .
PLOS ONE, 2014, 9 (02)
[23]   Continuous Emotion Recognition in Videos by Fusing Facial Expression, Head Pose and Eye Gaze [J].
Wu, Suowei ;
Du, Zhengyin ;
Li, Weixin ;
Huang, Di ;
Wang, Yunhong .
ICMI'19: PROCEEDINGS OF THE 2019 INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION, 2019, :40-48
[24]   Enhancing learner experience with instructor cues in video lectures: A comprehensive exploration and design discovery toward a novel gaze visualization [J].
Jeong, Jae-Yeop ;
Oh, Jiyeon ;
Jeong, Jin-Woo .
EDUCATION AND INFORMATION TECHNOLOGIES, 2024, 29 (16) :21411-21447
[25]   SOCIAL JUDGMENTS ARE INFLUENCED BY BOTH FACIAL EXPRESSION AND DIRECTION OF EYE GAZE [J].
Willis, Megan L. ;
Palermo, Romina ;
Burke, Darren .
SOCIAL COGNITION, 2011, 29 (04) :415-429
[26]   Memory for facial expressions on the autism spectrum: The influence of gaze direction and type of expression [J].
Macinska, Sylwia ;
Jellema, Tjeerd .
AUTISM RESEARCH, 2022, 15 (05) :870-880
[27]   Identification of Emotional Facial Expressions: Effects of Expression, Intensity, and Sex on Eye Gaze [J].
Wells, Laura Jean ;
Gillespie, Steven Mark ;
Rotshtein, Pia .
PLOS ONE, 2016, 11 (12)
[28]   Research on an Eye Control Method Based on the Fusion of Facial Expression and Gaze Intention Recognition [J].
Sun, Xiangyang ;
Cai, Zihan .
APPLIED SCIENCES-BASEL, 2024, 14 (22)
[29]   Estimation of the Quality of Experience During Video Streaming From Facial Expression and Gaze Direction [J].
Porcu, Simone ;
Floris, Alessandro ;
Voigt-Antons, Jan-Niklas ;
Atzori, Luigi ;
Moeller, Sebastian .
IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2020, 17 (04) :2702-2716
[30]   Multimodal Human Attention Detection for Reading from Facial Expression, Eye Gaze, and Mouse Dynamics [J].
Li, Jiajia ;
Ngai, Grace ;
Leong, Hong Va ;
Chan, Stephen C. F. .
APPLIED COMPUTING REVIEW, 2016, 16 (03) :37-49