The mutual influence of an instructor's eye gaze and facial expression in video lectures

被引:20
作者
Pi, Zhongling [1 ]
Zhang, Yi [2 ]
Zhu, Fangfang [2 ]
Chen, Louqi [2 ]
Guo, Xin [2 ]
Yang, Jiumin [2 ]
机构
[1] Shaanxi Normal Univ, Key Lab Modern Teaching Technol, Minist Educ, Xian, Peoples R China
[2] Cent China Normal Univ, Fac Artificial Intelligence Educ, 152 Luoyu Rd, Wuhan 430079, Hubei, Peoples R China
基金
中国国家自然科学基金;
关键词
Video lectures; instructor presence; eye gaze; facial expression; learning performance; MODELING EXAMPLES; VISUAL-ATTENTION; SOCIAL PRESENCE; CONTACT; DIRECTION; EMOTION; FACE; GENDER; MEMORY; SENSITIVITY;
D O I
10.1080/10494820.2021.1940213
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
This study tested the mutual effects of the instructor's eye gaze and facial expression on students' eye movements (i.e. first fixation time to the slides, percentage dwell time on the slides, and percentage dwell time on the instructor), parasocial interaction, and learning performance in pre-recorded video lectures. Students (N = 118 undergraduate and graduate students) were assigned to watch one of four videos in a 2 (gaze: direct, guided) x 2 (facial expression: surprised, neutral) between-groups design. Contrary to our hypotheses, eye movement data showed that students who watched the video lecture with the instructor's guided gaze and surprised face showed longer first fixation time to the slides and lower dwell time on the slides; these students also had lower learning scores. Instructor eye gaze and facial expression did not influence students' ratings of parasocial interaction. Our results suggest that in reference to social cues during video lectures with slides, "more" is not necessarily "better." The findings have practical implications for designing pre-recorded slide-based video lectures: An instructor is cautioned against using multiple social cues simultaneously, especially in video lectures in which the instructor and the visual learning materials compete for students' attention.
引用
收藏
页码:3664 / 3681
页数:18
相关论文
共 41 条
  • [21] Neural oscillations and learning performance vary with an instructor's gestures and visual materials in video lectures
    Pi, Zhongling
    Zhang, Yabo
    Yu, Qiuchen
    Zhang, Yi
    Yang, Jiumin
    Zhao, Qingbai
    BRITISH JOURNAL OF EDUCATIONAL TECHNOLOGY, 2022, 53 (01) : 93 - 113
  • [22] Fearful Gaze Cueing: Gaze Direction and Facial Expression Independently Influence Overt Orienting Responses in 12-Month-Olds
    Matsunaka, Reiko
    Hiraki, Kazuo
    PLOS ONE, 2014, 9 (02):
  • [23] Continuous Emotion Recognition in Videos by Fusing Facial Expression, Head Pose and Eye Gaze
    Wu, Suowei
    Du, Zhengyin
    Li, Weixin
    Huang, Di
    Wang, Yunhong
    ICMI'19: PROCEEDINGS OF THE 2019 INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION, 2019, : 40 - 48
  • [24] Enhancing learner experience with instructor cues in video lectures: A comprehensive exploration and design discovery toward a novel gaze visualization
    Jeong, Jae-Yeop
    Oh, Jiyeon
    Jeong, Jin-Woo
    EDUCATION AND INFORMATION TECHNOLOGIES, 2024, 29 (16) : 21411 - 21447
  • [25] SOCIAL JUDGMENTS ARE INFLUENCED BY BOTH FACIAL EXPRESSION AND DIRECTION OF EYE GAZE
    Willis, Megan L.
    Palermo, Romina
    Burke, Darren
    SOCIAL COGNITION, 2011, 29 (04) : 415 - 429
  • [26] Memory for facial expressions on the autism spectrum: The influence of gaze direction and type of expression
    Macinska, Sylwia
    Jellema, Tjeerd
    AUTISM RESEARCH, 2022, 15 (05) : 870 - 880
  • [27] Identification of Emotional Facial Expressions: Effects of Expression, Intensity, and Sex on Eye Gaze
    Wells, Laura Jean
    Gillespie, Steven Mark
    Rotshtein, Pia
    PLOS ONE, 2016, 11 (12):
  • [28] Research on an Eye Control Method Based on the Fusion of Facial Expression and Gaze Intention Recognition
    Sun, Xiangyang
    Cai, Zihan
    APPLIED SCIENCES-BASEL, 2024, 14 (22):
  • [29] Estimation of the Quality of Experience During Video Streaming From Facial Expression and Gaze Direction
    Porcu, Simone
    Floris, Alessandro
    Voigt-Antons, Jan-Niklas
    Atzori, Luigi
    Moeller, Sebastian
    IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2020, 17 (04): : 2702 - 2716
  • [30] Multimodal Human Attention Detection for Reading from Facial Expression, Eye Gaze, and Mouse Dynamics
    Li, Jiajia
    Ngai, Grace
    Leong, Hong Va
    Chan, Stephen C. F.
    APPLIED COMPUTING REVIEW, 2016, 16 (03): : 37 - 49