Eye'll Help You Out! How the Gaze Cue Reduces the Cognitive Load Required for Reference Processing

被引:23
作者
Sekicki, Mirjana [1 ]
Staudte, Maria [1 ]
机构
[1] Saarland Univ, Dept Language Sci & Technol, Campus Saarbucken C7-4,2-04, D-66123 Saarbrucken, Germany
关键词
Situated sentence comprehension; Visual world paradigm; Referential gaze; Anticipatory eye movements; Verbal restrictions; Surprisal; Cognitive load; The Index of Cognitive Activity; TIME-COURSE; LANGUAGE; MOVEMENTS; ATTENTION; INFORMATION; PREDICTION; TRACKING; OBJECTS; SHAPE;
D O I
10.1111/cogs.12682
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Referential gaze has been shown to benefit language processing insituated communication in terms of shifting visual attention and leading to shorter reaction times on subsequent tasks. The present study simultaneously assessed both visual attention and, importantly, the immediate cognitive load induced at different stages of sentence processing. We aimed to examine the dynamics of combining visual and linguistic information in creating anticipation for a specific object and the effect this has on language processing. We report evidence from three visual-world eye-tracking experiments, showing that referential gaze leads to a shift in visual attention toward the cued object, which consequently lowers the effort required for processing the linguistic reference. Importantly, perceiving and following the gaze cue did not prove costly in terms of cognitive effort, unless the cued object did not fit the verb selectional preferences.
引用
收藏
页码:2418 / 2458
页数:41
相关论文
共 59 条
[1]   Tracking the time course of spoken word recognition using eye movements: Evidence for continuous mapping models [J].
Allopenna, PD ;
Magnuson, JS ;
Tanenhaus, MK .
JOURNAL OF MEMORY AND LANGUAGE, 1998, 38 (04) :419-439
[2]   The real-time mediation of visual attention by language and world knowledge: Linking anticipatory (and other) eye movements to linguistic processing [J].
Altmann, Gerry T. M. ;
Kamide, Yuki .
JOURNAL OF MEMORY AND LANGUAGE, 2007, 57 (04) :502-518
[3]   Incrementality and Prediction in Human Sentence Processing [J].
Altmann, Gerry T. M. ;
Mirkovic, Jelena .
COGNITIVE SCIENCE, 2009, 33 (04) :583-609
[4]   Incremental interpretation at verbs: restricting the domain of subsequent reference [J].
Altmann, GTM ;
Kamide, Y .
COGNITION, 1999, 73 (03) :247-264
[5]  
[Anonymous], P IEEE 7 C HUM FACT, DOI DOI 10.1109/HFPP.2002.1042860
[6]  
[Anonymous], 2013, Short Papers
[7]  
Argyle Michael, 1976, Gaze and Mutual Gaze
[8]   Using pointing and describing to achieve joint focus of attention in dialogue [J].
Bangerter, A .
PSYCHOLOGICAL SCIENCE, 2004, 15 (06) :415-419
[9]   Random effects structure for confirmatory hypothesis testing: Keep it maximal [J].
Barr, Dale J. ;
Levy, Roger ;
Scheepers, Christoph ;
Tily, Harry J. .
JOURNAL OF MEMORY AND LANGUAGE, 2013, 68 (03) :255-278
[10]   Fitting Linear Mixed-Effects Models Using lme4 [J].
Bates, Douglas ;
Maechler, Martin ;
Bolker, Benjamin M. ;
Walker, Steven C. .
JOURNAL OF STATISTICAL SOFTWARE, 2015, 67 (01) :1-48