Children Flexibly Seek Visual Information to Support Signed and Spoken Language Comprehension

被引:12
作者
MacDonald, Kyle [1 ,2 ]
Marchman, Virginia A. [1 ]
Fernald, Anne [1 ]
Frank, Michael C. [1 ]
机构
[1] Stanford Univ, Dept Psychol, Stanford, CA 94305 USA
[2] Univ Calif Los Angeles, Dept Commun, 2225 Rolfe Hall, Los Angeles, CA 90095 USA
关键词
eye movements; grounded language comprehension; information-seeking; speech in background noise; American Sign Language; EYE-MOVEMENTS; WORD RECOGNITION; TIME-COURSE; SPEECH; ATTENTION; MODEL; INPUT; DEAF; INTEGRATION; TRACKING;
D O I
10.1037/xge0000702
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
During grounded language comprehension, listeners must link the incoming linguistic signal to the visual world despite uncertainty in the input. Information gathered through visual fixations can facilitate understanding. But do listeners flexibly seek supportive visual information? Here, we propose that even young children can adapt their gaze and actively gather information for the goal of language comprehension. We present 2 studies of eye movements during real-time language processing, where the value of fixating on a social partner varies across different contexts. First, compared with children learning spoken English (n = 80), young American Sign Language (ASL) learners (n = 30) delayed gaze shifts away from a language source and produced a higher proportion of language-consistent eye movements. This result provides evidence that ASL learners adapt their gaze to effectively divide attention between language and referents, which both compete for processing via the visual channel. Second, English-speaking preschoolers (n = 39) and adults (n = 31) fixated longer on a speaker's face while processing language in a noisy auditory environment. Critically, like the ASL learners in Experiment 1, this delay resulted in gathering more visual information and a higher proportion of language-consistent gaze shifts. Taken together, these studies suggest that young listeners can adapt their gaze to seek visual information from social partners to support real-time language comprehension.
引用
收藏
页码:1078 / 1096
页数:19
相关论文
共 60 条
[1]   Tracking the time course of spoken word recognition using eye movements: Evidence for continuous mapping models [J].
Allopenna, PD ;
Magnuson, JS ;
Tanenhaus, MK .
JOURNAL OF MEMORY AND LANGUAGE, 1998, 38 (04) :419-439
[2]   Do deaf individuals see better? [J].
Bavelier, Daphne ;
Dye, Matthew W. G. ;
Hauser, Peter C. .
TRENDS IN COGNITIVE SCIENCES, 2006, 10 (11) :512-518
[3]  
Bettger J, 1997, J Deaf Stud Deaf Educ, V2, P223
[4]  
Clark E., 2009, 1 LANGUAGE ACQUISITI, DOI DOI 10.1017/CBO9780511806698
[5]   Looking at the rope when looking for the snake: Conceptually mediated eye movements during spoken-word recognition [J].
Dahan, D ;
Tanenhaus, MK .
PSYCHONOMIC BULLETIN & REVIEW, 2005, 12 (03) :453-+
[6]   VISUAL-IMAGERY AND VISUAL SPATIAL LANGUAGE - ENHANCED IMAGERY ABILITIES IN DEAF AND HEARING ASL SIGNERS [J].
EMMOREY, K ;
KOSSLYN, SM ;
BELLUGI, U .
COGNITION, 1993, 46 (02) :139-181
[7]   Mental rotation Within linguistic and non-linguistic domains in users of American sign language [J].
Emmorey, K ;
Klima, E ;
Hickok, G .
COGNITION, 1998, 68 (03) :221-246
[8]   INTERACTION OF AUDITION AND VISION IN RECOGNITION OF ORAL SPEECH STIMULI [J].
ERBER, NP .
JOURNAL OF SPEECH AND HEARING RESEARCH, 1969, 12 (02) :423-&
[9]   Getting and maintaining attention in talk to young children [J].
Estigarribia, Bruno ;
Clark, Eve V. .
JOURNAL OF CHILD LANGUAGE, 2007, 34 (04) :799-814
[10]   From faces to hands: Changing visual input in the first two years [J].
Fausey, Caitlin M. ;
Jayaraman, Swapnaa ;
Smith, Linda B. .
COGNITION, 2016, 152 :101-107