Visual context benefits spoken sentence comprehension across the lifespan

被引:0
作者
Zona, Carlotta Isabella [1 ,3 ]
Reifegerste, Jana [2 ]
机构
[1] Univ Potsdam, Potsdam Res Inst Multilingualism, Bldg 2,Room 0-07,Karl Liebknecht Str 24-25, D-14476 Potsdam, Germany
[2] Georgetown Univ, Dept Neurol, Bldg D,Room 235A,4000 Reservoir Rd,NW, Washington, DC 20057 USA
[3] Univ Potsdam, Potsdam Embodied Cognit Grp, Bldg 14,Room 6-22,Karl Liebknecht Str 24-25, D-14476 Potsdam, Germany
基金
美国国家科学基金会;
关键词
Sentence comprehension; Aging; Visual context; Working memory; Interference control; MONTREAL COGNITIVE ASSESSMENT; WORKING-MEMORY CAPACITY; OLDER-ADULTS; AGE-DIFFERENCES; RELATIVE CLAUSES; EYE-MOVEMENTS; INDIVIDUAL-DIFFERENCES; SYNTACTIC COMPLEXITY; RESOURCE-ALLOCATION; STROOP INTERFERENCE;
D O I
10.1016/j.jml.2024.104576
中图分类号
H0 [语言学];
学科分类号
030303 ; 0501 ; 050102 ;
摘要
Evidence for age-related declines in syntactic comprehension is mixed, often modulated by concomitant cognitive changes. Further, while older (vs. younger) adults may make greater use of semantic information for sentence comprehension, it is unclear whether this extends to visual information. We investigated whether visual-scene depictions benefit sentence comprehension in adults with varying cognitive-ability levels. 153 participants (18-70 years) listened to German relative clauses with canonical/noncanonical structure ("This is the man who follows the woman"/"...whom the woman follows") presented in isolation or alongside visual-scene depictions, and answered agent-identification questions. Visual-scene depictions facilitated comprehension, especially when individuals with lower cognitive-ability levels encountered noncanonical structures. Individual differences in cognitive ability tended to modulate age-related changes in comprehension of utterances presented in isolation. These findings indicate beneficial effects of visual information for thematic-role comprehension - especially when task demands are high - and that cognitive-ability levels may modulate age-related changes in comprehension.
引用
收藏
页数:14
相关论文
共 50 条
[21]   Rapid Serial Visual Presentation Interacts with Ambiguity During Sentence Comprehension [J].
Sarah E. Key-DeLyria ;
Todd Bodner ;
Lori J. P. Altmann .
Journal of Psycholinguistic Research, 2019, 48 :665-682
[22]   Revealing differential importance of word categories in spoken sentence comprehension using phoneme-related representation [J].
Trang-Le Thi ;
Na, Youngmin ;
Choi, Inyong ;
Woo, Jihwan .
JOURNAL OF INTEGRATIVE NEUROSCIENCE, 2022, 21 (01)
[23]   Changes in the modulation of brain activity during context encoding vs. context retrieval across the adult lifespan [J].
Ankudowich, E. ;
Pasvanis, S. ;
Rajah, M. N. .
NEUROIMAGE, 2016, 139 :103-113
[24]   Children Flexibly Seek Visual Information to Support Signed and Spoken Language Comprehension [J].
MacDonald, Kyle ;
Marchman, Virginia A. ;
Fernald, Anne ;
Frank, Michael C. .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL, 2020, 149 (06) :1078-1096
[25]   Integration of Partial Information Within and Across Modalities: Contributions to Spoken and Written Sentence Recognition [J].
Smith, Kimberly G. ;
Fogerty, Daniel .
JOURNAL OF SPEECH LANGUAGE AND HEARING RESEARCH, 2015, 58 (06) :1805-1817
[26]   Context Memory Encoding and Retrieval Temporal Dynamics are Modulated by Attention across the Adult Lifespan [J].
Mirjalili, Soroush ;
Powell, Patrick ;
Strunk, Jonathan ;
James, Taylor ;
Duarte, Audrey .
ENEURO, 2021, 8 (01) :1-15
[27]   Tracking the time-course of spoken word recognition of Cantonese Chinese in sentence context: Evidence from eye movements [J].
Yip, Michael C. W. .
PSYCHONOMIC BULLETIN & REVIEW, 2024, 31 (03) :1131-1141
[28]   Morphological constraints in children's spoken language comprehension: A visual world study of plurals inside compounds in English [J].
Silva, Renita ;
Gerth, Sabrina ;
Clahsen, Harald .
COGNITION, 2013, 129 (02) :457-469
[29]   Speech and Span: Working Memory Capacity Impacts the Use of Animacy but Not of World Knowledge during Spoken Sentence Comprehension [J].
Nakano, Hiroko ;
Saron, Clifford ;
Swaab, Tamara Y. .
JOURNAL OF COGNITIVE NEUROSCIENCE, 2010, 22 (12) :2886-2898
[30]   The cortical organization of audio-visual sentence comprehension: an fMRI study at 4 Tesla [J].
Capek, CM ;
Bavelier, D ;
Corina, D ;
Newman, AJ ;
Jezzard, P ;
Neville, HJ .
COGNITIVE BRAIN RESEARCH, 2004, 20 (02) :111-119