Visual context benefits spoken sentence comprehension across the lifespan

被引:0
作者
Zona, Carlotta Isabella [1 ,3 ]
Reifegerste, Jana [2 ]
机构
[1] Univ Potsdam, Potsdam Res Inst Multilingualism, Bldg 2,Room 0-07,Karl Liebknecht Str 24-25, D-14476 Potsdam, Germany
[2] Georgetown Univ, Dept Neurol, Bldg D,Room 235A,4000 Reservoir Rd,NW, Washington, DC 20057 USA
[3] Univ Potsdam, Potsdam Embodied Cognit Grp, Bldg 14,Room 6-22,Karl Liebknecht Str 24-25, D-14476 Potsdam, Germany
基金
美国国家科学基金会;
关键词
Sentence comprehension; Aging; Visual context; Working memory; Interference control; MONTREAL COGNITIVE ASSESSMENT; WORKING-MEMORY CAPACITY; OLDER-ADULTS; AGE-DIFFERENCES; RELATIVE CLAUSES; EYE-MOVEMENTS; INDIVIDUAL-DIFFERENCES; SYNTACTIC COMPLEXITY; RESOURCE-ALLOCATION; STROOP INTERFERENCE;
D O I
10.1016/j.jml.2024.104576
中图分类号
H0 [语言学];
学科分类号
030303 ; 0501 ; 050102 ;
摘要
Evidence for age-related declines in syntactic comprehension is mixed, often modulated by concomitant cognitive changes. Further, while older (vs. younger) adults may make greater use of semantic information for sentence comprehension, it is unclear whether this extends to visual information. We investigated whether visual-scene depictions benefit sentence comprehension in adults with varying cognitive-ability levels. 153 participants (18-70 years) listened to German relative clauses with canonical/noncanonical structure ("This is the man who follows the woman"/"...whom the woman follows") presented in isolation or alongside visual-scene depictions, and answered agent-identification questions. Visual-scene depictions facilitated comprehension, especially when individuals with lower cognitive-ability levels encountered noncanonical structures. Individual differences in cognitive ability tended to modulate age-related changes in comprehension of utterances presented in isolation. These findings indicate beneficial effects of visual information for thematic-role comprehension - especially when task demands are high - and that cognitive-ability levels may modulate age-related changes in comprehension.
引用
收藏
页数:14
相关论文
共 50 条
[31]   Does the Timing of Visual Support Affect Sentence Comprehension? An Eye-Tracking Study [J].
Rivero-Contreras, Miriam ;
Engelhardt, Paul E. ;
Delgado, Pablo ;
Saldana, David .
JOURNAL OF EXPERIMENTAL EDUCATION, 2023,
[32]   Assessment of Lifestyle Experiences across Lifespan and Cognitive Ageing in the Indian Context [J].
Paplikar, Avanthi ;
Ballal, Divya ;
Varghese, Feba ;
Sireesha, Jala ;
Dwivedi, Ramya ;
Rajan, Amulya ;
Mekala, Shailaja ;
Arshad, Faheem ;
Kaul, Subhash ;
Alladi, Suvarna .
PSYCHOLOGY AND DEVELOPING SOCIETIES, 2020, 32 (02) :308-330
[33]   Distinct effects of different visual cues on sentence comprehension and later recall: The case of speaker gaze versus depicted actions [J].
Kreysa, Helene ;
Nunnemann, Eva M. ;
Knoeferle, Pia .
ACTA PSYCHOLOGICA, 2018, 188 :220-229
[34]   Developmental changes in GABAergic mechanisms in human visual cortex across the lifespan [J].
Pinto, Joshua G. A. ;
Hornby, Kyle R. ;
Jones, David G. ;
Murphy, Kathryn M. .
FRONTIERS IN CELLULAR NEUROSCIENCE, 2010, 4
[35]   Using the Visual World Paradigm to Study Sentence Comprehension in Mandarin-Speaking Children with Autism [J].
Zhou, Peng ;
Ma, Weiyi ;
Zhan, Likan ;
Ma, Huimin .
JOVE-JOURNAL OF VISUALIZED EXPERIMENTS, 2018, (140)
[36]   Referring Expression Comprehension via Co-attention and Visual Context [J].
Gao, Youming ;
Ji, Yi ;
Xu, Ting ;
Xu, Yunlong ;
Liu, Chunping .
ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2019: IMAGE PROCESSING, PT III, 2019, 11729 :119-130
[37]   The Effects of Phonological Short-Term Memory and Speech Perception on Spoken Sentence Comprehension in Children: Simulating Deficits in an Experimental Design [J].
Higgins, Meaghan C. ;
Penney, Sarah B. ;
Robertson, Erin K. .
JOURNAL OF PSYCHOLINGUISTIC RESEARCH, 2017, 46 (05) :1213-1235
[38]   Who Benefits the Most? Individual Differences in the Transfer of Executive Control Training Across the Lifespan [J].
Karbach J. ;
Könen T. ;
Spengler M. .
Journal of Cognitive Enhancement, 2017, 1 (4) :394-405
[39]   Story Comprehension Monitoring Across Visual, Listening, and Written Modalities in Children with and Without Autism Spectrum Disorder [J].
Davidson, Meghan M. ;
Fleming, Kandace K. .
JOURNAL OF AUTISM AND DEVELOPMENTAL DISORDERS, 2023, 53 (01) :1-24
[40]   Common Neural System for Sentence and Picture Comprehension Across Languages: A Chinese-Japanese Bilingual Study [J].
Hu, Zhengfei ;
Yang, Huixiang ;
Yang, Yuxiang ;
Nishida, Shuhei ;
Madden-Lombardi, Carol ;
Ventre-Dominey, Jocelyne ;
Dominey, Peter Ford ;
Ogawa, Kenji .
FRONTIERS IN HUMAN NEUROSCIENCE, 2019, 13