The Development of the Ability to Semantically Integrate Information in Speech and Iconic Gesture in Comprehension

被引:31
作者
Sekine, Kazuki [1 ]
Sowden, Hannah [2 ]
Kita, Sotaro [1 ]
机构
[1] Univ Warwick, Dept Psychol, Coventry CV4 7AL, W Midlands, England
[2] Univ Kingston, Dept English Language & Commun, Kingston Upon Thames, Surrey, England
关键词
Gesture; Speech; Semantics; Multimodal communication; Preschool children; CHILDREN; COMMUNICATION; OBJECTS; REPRESENTATION; TELEVISION; IMITATION; LANGUAGE; MEMORY; MIND;
D O I
10.1111/cogs.12221
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
We examined whether children's ability to integrate speech and gesture follows the pattern of a broader developmental shift between 3- and 5-year-old children (Ramscar & Gitcho, 2007) regarding the ability to process two pieces of information simultaneously. In Experiment 1, 3-year-olds, 5-year-olds, and adults were presented with either an iconic gesture or a spoken sentence or a combination of the two on a computer screen, and they were instructed to select a photograph that best matched the message. The 3-year-olds did not integrate information in speech and gesture, but 5-year-olds and adults did. In Experiment 2, 3-year-old children were presented with the same speech and gesture as in Experiment 1 that were produced live by an experimenter. When presented live, 3-year-olds could integrate speech and gesture. We concluded that development of the integration ability is a part of the broader developmental shift; however, live-presentation facilitates the nascent integration ability in 3-year-olds.
引用
收藏
页码:1855 / 1880
页数:26
相关论文
共 50 条
  • [41] Electrophysiological evidence for the enhancement of gesture-speech integration by linguistic predictability during multimodal discourse comprehension
    Florian Hintz
    Yung Han Khoe
    Antje Strauß
    Adam Johannes Alfredo Psomakas
    Judith Holler
    Cognitive, Affective, & Behavioral Neuroscience, 2023, 23 : 340 - 353
  • [42] Knowing 'who she is' based on 'where she is': The effect of co-speech gesture on pronoun comprehension
    Goodrich Smith, Whitney
    Hudson Kam, Carla L.
    LANGUAGE AND COGNITION, 2012, 4 (02) : 75 - 98
  • [43] Development and preliminary evaluation of a new test of ongoing speech comprehension
    Best, Virginia
    Keidser, Gitte
    Buchholz, Joerg M.
    Freeston, Katrina
    INTERNATIONAL JOURNAL OF AUDIOLOGY, 2016, 55 (01) : 45 - 52
  • [44] Idiosyncratic gesture use in atypical language development, and its interaction with speech rhythm, word juncture, syntax, pragmatics and discourse: a case study
    Howard, Sara J.
    Perkins, Michael R.
    Sowden, Hannah
    CLINICAL LINGUISTICS & PHONETICS, 2012, 26 (10) : 882 - 907
  • [45] The use of Information and Communication Technologies in the development of reading comprehension
    Tomas Batista, Barbara Lisett
    Patterson Santisteban, Anna Bella
    DILEMAS CONTEMPORANEOS-EDUCACION POLITICA Y VALORES, 2016, 4 (01):
  • [46] Modulation of brain activity by psycholinguistic information during naturalistic speech comprehension and production
    Wu, Wei
    Morales, Matias
    Patel, Tanvi
    Pickering, Martin J.
    Hoffman, Paul
    CORTEX, 2022, 155 : 287 - 306
  • [47] Benefit of visual speech information for word comprehension in post-stroke aphasia
    Krason, Anna
    Vigliocco, Gabriella
    Mailend, Marja-Liisa
    Stoll, Harrison
    Varley, Rosemary
    Buxbaum, Laurel J.
    CORTEX, 2023, 165 : 86 - 100
  • [48] Exploring how visual attention, inhibitory control, and co-speech gesture instruction contribute to children's analogical reasoning ability
    Guarino, Katharine F.
    Wakefield, Elizabeth M.
    Morrison, Robert G.
    Richland, Lindsey E.
    COGNITIVE DEVELOPMENT, 2021, 58
  • [49] Effect of sex and dyad composition on speech and gesture development of singleton and twin children
    Ozturk, Sumeyra
    Pinar, Ebru
    Ketrez, F. Nihan
    Ozcaliskan, Seyda
    JOURNAL OF CHILD LANGUAGE, 2021, 48 (05) : 1048 - 1066
  • [50] Through Thick and Thin: Gesture and Speech Remain as an Integrated System in Atypical Development
    Demir-Lira, O. Ece
    Goksun, Tilbe
    TOPICS IN COGNITIVE SCIENCE, 2024,