The Development of the Ability to Semantically Integrate Information in Speech and Iconic Gesture in Comprehension

被引:32
作者
Sekine, Kazuki [1 ]
Sowden, Hannah [2 ]
Kita, Sotaro [1 ]
机构
[1] Univ Warwick, Dept Psychol, Coventry CV4 7AL, W Midlands, England
[2] Univ Kingston, Dept English Language & Commun, Kingston Upon Thames, Surrey, England
关键词
Gesture; Speech; Semantics; Multimodal communication; Preschool children; CHILDREN; COMMUNICATION; OBJECTS; REPRESENTATION; TELEVISION; IMITATION; LANGUAGE; MEMORY; MIND;
D O I
10.1111/cogs.12221
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
We examined whether children's ability to integrate speech and gesture follows the pattern of a broader developmental shift between 3- and 5-year-old children (Ramscar & Gitcho, 2007) regarding the ability to process two pieces of information simultaneously. In Experiment 1, 3-year-olds, 5-year-olds, and adults were presented with either an iconic gesture or a spoken sentence or a combination of the two on a computer screen, and they were instructed to select a photograph that best matched the message. The 3-year-olds did not integrate information in speech and gesture, but 5-year-olds and adults did. In Experiment 2, 3-year-old children were presented with the same speech and gesture as in Experiment 1 that were produced live by an experimenter. When presented live, 3-year-olds could integrate speech and gesture. We concluded that development of the integration ability is a part of the broader developmental shift; however, live-presentation facilitates the nascent integration ability in 3-year-olds.
引用
收藏
页码:1855 / 1880
页数:26
相关论文
共 50 条
  • [31] Degree of Language Experience Modulates Visual Attention to Visible Speech and Iconic Gestures During Clear and Degraded Speech Comprehension
    Drijvers, Linda
    Vaitonyte, Julija
    Ozyurek, Asli
    COGNITIVE SCIENCE, 2019, 43 (10)
  • [32] Children integrate speech and gesture across a wider temporal window than speech and action when learning a math concept
    Carrazza, Cristina
    Wakefield, Elizabeth M.
    Hemani-Lopez, Naureen
    Plath, Kristin
    Goldin-Meadow, Susan
    COGNITION, 2021, 210
  • [33] Neural development of networks for audiovisual speech comprehension
    Dick, Anthony Steven
    Solodkin, Ana
    Small, Steven L.
    BRAIN AND LANGUAGE, 2010, 114 (02) : 101 - 114
  • [34] Evidence for children's online integration of simultaneous information from speech and iconic gestures: an ERP study
    Sekine, Kazuki
    Schoechl, Christina
    Mulder, Kimberley
    Holler, Judith
    Kelly, Spencer
    Furman, Reyhan
    Ozyurek, Asli
    LANGUAGE COGNITION AND NEUROSCIENCE, 2020, 35 (10) : 1283 - 1294
  • [35] The development of co-speech gesture and its semantic integration with speech in 6-to 12-year-old children with autism spectrum disorders
    So, Wing-Chee
    Wong, Miranda Kit-Yi
    Lui, Ming
    Yip, Virginia
    AUTISM, 2015, 19 (08) : 956 - 968
  • [36] Deliberate synchronization of speech and gesture: effects of neurodiversity and development
    Eigsti, Inge-Marie
    Pouw, Wim
    LANGUAGE AND COGNITION, 2024, 16 (04) : 1812 - 1833
  • [37] A cross-linguistic study of the development of gesture and speech in Zulu and French oral narratives
    Nicolas, Ramona Kunene
    Guidetti, Michele
    Colletta, Jean-Marc
    JOURNAL OF CHILD LANGUAGE, 2017, 44 (01) : 36 - 62
  • [38] Sensitivity to information status in discourse: Gesture precedes speech in unbalanced bilinguals
    So, Wing-Chee
    Lim, Jia-Yi
    Tan, Seok-Hui
    APPLIED PSYCHOLINGUISTICS, 2014, 35 (01) : 71 - 95
  • [39] Do 14-17-month-old infants use iconic speech and gesture cues to interpret word meanings?
    Aussems, Suzanne
    Smith, Lottie Devey
    Kita, Sotaro
    JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2024, 156 (01) : 638 - 654
  • [40] Universal Development and L1-L2 Convergence in Bilingual Construal of Manner in Speech and Gesture in Mandarin, Japanese, and English
    Brown, Amanda
    MODERN LANGUAGE JOURNAL, 2015, 99 : 66 - 82