The Development of the Ability to Semantically Integrate Information in Speech and Iconic Gesture in Comprehension

被引:32
|
作者
Sekine, Kazuki [1 ]
Sowden, Hannah [2 ]
Kita, Sotaro [1 ]
机构
[1] Univ Warwick, Dept Psychol, Coventry CV4 7AL, W Midlands, England
[2] Univ Kingston, Dept English Language & Commun, Kingston Upon Thames, Surrey, England
关键词
Gesture; Speech; Semantics; Multimodal communication; Preschool children; CHILDREN; COMMUNICATION; OBJECTS; REPRESENTATION; TELEVISION; IMITATION; LANGUAGE; MEMORY; MIND;
D O I
10.1111/cogs.12221
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
We examined whether children's ability to integrate speech and gesture follows the pattern of a broader developmental shift between 3- and 5-year-old children (Ramscar & Gitcho, 2007) regarding the ability to process two pieces of information simultaneously. In Experiment 1, 3-year-olds, 5-year-olds, and adults were presented with either an iconic gesture or a spoken sentence or a combination of the two on a computer screen, and they were instructed to select a photograph that best matched the message. The 3-year-olds did not integrate information in speech and gesture, but 5-year-olds and adults did. In Experiment 2, 3-year-old children were presented with the same speech and gesture as in Experiment 1 that were produced live by an experimenter. When presented live, 3-year-olds could integrate speech and gesture. We concluded that development of the integration ability is a part of the broader developmental shift; however, live-presentation facilitates the nascent integration ability in 3-year-olds.
引用
收藏
页码:1855 / 1880
页数:26
相关论文
共 50 条
  • [21] The processing of speech, gesture, and action during language comprehension
    Spencer Kelly
    Meghan Healey
    Asli Özyürek
    Judith Holler
    Psychonomic Bulletin & Review, 2015, 22 : 517 - 523
  • [22] Electrophysiological evidence for the enhancement of gesture-speech integration by linguistic predictability during multimodal discourse comprehension
    Hintz, Florian
    Khoe, Yung Han
    Strauss, Antje
    Psomakas, Adam Johannes Alfredo
    Holler, Judith
    COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE, 2023, 23 (02) : 340 - 353
  • [23] Second Language Speech Intelligibility Revisited: Differential Roles of Phonological Accuracy, Visual Speech, and Iconic Gesture
    Wheeler, Page
    Saito, Kazuya
    MODERN LANGUAGE JOURNAL, 2022, 106 (02) : 429 - 448
  • [24] Emoji as gesture in digital communication: Emoji improve comprehension of indirect speech
    Hancock, Patrick M.
    Hilverman, Caitlin
    Cook, Susan Wagner
    Halvorson, Kimberly M.
    PSYCHONOMIC BULLETIN & REVIEW, 2024, 31 (03) : 1335 - 1347
  • [25] The Role of Synchrony and Ambiguity in Speech-Gesture Integration during Comprehension
    Habets, Boukje
    Kita, Sotaro
    Shao, Zeshu
    Oezyurek, Asli
    Hagoort, Peter
    JOURNAL OF COGNITIVE NEUROSCIENCE, 2011, 23 (08) : 1845 - 1854
  • [26] The Development of Gesture Skills in Chinese Autistic Children: The Predictive Roles of Age and Language Ability
    Zhang, Xin
    Song, Xue-Ke
    So, Wing-Chee
    JOURNAL OF SPEECH LANGUAGE AND HEARING RESEARCH, 2024, 67 (08): : 2583 - 2599
  • [27] The effect of directive words on integrated comprehension of speech and iconic gestures for actions in young children
    Miyake, Hidenori
    Sugimura, Shinichiro
    INFANT AND CHILD DEVELOPMENT, 2018, 27 (05):
  • [28] Lending a hand to storytelling: Gesture's effects on narrative comprehension moderated by task difficulty and cognitive ability
    McKern, Nicola
    Dargue, Nicole
    Sweller, Naomi
    Sekine, Kazuki
    Austin, Elizabeth
    QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY, 2021, 74 (10) : 1791 - 1805
  • [29] What Iconic Gesture Fragments Reveal about Gesture-Speech Integration: When Synchrony Is Lost, Memory Can Help
    Obermeier, Christian
    Holle, Henning
    Gunter, Thomas C.
    JOURNAL OF COGNITIVE NEUROSCIENCE, 2011, 23 (07) : 1648 - 1663
  • [30] Integration of iconic gestures and speech in left superior temporal areas boosts speech comprehension under adverse listening conditions
    Holle, Henning
    Obleser, Jonas
    Rueschemeyer, Shirley-Ann
    Gunter, Thomas C.
    NEUROIMAGE, 2010, 49 (01) : 875 - 884