The Development of the Ability to Semantically Integrate Information in Speech and Iconic Gesture in Comprehension

被引:34
作者
Sekine, Kazuki [1 ]
Sowden, Hannah [2 ]
Kita, Sotaro [1 ]
机构
[1] Univ Warwick, Dept Psychol, Coventry CV4 7AL, W Midlands, England
[2] Univ Kingston, Dept English Language & Commun, Kingston Upon Thames, Surrey, England
关键词
Gesture; Speech; Semantics; Multimodal communication; Preschool children; CHILDREN; COMMUNICATION; OBJECTS; REPRESENTATION; TELEVISION; IMITATION; LANGUAGE; MEMORY; MIND;
D O I
10.1111/cogs.12221
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
We examined whether children's ability to integrate speech and gesture follows the pattern of a broader developmental shift between 3- and 5-year-old children (Ramscar & Gitcho, 2007) regarding the ability to process two pieces of information simultaneously. In Experiment 1, 3-year-olds, 5-year-olds, and adults were presented with either an iconic gesture or a spoken sentence or a combination of the two on a computer screen, and they were instructed to select a photograph that best matched the message. The 3-year-olds did not integrate information in speech and gesture, but 5-year-olds and adults did. In Experiment 2, 3-year-old children were presented with the same speech and gesture as in Experiment 1 that were produced live by an experimenter. When presented live, 3-year-olds could integrate speech and gesture. We concluded that development of the integration ability is a part of the broader developmental shift; however, live-presentation facilitates the nascent integration ability in 3-year-olds.
引用
收藏
页码:1855 / 1880
页数:26
相关论文
共 43 条
[21]   Neural correlates of bimodal speech and gesture comprehension [J].
Kelly, SD ;
Kravitz, C ;
Hopkins, M .
BRAIN AND LANGUAGE, 2004, 89 (01) :253-260
[22]  
Kelly SD, 2001, J CHILD LANG, V28, P325
[23]   The processing of speech, gesture, and action during language comprehension [J].
Kelly, Spencer ;
Healey, Meghan ;
Oezyuerek, Asli ;
Holler, Judith .
PSYCHONOMIC BULLETIN & REVIEW, 2015, 22 (02) :517-523
[24]   Two Sides of the Same Coin: Speech and Gesture Mutually Interact to Enhance Comprehension [J].
Kelly, Spencer D. ;
Ozyurek, Asli ;
Maris, Eric .
PSYCHOLOGICAL SCIENCE, 2010, 21 (02) :260-267
[25]   Relational language and the development of relational mapping [J].
Loewenstein, J ;
Gentner, D .
COGNITIVE PSYCHOLOGY, 2005, 50 (04) :315-353
[26]   Gesture as a support for word learning: The case of under [J].
McGregor, Karla K. ;
Rohlfing, Katharina J. ;
Bean, Allison ;
Marschner, Ellen .
JOURNAL OF CHILD LANGUAGE, 2009, 36 (04) :807-828
[27]   Imitation of causally opaque versus causally transparent tool use by 3-and 5-year-old children [J].
McGuigan, Nicola ;
Whiten, Andrew ;
Flynn, Emma ;
Horner, Victoria .
COGNITIVE DEVELOPMENT, 2007, 22 (03) :353-364
[28]   The role of gesture in children's comprehension of spoken language: Now they need it, now they don't [J].
McNeil, NM ;
Alibali, MW ;
Evans, JL .
JOURNAL OF NONVERBAL BEHAVIOR, 2000, 24 (02) :131-150
[29]   COMPREHENSION AND PRODUCTION OF GESTURE IN COMBINATION WITH SPEECH IN ONE-WORD SPEAKERS [J].
MORFORD, M ;
GOLDINMEADOW, S .
JOURNAL OF CHILD LANGUAGE, 1992, 19 (03) :559-580
[30]   Children Use Gesture to Interpret Novel Verb Meanings [J].
Mumford, Katherine H. ;
Kita, Sotaro .
CHILD DEVELOPMENT, 2014, 85 (03) :1181-1189