Children benefit from gestures to understand degraded speech but to a lesser extent than adults

被引:0
|
作者
Sekine, Kazuki [1 ]
Ozyurek, Asli [2 ,3 ,4 ]
机构
[1] Waseda Univ, Fac Human Sci, Tokorozawa, Japan
[2] Radboud Univ Nijmegen, Ctr Language Studies, Nijmegen, Netherlands
[3] Max Planck Inst Psycholinguist, Nijmegen, Netherlands
[4] Radboud Univ Nijmegen, Donders Inst Brain Cognit & Behav, Nijmegen, Netherlands
来源
FRONTIERS IN PSYCHOLOGY | 2024年 / 14卷
基金
欧盟地平线“2020”;
关键词
co-speech gestures; degraded speech; primary school children; multimodal integration; speech comprehension; ICONIC GESTURES; RECOGNITION; INTEGRATION; INFORMATION; COMMUNICATION; HEARING; HAND;
D O I
10.3389/fpsyg.2023.1305562
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
The present study investigated to what extent children, compared to adults, benefit from gestures to disambiguate degraded speech by manipulating speech signals and manual modality. Dutch-speaking adults (N = 20) and 6- and 7-year-old children (N = 15) were presented with a series of video clips in which an actor produced a Dutch action verb with or without an accompanying iconic gesture. Participants were then asked to repeat what they had heard. The speech signal was either clear or altered into 4- or 8-band noise-vocoded speech. Children had more difficulty than adults in disambiguating degraded speech in the speech-only condition. However, when presented with both speech and gestures, children reached a comparable level of accuracy to that of adults in the degraded-speech-only condition. Furthermore, for adults, the enhancement of gestures was greater in the 4-band condition than in the 8-band condition, whereas children showed the opposite pattern. Gestures help children to disambiguate degraded speech, but children need more phonological information than adults to benefit from use of gestures. Children's multimodal language integration needs to further develop to adapt flexibly to challenging situations such as degraded speech, as tested in our study, or instances where speech is heard with environmental noise or through a face mask.
引用
收藏
页数:10
相关论文
共 13 条
  • [1] Non-native Listeners Benefit Less from Gestures and Visible Speech than Native Listeners During Degraded Speech Comprehension
    Drijvers, Linda
    Ozyurek, Asli
    LANGUAGE AND SPEECH, 2020, 63 (02) : 209 - 220
  • [2] How early do children understand gesture-speech combinations with iconic gestures?
    Stanfield, Carmen
    Williamson, Rebecca
    Ozcaliskan, Seyda
    JOURNAL OF CHILD LANGUAGE, 2014, 41 (02) : 462 - 471
  • [3] Sign advantage: Both children and adults' spatial expressions in sign are more informative than those in speech and gestures combined
    Karadoller, Dilay Z.
    Sumer, Beyza
    Unal, Ercenur
    Ozyurek, Asli
    JOURNAL OF CHILD LANGUAGE, 2024, 51 (04) : 876 - 902
  • [4] Evidence for children's online integration of simultaneous information from speech and iconic gestures: an ERP study
    Sekine, Kazuki
    Schoechl, Christina
    Mulder, Kimberley
    Holler, Judith
    Kelly, Spencer
    Furman, Reyhan
    Ozyurek, Asli
    LANGUAGE COGNITION AND NEUROSCIENCE, 2020, 35 (10) : 1283 - 1294
  • [5] Aging and working memory modulate the ability to benefit from visible speech and iconic gestures during speech-in-noise comprehension
    Schubotz, Louise
    Holler, Judith
    Drijvers, Linda
    ozyurek, Asli
    PSYCHOLOGICAL RESEARCH-PSYCHOLOGISCHE FORSCHUNG, 2021, 85 (05): : 1997 - 2011
  • [6] Gesture-speech integration in narrative Are children less redundant than adults?
    Alibali, Martha W.
    Evans, Julia L.
    Hostetter, Autumn B.
    Ryan, Kristin
    Mainela-Arnold, Elina
    GESTURE, 2009, 9 (03) : 290 - 311
  • [7] The role of gestures in the transition from one- to two-word speech in a variety of children with intellectual disabilities
    Vandereet, Joke
    Maes, Bea
    Lembrechts, Dirk
    Zink, Inge
    INTERNATIONAL JOURNAL OF LANGUAGE & COMMUNICATION DISORDERS, 2011, 46 (06) : 714 - 727
  • [8] Does it take older adults longer than younger adults to perceptually segregate a speech target from a background masker?
    Ben-David, Boaz M.
    Tse, Vania Y. Y.
    Schneider, Bruce A.
    HEARING RESEARCH, 2012, 290 (1-2) : 55 - 63
  • [9] Prelingually Deaf Children With Cochlear Implants Show Better Perception of Voice Cues and Speech in Competing Speech Than Postlingually Deaf Adults With Cochlear Implants
    Nagels, Leanne
    Gaudrain, Etienne
    Vickers, Deborah
    Hendriks, Petra
    Baskent, Deniz
    EAR AND HEARING, 2024, 45 (04) : 952 - 968
  • [10] Children with dyslexia show a reduced processing benefit from bimodal speech information compared to their typically developing peers
    Schaadt, Gesa
    van der Meer, Elke
    Pannekamp, Ann
    Oberecker, Regine
    Maennel, Claudia
    NEUROPSYCHOLOGIA, 2019, 126 : 147 - 158