Audiovisual emotion perception develops differently from audiovisual phoneme perception during childhood

被引:2
|
作者
Yamamoto, Hisako W. [1 ,2 ]
Kawahara, Misako [1 ,2 ]
Tanaka, Akihiro [1 ]
机构
[1] Tokyo Womans Christian Univ, Suginami Ku, Tokyo, Japan
[2] Japan Soc Promot Sci, Chiyoda Ku, Tokyo, Japan
来源
PLOS ONE | 2020年 / 15卷 / 06期
关键词
VISUAL SPEECH; RECOGNITION; VOICE; FACE;
D O I
10.1371/journal.pone.0234553
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
This study investigated the developmental paths in the use of audiovisual information for the perception of emotions and phonemes by Japanese speakers. Children aged 5 to 12 years and adults aged 30 to 39 years engaged in an emotion perception task in which speakers expressed their emotions through their faces and voices, and a phoneme perception task using phonemic information in speakers' lip movements and speech sounds. Results indicated that Japanese children's judgement of emotions by using auditory information increased with increasing age, whereas the use of audiovisual information for judging phonemes remained constant with increasing age. Moreover, adults were affected by visual information more than children. We discuss whether these differences in developmental patterns are due to differential integration processes for information indicative of emotions and phonemes, as well as possible cultural / linguistic reasons for these differences.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] Audiovisual Speech Perception Benefits are Stable from Preschool through Adolescence
    Gijbels, Liesbeth
    Yeatman, Jason D.
    Lalonde, Kaylah
    Doering, Piper
    Lee, Adrian K. C.
    MULTISENSORY RESEARCH, 2024, 37 (4-5) : 317 - 340
  • [22] Effect of attentional load on audiovisual speech perception: evidence from ERPs
    Alsius, Agnes
    Moettoenen, Riikka
    Sams, Mikko E.
    Soto-Faraco, Salvador
    Tiippana, Kaisa
    FRONTIERS IN PSYCHOLOGY, 2014, 5
  • [23] The role of left inferior frontal cortex during audiovisual speech perception in infants
    Altvater-Mackensen, Nicole
    Grossmann, Tobias
    NEUROIMAGE, 2016, 133 : 14 - 20
  • [24] Brain activation during audiovisual exposure anticipates future perception of ambiguous speech
    Kilian-Hutten, Niclas
    Vroomen, Jean
    Formisano, Elia
    NEUROIMAGE, 2011, 57 (04) : 1601 - 1607
  • [25] Crossmodal and incremental perception of audiovisual cues to emotional speech
    Barkhuysen, Pashiera
    Krahmer, Emiel
    Swerts, Marc
    LANGUAGE AND SPEECH, 2010, 53 : 3 - 30
  • [26] On the tip of the tongue: Modulation of the primary motor cortex during audiovisual speech perception
    Sato, Marc
    Buccino, Giovanni
    Gentilucci, Maurizio
    Cattaneo, Luigi
    SPEECH COMMUNICATION, 2010, 52 (06) : 533 - 541
  • [27] Sources of Confusion in Infant Audiovisual Speech Perception Research
    Shaw, Kathleen E.
    Bortfeld, Heather
    FRONTIERS IN PSYCHOLOGY, 2015, 6
  • [28] Perception of the multisensory coherence of fluent audiovisual speech in infancy: Its emergence and the role of experience
    Lewkowicz, David J.
    Minar, Nicholas J.
    Tift, Amy H.
    Brandon, Melissa
    JOURNAL OF EXPERIMENTAL CHILD PSYCHOLOGY, 2015, 130 : 147 - 162
  • [29] The contribution of dynamic visual cues to audiovisual speech perception
    Jaekl, Philip
    Pesquita, Ana
    Alsius, Agnes
    Munhall, Kevin
    Soto-Faraco, Salvador
    NEUROPSYCHOLOGIA, 2015, 75 : 402 - 410
  • [30] Reassessing the Benefits of Audiovisual Integration to Speech Perception and Intelligibility
    O'Hanlon, Brandon
    Plack, Christopher J.
    Nuttall, Helen E.
    JOURNAL OF SPEECH LANGUAGE AND HEARING RESEARCH, 2025, 68 (01): : 26 - 39