Audio-visual speech perception in adult readers with dyslexia: an fMRI study

被引:25
|
作者
Ruesseler, Jascha [1 ]
Ye, Zheng [2 ]
Gerth, Ivonne [3 ]
Szycik, Gregor R. [4 ]
Muente, Thomas F. [5 ,6 ]
机构
[1] Otto Friedrich Univ Bamberg, Dept Psychol, Bamberg, Germany
[2] Chinese Acad Sci, Inst Psychol, Beijing, Peoples R China
[3] Klinikum Magdeburg, Neurol, Magdeburg, Germany
[4] Hannover Med Sch, Dept Psychiat, Hannover, Germany
[5] Univ Lubeck, Dept Neurol, Ratzeburger Allee 160, D-23562 Lubeck, Germany
[6] Univ Lubeck, Inst Psychol 2, Lubeck, Germany
关键词
Developmental dyslexia; Audio-visual processing; Event-related fMRI; Independent component analysis; INDEPENDENT COMPONENT ANALYSIS; AUDITORY-VISUAL SPEECH; MULTISENSORY INTEGRATION; DEVELOPMENTAL DYSLEXIA; READING-DISABILITY; HEARING LIPS; NEURAL BASIS; SCHIZOPHRENIA; BRAIN; NETWORKS;
D O I
10.1007/s11682-017-9694-y
中图分类号
R445 [影像诊断学];
学科分类号
100207 ;
摘要
Developmental dyslexia is a specific deficit in reading and spelling that often persists into adulthood. In the present study, we used slow event-related fMRI and independent component analysis to identify brain networks involved in perception of audio-visual speech in a group of adult readers with dyslexia (RD) and a group of fluent readers (FR). Participants saw a video of a female speaker saying a disyllabic word. In the congruent condition, audio and video input were identical whereas in the incongruent condition, the two inputs differed. Participants had to respond to occasionally occurring animal names. The independent components analysis (ICA) identified several components that were differently modulated in FR and RD. Two of these components including fusiform gyrus and occipital gyrus showed less activation in RD compared to FR possibly indicating a deficit to extract face information that is needed to integrate auditory and visual information in natural speech perception. A further component centered on the superior temporal sulcus (STS) also exhibited less activation in RD compared to FR. This finding is corroborated in the univariate analysis that shows less activation in STS for RD compared to FR. These findings suggest a general impairment in recruitment of audiovisual processing areas in dyslexia during the perception of natural speech.
引用
收藏
页码:357 / 368
页数:12
相关论文
共 50 条
  • [31] Audio-Visual Speech and Gesture Recognition by Sensors of Mobile Devices
    Ryumin, Dmitry
    Ivanko, Denis
    Ryumina, Elena
    SENSORS, 2023, 23 (04)
  • [32] Cross-cultural (A)symmetries in Audio-visual Attitude Perception
    Mixdorff, Hansjoerg
    Rilliard, Albert
    Lee, Tan
    Ma, Matthew K. H.
    Hoenemann, Angelika
    19TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2018), VOLS 1-6: SPEECH RESEARCH FOR EMERGING MARKETS IN MULTILINGUAL SOCIETIES, 2018, : 426 - 430
  • [33] Perceptual congruency of audio-visual speech affects ventriloquism with bilateral visual stimuli
    Shoko Kanaya
    Kazuhiko Yokosawa
    Psychonomic Bulletin & Review, 2011, 18 : 123 - 128
  • [34] Perceptual congruency of audio-visual speech affects ventriloquism with bilateral visual stimuli
    Kanaya, Shoko
    Yokosawa, Kazuhiko
    PSYCHONOMIC BULLETIN & REVIEW, 2011, 18 (01) : 123 - 128
  • [35] Functional correlates of the speech-in-noise perception impairment in dyslexia: An MRI study
    Dole, Marjorie
    Meunier, Fanny
    Hoen, Michel
    NEUROPSYCHOLOGIA, 2014, 60 : 103 - 114
  • [36] Allophonic mode of speech perception in Dutch children at risk for dyslexia: A longitudinal study
    Noordenbos, M. W.
    Segers, E.
    Serniclaes, W.
    Mitterer, H.
    Verhoeven, L.
    RESEARCH IN DEVELOPMENTAL DISABILITIES, 2012, 33 (05) : 1469 - 1483
  • [37] Weighted RSA: An Improved Framework on the Perception of Audio-visual Affective Speech in Left Insula and Superior Temporal Gyrus
    Xu, Junhai
    Dong, Haibin
    Li, Na
    Wang, Zeyu
    Guo, Fei
    Wei, Jianguo
    Dang, Jianwu
    NEUROSCIENCE, 2021, 469 : 46 - 58
  • [38] Effects of audio-visual integration on the detection of masked speech and non-speech sounds
    Eramudugolla, Ranmalee
    Henderson, Rachel
    Mattingley, Jason B.
    BRAIN AND COGNITION, 2011, 75 (01) : 60 - 66
  • [39] Visual motion processing in Chinese children with developmental dyslexia: An fMRI study
    Liu, Yu-Fei
    Qian, Yi
    Bi, Hong-Yan
    DYSLEXIA, 2022, 28 (04) : 431 - 447
  • [40] Video-realistic expressive audio-visual speech synthesis for the Greek language
    Filntisis, Panagiotis Paraskevas
    Katsamanis, Athanasios
    Tsiakoulis, Pirros
    Maragos, Petros
    SPEECH COMMUNICATION, 2017, 95 : 137 - 152