Audio-visual speech perception: a developmental ERP investigation

被引:52
作者
Knowland, Victoria C. P. [1 ,2 ]
Mercure, Evelyne [3 ]
Karmiloff-Smith, Annette [2 ]
Dick, Fred [2 ]
Thomas, Michael S. C. [2 ]
机构
[1] City Univ London, Sch Hlth Sci, London EC1V 0HB, England
[2] Univ London Birkbeck Coll, Dept Psychol Sci, London WC1E 7HX, England
[3] UCL, Inst Cognit Neurosci, London, England
基金
英国医学研究理事会;
关键词
SUPERIOR TEMPORAL SULCUS; AUDITORY-EVOKED-POTENTIALS; EVENT-RELATED POTENTIALS; VISUAL SPEECH; MULTISENSORY INTEGRATION; TALKING FACES; HUMAN BRAIN; INFORMATION; ACTIVATION; MATURATION;
D O I
10.1111/desc.12098
中图分类号
B844 [发展心理学(人类心理学)];
学科分类号
040202 ;
摘要
Being able to see a talking face confers a considerable advantage for speech perception in adulthood. However, behavioural data currently suggest that children fail to make full use of these available visual speech cues until age 8 or 9. This is particularly surprising given the potential utility of multiple informational cues during language learning. We therefore explored this at the neural level. The event-related potential (ERP) technique has been used to assess the mechanisms of audio-visual speech perception in adults, with visual cues reliably modulating auditory ERP responses to speech. Previous work has shown congruence-dependent shortening of auditory N1/P2 latency and congruence-independent attenuation of amplitude in the presence of auditory and visual speech signals, compared to auditory alone. The aim of this study was to chart the development of these well-established modulatory effects over mid-to-late childhood. Experiment 1 employed an adult sample to validate a child-friendly stimulus set and paradigm by replicating previously observed effects of N1/P2 amplitude and latency modulation by visual speech cues; it also revealed greater attenuation of component amplitude given incongruent audio-visual stimuli, pointing to a new interpretation of the amplitude modulation effect. Experiment 2 used the same paradigm to map cross-sectional developmental change in these ERP responses between 6 and 11years of age. The effect of amplitude modulation by visual cues emerged over development, while the effect of latency modulation was stable over the child sample. These data suggest that auditory ERP modulation by visual speech represents separable underlying cognitive processes, some of which show earlier maturation than others over the course of development.
引用
收藏
页码:110 / 124
页数:15
相关论文
共 75 条
[41]   Brain development in children and adolescents: Insights from anatomical magnetic resonance imaging [J].
Lenroot, Rhoshel K. ;
Giedd, Jay N. .
NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS, 2006, 30 (06) :718-729
[42]   Infants deploy selective attention to the mouth of a talking face when learning speech [J].
Lewkowicz, David J. ;
Hansen-Tift, Amy M. .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2012, 109 (05) :1431-1436
[43]   Specialization along the Left Superior Temporal Sulcus for Auditory Categorization [J].
Liebenthal, Einat ;
Desai, Rutvik ;
Ellingson, Michael M. ;
Ramachandran, Brinda ;
Desai, Anjali ;
Binder, Jeffrey R. .
CEREBRAL CORTEX, 2010, 20 (12) :2958-2970
[44]   Differential maturation of brain signal complexity in the human auditory and visual system [J].
Lippe, Sarah ;
Kovacevic, Natasa ;
McIntosh, Anthony Randal .
FRONTIERS IN HUMAN NEUROSCIENCE, 2009, 3
[45]   AUDITORY EVENT-RELATED POTENTIALS IN WELL-CHARACTERIZED GROUPS OF CHILDREN [J].
MARTIN, L ;
BARAJAS, JJ ;
FERNANDEZ, R ;
TORRES, E .
ELECTROENCEPHALOGRAPHY AND CLINICAL NEUROPHYSIOLOGY, 1988, 71 (05) :375-381
[46]   DEVELOPMENTAL-CHANGES IN VISUAL AND AUDITORY CONTRIBUTIONS TO SPEECH-PERCEPTION [J].
MASSARO, DW ;
THOMPSON, LA ;
BARRON, B ;
LAREN, E .
JOURNAL OF EXPERIMENTAL CHILD PSYCHOLOGY, 1986, 41 (01) :93-113
[47]   HEARING LIPS AND SEEING VOICES [J].
MCGURK, H ;
MACDONALD, J .
NATURE, 1976, 264 (5588) :746-748
[48]   Maturation of human auditory cortex: Implications for speech perception [J].
Moore, JK .
ANNALS OF OTOLOGY RHINOLOGY AND LARYNGOLOGY, 2002, 111 (05) :7-10
[49]   Seeing speech affects acoustic information processing in the human brainstem [J].
Musacchia, G ;
Sams, M ;
Nicol, T ;
Kraus, N .
EXPERIMENTAL BRAIN RESEARCH, 2006, 168 (1-2) :1-10
[50]   Neural Correlates of Interindividual Differences in Children's Audiovisual Speech Perception [J].
Nath, Audrey R. ;
Fava, Eswen E. ;
Beauchamp, Michael S. .
JOURNAL OF NEUROSCIENCE, 2011, 31 (39) :13963-13971