Turning a blind eye to the lexicon: ERPs show no cross-talk between lip-read and lexical context during speech sound processing

被引:24
作者
Baart, Martijn [1 ]
Samuel, Arthur G. [1 ,2 ,3 ]
机构
[1] Basque Ctr Cognit Brain & Language, BCBL, Donostia San Sebastian 20009, San Sebastian, Spain
[2] Basque Fdn Sci, Ikerbasque, Bilbao, Spain
[3] SUNY Stony Brook, Dept Psychol, Stony Brook, NY 11794 USA
关键词
ERPs; N200-effect; P2; Lexical processing; Audiovisual speech integration; SPOKEN-WORD RECOGNITION; SELECTIVE ADAPTATION; VISUAL SPEECH; MISMATCH NEGATIVITY; AUDITORY SPEECH; ELECTROPHYSIOLOGICAL EVIDENCE; MULTISENSORY INTERACTIONS; PHONETIC RECALIBRATION; LIPREAD SPEECH; PERCEPTION;
D O I
10.1016/j.jml.2015.06.008
中图分类号
H0 [语言学];
学科分类号
030303 ; 0501 ; 050102 ;
摘要
Electrophysiological research has shown that pseudowords elicit more negative Event-Related Potentials (i.e., ERPs) than words within 250 ms after the lexical status of a speech token is defined (e.g., after hearing the onset of "ga" in the Spanish word "lechuga", versus "da" in the pseudoword "lechuda"). Since lip-read context also affects speech sound processing within this time frame, we investigated whether these two context effects on speech perception operate together. We measured ERPs while listeners were presented with auditory-only, audiovisual, or lip-read-only stimuli, in which the critical syllable that determined lexical status was naturally-timed (Experiment 1) or delayed by similar to 800 ms (Experiment 2). We replicated the electrophysiological effect of stimulus lexicality, and also observed substantial effects of audiovisual speech integration for words and pseudowords. Critically, we found several early time-windows (<400 ms) in which both contexts influenced auditory processes, but we never observed any cross-talk between the two types of speech context. The absence of any interaction between the two types of speech context supports the view that lip-read and lexical context mainly function separately, and may have different neural bases and purposes. (C) 2015 Elsevier Inc. All rights reserved.
引用
收藏
页码:42 / 59
页数:18
相关论文
共 77 条
[1]   Effect of attentional load on audiovisual speech perception: evidence from ERPs [J].
Alsius, Agnes ;
Moettoenen, Riikka ;
Sams, Mikko E. ;
Soto-Faraco, Salvador ;
Tiippana, Kaisa .
FRONTIERS IN PSYCHOLOGY, 2014, 5
[2]  
[Anonymous], 33 ANN C COGN SCI SO
[3]   Early processing of auditory lexical predictions revealed by ERPs [J].
Baart, Martijn ;
Samuel, Arthur G. .
NEUROSCIENCE LETTERS, 2015, 585 :98-102
[4]   Electrophysiological evidence for speech-specific audiovisual integration [J].
Baart, Martijn ;
Stekelenburg, Jeroen J. ;
Vroomen, Jean .
NEUROPSYCHOLOGIA, 2014, 53 :115-121
[5]   Lipread-induced phonetic recalibration in dyslexia [J].
Baart, Martijn ;
de Boer-Schellekens, Liselotte ;
Vroomen, Jean .
ACTA PSYCHOLOGICA, 2012, 140 (01) :91-95
[6]   Phonetic recalibration does not depend on working memory [J].
Baart, Martijn ;
Vroomen, Jean .
EXPERIMENTAL BRAIN RESEARCH, 2010, 203 (03) :575-582
[7]   When \b\ill with \g\ill becomes \d\ill:: Evidence for a lexical effect in audiovisual speech perception [J].
Barutchu, Ayla ;
Crewther, Sheila G. ;
Kiely, Patricia ;
Murphy, Melanie J. ;
Crewther, David P. .
EUROPEAN JOURNAL OF COGNITIVE PSYCHOLOGY, 2008, 20 (01) :1-11
[8]   Visual recalibration of auditory speech identification: A McGurk aftereffect [J].
Bertelson, P ;
Vroomen, J ;
de Gelder, B .
PSYCHOLOGICAL SCIENCE, 2003, 14 (06) :592-597
[9]   Bimodal speech: early suppressive visual effects in human auditory cortex [J].
Besle, J ;
Fort, A ;
Delpuech, C ;
Giard, MH .
EUROPEAN JOURNAL OF NEUROSCIENCE, 2004, 20 (08) :2225-2234
[10]  
Besle J., 2004, Cogn Process, V5, P189, DOI DOI 10.1007/S10339-004-0026-Y