Semantic priming from McGurk words: Priming depends on perception

被引:1
作者
Dorsi, Josh [1 ,2 ]
Ostrand, Rachel [3 ]
Rosenblum, Lawrence D. [1 ]
机构
[1] Univ Calif Riverside, Dept Psychol, 900 Univ Ave, Riverside, CA 92521 USA
[2] Penn State Univ, Coll Med, State Coll, PA 16801 USA
[3] IBM Res, Yorktown Hts, NY USA
基金
美国国家科学基金会;
关键词
Multisensory processing; Semantic priming; VISUAL SPEECH; SELECTIVE ADAPTATION; AUDITORY-CORTEX; HEARING-LIPS; LEXICAL CONTEXT; INFORMATION; ACTIVATION; INTEGRATION; PLACE; TESTS;
D O I
10.3758/s13414-023-02689-2
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
The McGurk effect is an illusion in which visible articulations alter the perception of auditory speech (e.g., video 'da' dubbed with audio 'ba' may be heard as 'da'). To test the timing of the multisensory processes that underlie the McGurk effect, Ostrand et al. Cognition 151, 96-107, 2016 used incongruent stimuli, such as auditory 'bait' + visual 'date' as primes in a lexical decision task. These authors reported that the auditory word, but not the perceived (visual) word, induced semantic priming, suggesting that the auditory signal alone can provide the input for lexical access, before multisensory integration is complete. Here, we conceptually replicate the design of Ostrand et al. (2016), using different stimuli chosen to optimize the success of the McGurk illusion. In contrast to the results of Ostrand et al. (2016), we find that the perceived (i.e., visual) word of the incongruent stimulus usually induced semantic priming. We further find that the strength of this priming corresponded to the magnitude of the McGurk effect for each word combination. These findings suggest, in contrast to the findings of Ostrand et al. (2016), that lexical access makes use of integrated multisensory information which is perceived by the listener. These findings further suggest that which unimodal signal of a multisensory stimulus is used in lexical access is dependent on the perception of that stimulus.
引用
收藏
页码:1219 / 1237
页数:19
相关论文
共 54 条
[1]   Forty Years After Hearing Lips and Seeing Voices: the McGurk Effect Revisited [J].
Alsius, Agnes ;
Pare, Martin ;
Munhall, Kevin G. .
MULTISENSORY RESEARCH, 2018, 31 (1-2) :111-144
[2]   Bisensory augmentation: A speechreading advantage when speech is clearly audible and intact [J].
Arnold, P ;
Hill, F .
BRITISH JOURNAL OF PSYCHOLOGY, 2001, 92 :339-355
[3]   Turning a blind eye to the lexicon: ERPs show no cross-talk between lip-read and lexical context during speech sound processing [J].
Baart, Martijn ;
Samuel, Arthur G. .
JOURNAL OF MEMORY AND LANGUAGE, 2015, 85 :42-59
[4]   When \b\ill with \g\ill becomes \d\ill:: Evidence for a lexical effect in audiovisual speech perception [J].
Barutchu, Ayla ;
Crewther, Sheila G. ;
Kiely, Patricia ;
Murphy, Melanie J. ;
Crewther, David P. .
EUROPEAN JOURNAL OF COGNITIVE PSYCHOLOGY, 2008, 20 (01) :1-11
[5]   Variability and stability in the McGurk effect: contributions of participants, stimuli, time, and response type [J].
Basu Mallick, Debshila ;
Magnotti, John F. ;
Beauchamp, Michael S. .
PSYCHONOMIC BULLETIN & REVIEW, 2015, 22 (05) :1299-1307
[6]   The McGurk Effect in Children With Autism and Asperger Syndrome [J].
Bebko, James M. ;
Schroeder, Jessica H. ;
Weiss, Jonathan A. .
AUTISM RESEARCH, 2014, 7 (01) :50-59
[7]   Visual Activation and Audiovisual Interactions in the Auditory Cortex during Speech Perception: Intracranial Recordings in Humans [J].
Besle, Julien ;
Fischer, Catherine ;
Bidet-Caulet, Aurelie ;
Lecaignard, Francoise ;
Bertrand, Olivier ;
Giard, Marie-Helene .
JOURNAL OF NEUROSCIENCE, 2008, 28 (52) :14301-14310
[8]   Use of visual information in speech perception: Evidence for a visual rate effect both with and without a McGurk effect [J].
Brancazio, L ;
Miller, JL .
PERCEPTION & PSYCHOPHYSICS, 2005, 67 (05) :759-769
[9]   Lexical influences in audiovisual speech perception [J].
Brancazio, L .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-HUMAN PERCEPTION AND PERFORMANCE, 2004, 30 (03) :445-463
[10]   What accounts for individual differences in susceptibility to the McGurk effect? [J].
Brown, Violet A. ;
Hedayati, Maryam ;
Zanger, Annie ;
Mayn, Sasha ;
Ray, Lucia ;
Dillman-Hasso, Naseem ;
Strand, Julia F. .
PLOS ONE, 2018, 13 (11)