Behavioural evidence for separate mechanisms of audiovisual temporal binding as a function of leading sensory modality

被引:25
作者
Cecere, Roberto [1 ]
Gross, Joachim [1 ]
Thut, Gregor [1 ]
机构
[1] Univ Glasgow, Inst Neurosci & Psychol, Ctr Cognit Neuroimaging CCNi, 58 Hillhead St, Glasgow G12 8QB, Lanark, Scotland
基金
英国惠康基金;
关键词
multisensory integration; simultaneity judgments; temporal binding window; temporal processing; VISUAL-CORTEX; MULTISENSORY INTERACTION; SPEECH-PERCEPTION; PHASE RESET; INTEGRATION; WINDOW; RECALIBRATION; OSCILLATIONS; PERFORMANCE; ACTIVATION;
D O I
10.1111/ejn.13242
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
The ability to integrate auditory and visual information is critical for effective perception and interaction with the environment, and is thought to be abnormal in some clinical populations. Several studies have investigated the time window over which audiovisual events are integrated, also called the temporal binding window, and revealed asymmetries depending on the order of audiovisual input (i.e. the leading sense). When judging audiovisual simultaneity, the binding window appears narrower and non-malleable for auditory-leading stimulus pairs and wider and trainable for visual-leading pairs. Here we specifically examined the level of independence of binding mechanisms when auditory-before-visual vs. visual-before-auditory input is bound. Three groups of healthy participants practiced audiovisual simultaneity detection with feedback, selectively training on auditory-leading stimulus pairs (group1), visual-leading stimulus pairs (group2) or both (group3). Subsequently, we tested for learning transfer (crossover) from trained stimulus pairs to non-trained pairs with opposite audiovisual input. Our data confirmed the known asymmetry in size and trainability for auditory-visual vs. visual-auditory binding windows. More importantly, practicing one type of audiovisual integration (e.g. auditory-visual) did not affect the other type (e.g. visual-auditory), even if trainable by within-condition practice. Together, these results provide crucial evidence that audiovisual temporal binding for auditory-leading vs. visual-leading stimulus pairs are independent, possibly tapping into different circuits for audiovisual integration due to engagement of different multisensory sampling mechanisms depending on leading sense. Our results have implications for informing the study of multisensory interactions in healthy participants and clinical populations with dysfunctional multisensory integration.
引用
收藏
页码:1561 / 1568
页数:8
相关论文
共 44 条
  • [1] Cortical oscillations and sensory predictions
    Arnal, Luc H.
    Giraud, Anne-Lise
    [J]. TRENDS IN COGNITIVE SCIENCES, 2012, 16 (07) : 390 - 398
  • [2] Visual Activation and Audiovisual Interactions in the Auditory Cortex during Speech Perception: Intracranial Recordings in Humans
    Besle, Julien
    Fischer, Catherine
    Bidet-Caulet, Aurelie
    Lecaignard, Francoise
    Bertrand, Olivier
    Giard, Marie-Helene
    [J]. JOURNAL OF NEUROSCIENCE, 2008, 28 (52) : 14301 - 14310
  • [3] Crossmodal enhancement of visual orientation discrimination by looming sounds requires functional activation of primary visual areas: A case study
    Cecere, Roberto
    Romei, Vincenzo
    Bertini, Caterina
    Ladavas, Elisabetta
    [J]. NEUROPSYCHOLOGIA, 2014, 56 : 350 - 358
  • [4] The Natural Statistics of Audiovisual Speech
    Chandrasekaran, Chandramouli
    Trubanova, Andrea
    Stillittano, Sebastien
    Caplier, Alice
    Ghazanfar, Asif A.
    [J]. PLOS COMPUTATIONAL BIOLOGY, 2009, 5 (07)
  • [5] Multisensory interaction in saccadic reaction time: A time-window-of-integration model
    Colonius, H
    Diederich, A
    [J]. JOURNAL OF COGNITIVE NEUROSCIENCE, 2004, 16 (06) : 1000 - 1009
  • [6] Auditory-visual speech perception and synchrony detection for speech and nonspeech signals
    Conrey, B
    Pisoni, DB
    [J]. JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2006, 119 (06) : 4065 - 4073
  • [7] THE DETECTION OF AUDITORY VISUAL DESYNCHRONY
    DIXON, NF
    SPITZ, L
    [J]. PERCEPTION, 1980, 9 (06) : 719 - 721
  • [8] An extended multisensory temporal binding window in autism spectrum disorders
    Foss-Feig, Jennifer H.
    Kwakye, Leslie D.
    Cascio, Carissa J.
    Burnette, Courtney P.
    Kadivar, Haleh
    Stone, Wendy L.
    Wallace, Mark T.
    [J]. EXPERIMENTAL BRAIN RESEARCH, 2010, 203 (02) : 381 - 389
  • [9] Recalibration of audiovisual simultaneity
    Fujisaki, W
    Shimojo, S
    Kashino, M
    Nishida, S
    [J]. NATURE NEUROSCIENCE, 2004, 7 (07) : 773 - 778
  • [10] ON THE NATURE OF INTERSENSORY FACILITATION OF REACTION-TIME
    GIELEN, SCAM
    SCHMIDT, RA
    VANDENHEUVEL, PJM
    [J]. PERCEPTION & PSYCHOPHYSICS, 1983, 34 (02): : 161 - 168