Supramodal processing optimizes visual perceptual learning and plasticity

被引:26
作者
Zilber, Nicolas [1 ,2 ]
Ciuciu, Philippe [1 ,2 ]
Gramfort, Alexandre [1 ,2 ,3 ]
Azizi, Leila [1 ,4 ,5 ]
van Wassenhove, Virginie [1 ,4 ,5 ]
机构
[1] CEA, DSV I2BM, NeuroSpin Ctr, F-91191 Gif Sur Yvette, France
[2] INRIA, Parietal Team, Saclay, France
[3] Telecom ParisTech, Inst Mines Telecom, CNRS LTCI, F-75014 Paris, France
[4] INSERM, Cognit Neuroimaging Unit, U992, F-91191 Gif Sur Yvette, France
[5] Univ Paris 11, Cognit Neuroimaging Unit, F-91191 Gif Sur Yvette, France
关键词
MEG; Multisensory; Audition; Coherence; Dual-stream; Sensory substitution device; SUPERIOR TEMPORAL SULCUS; CROSS-MODAL PLASTICITY; SURFACE-BASED ANALYSIS; SENSORY SUBSTITUTION; AUDITORY MOTION; MULTISENSORY CONVERGENCE; AUDIOVISUAL INTEGRATION; SUBJECTIVE MEASURES; EEG-DATA; BRAIN;
D O I
10.1016/j.neuroimage.2014.02.017
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Multisensory interactions are ubiquitous in cortex and it has been suggested that sensory cortices may be supramodal i.e. capable of functional selectivity irrespective of the sensory modality of inputs (Pascual-Leone and Hamilton, 2001; Renier et al., 2013; Ricciardi and Pietrini, 2011; Voss and Zatorre, 2012). Here, we asked whether learning to discriminate visual coherence could benefit from supramodal processing. To this end, three groups of participants were briefly trained to discriminate which of a red or green intermixed population of random-dot-kinematograms (RDKs) was most coherent in a visual display while being recorded with magnetoencephalography (MEG). During training, participants heard no sound (V), congruent acoustic textures (AV) or auditory noise (AVn); importantly, congruent acoustic textures shared the temporal statistics - i.e. coherence - of visual RDKs. After training, the AV group significantly outperformed participants trained in V and AVn although they were not aware of their progress. In pre- and post-training blocks, all participants were tested without sound and with the same set of RDKs. When contrasting MEG data collected in these experimental blocks, selective differences were observed in the dynamic pattern and the cortical lad responsive to visual RDKs. First and common to all three groups, vlPFC showed selectivity to the learned coherence levels whereas selectivity in visual motion area hMT+ was only seen for the AV group. Second and solely for the AV group, activity in multisensory cortices (mSTS, pSTS) correlated with post-training performances; additionally, the latencies of these effects suggested feedback from v1PFC to hMT+ possibly mediated by temporal cortices in AV and AVn groups. Altogether, we interpret our results in the context of the Reverse Hierarchy Theory of learning (Ahissar and Hochstein, 2004) in which supramodal processing optimizes visual perceptual learning by capitalizing on sensory-invariant representations here, global coherence levels across sensory modalities. (C) 2014 Elsevier Inc. All rights reserved.
引用
收藏
页码:32 / 46
页数:15
相关论文
共 116 条
  • [1] Task difficulty and the specificity of perceptual learning
    Ahissar, M
    Hochstein, S
    [J]. NATURE, 1997, 387 (6631) : 401 - 406
  • [2] The reverse hierarchy theory of visual perceptual learning
    Ahissar, M
    Hochstein, S
    [J]. TRENDS IN COGNITIVE SCIENCES, 2004, 8 (10) : 457 - 464
  • [3] Spatiotemporal activity of a cortical network for processing visual motion revealed by MEG and fMRI
    Ahlfors, SP
    Simpson, GV
    Dale, AM
    Belliveau, JW
    Liu, AK
    Korvenoja, A
    Virtanen, J
    Huotilainen, M
    Tootell, RBH
    Aronen, HJ
    Ilmoniemi, RJ
    [J]. JOURNAL OF NEUROPHYSIOLOGY, 1999, 82 (05) : 2545 - 2555
  • [4] No direction-specific bimodal facilitation for audiovisual motion detection
    Alais, D
    Burr, D
    [J]. COGNITIVE BRAIN RESEARCH, 2004, 19 (02): : 185 - 194
  • [5] Capture of auditory motion by vision is represented by an activation shift from auditory to visual motion cortex
    Alink, Arjen
    Singer, Wolf
    Muckli, Lars
    [J]. JOURNAL OF NEUROSCIENCE, 2008, 28 (11) : 2690 - 2697
  • [6] Estimation of the timing of human visual perception from magnetoencephalography
    Amano, K
    Goda, N
    Nishida, S
    Ejima, Y
    Takeda, T
    Ohtani, Y
    [J]. JOURNAL OF NEUROSCIENCE, 2006, 26 (15) : 3981 - 3991
  • [7] Shape conveyed by visual-to-auditory sensory substitution activates the lateral occipital complex
    Amedi, Amir
    Stern, William M.
    Camprodon, Joan A.
    Bermpohl, Felix
    Merabet, Lotfi
    Rotman, Stephen
    Hemond, Christopher
    Meijer, Peter
    Pascual-Leone, Alvaro
    [J]. NATURE NEUROSCIENCE, 2007, 10 (06) : 687 - 689
  • [8] Neuromagnetic correlates of visual motion coherence
    Aspell, JE
    Tanskanen, T
    Hurlbert, AC
    [J]. EUROPEAN JOURNAL OF NEUROSCIENCE, 2005, 22 (11) : 2937 - 2945
  • [9] Sensory substitution and the human-machine interface
    Bach-y-Rita, P
    Kercel, SW
    [J]. TRENDS IN COGNITIVE SCIENCES, 2003, 7 (12) : 541 - 546
  • [10] I see where you're hearing: how cross-modal plasticity may exploit homologous brain structures
    Bavelier, Daphne
    Hirshorn, Elizabeth A.
    [J]. NATURE NEUROSCIENCE, 2010, 13 (11) : 1309 - 1311