Neural source dynamics of brain responses to continuous stimuli: Speech processing from acoustics to comprehension

被引:79
作者
Brodbeck, Christian [1 ]
Presacco, Alessandro [2 ]
Simon, Jonathan Z. [1 ,3 ,4 ]
机构
[1] Univ Maryland, Syst Res Inst, College Pk, MD 20742 USA
[2] Univ Calif Irvine, Dept Otolaryngol, Irvine, CA USA
[3] Univ Maryland, Dept Elect & Comp Engn, College Pk, MD 20742 USA
[4] Univ Maryland, Dept Biol, College Pk, MD 20742 USA
基金
美国国家卫生研究院;
关键词
Magnetoencephalography; Minimum norm estimate; Speech representation; Impulse response; Temporal response function; Reverse correlation; AUDITORY WORD RECOGNITION; CORTICAL REPRESENTATION; MOTOR CORTEX; TIME-COURSE; MEG; FREQUENCY; LOCALIZATION; EEG; ORGANIZATION; REGIONS;
D O I
10.1016/j.neuroimage.2018.01.042
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Human experience often involves continuous sensory information that unfolds over time. This is true in particular for speech comprehension, where continuous acoustic signals are processed over seconds or even minutes. We show that brain responses to such continuous stimuli can be investigated in detail, for magnetoencephalography (MEG) data, by combining linear kernel estimation with minimum norm source localization. Previous research has shown that the requirement to average data over many trials can be overcome by modeling the brain response as a linear convolution of the stimulus and a kernel, or response function, and estimating a kernel that predicts the response from the stimulus. However, such analysis has been typically restricted to sensor space. Here we demonstrate that this analysis can also be performed in neural source space. We first computed distributed minimum norm current source estimates for continuous MEG recordings, and then computed response functions for the current estimate at each source element, using the boosting algorithm with cross-validation. Permutation tests can then assess the significance of individual predictor variables, as well as features of the corresponding spatio-temporal response functions. We demonstrate the viability of this technique by computing spatio-temporal response functions for speech stimuli, using predictor variables reflecting acoustic, lexical and semantic processing. Results indicate that processes related to comprehension of continuous speech can be differentiated anatomically as well as temporally: acoustic information engaged auditory cortex at short latencies, followed by responses over the central sulcus and inferior frontal gyrus, possibly related to somatosensory/motor cortex involvement in speech perception; lexical frequency was associated with a left-lateralized response in auditory cortex and subsequent bilateral frontal activity; and semantic composition was associated with bilateral temporal and frontal brain activity. We conclude that this technique can be used to study the neural processing of continuous stimuli in time and anatomical space with the millisecond temporal resolution of MEG. This suggests new avenues for analyzing neural processing of naturalistic stimuli, without the necessity of averaging over artificially short or truncated stimuli.
引用
收藏
页码:162 / 174
页数:13
相关论文
共 71 条
  • [1] Speech comprehension is correlated with temporal response patterns recorded from auditory cortex
    Ahissar, E
    Nagarajan, S
    Ahissar, M
    Protopapas, A
    Mahncke, H
    Merzenich, MM
    [J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2001, 98 (23) : 13367 - 13372
  • [2] Dynamic Estimation of the Auditory Temporal Response Function From MEG in Competing-Speaker Environments
    Akram, Sahar
    Simon, Jonathan Z.
    Babadi, Behtash
    [J]. IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2017, 64 (08) : 1896 - 1905
  • [3] [Anonymous], BIORXIV
  • [4] [Anonymous], 2016, SPEECH PERCEPTION SP, DOI DOI 10.4324/9781315772110
  • [5] [Anonymous], GENTLE COMPUTER PROG
  • [6] [Anonymous], 1992, PRAAT DOING PHONETIC
  • [7] [Anonymous], EELBRAIN 0 25 ZENODO
  • [8] Frequency in lexical processing
    Baayen, R. Harald
    Milin, Petar
    Ramscar, Michael
    [J]. APHASIOLOGY, 2016, 30 (11) : 1174 - 1220
  • [9] Basic Linguistic Composition Recruits the Left Anterior Temporal Lobe and Left Angular Gyrus During Both Listening and Reading
    Bemis, D. K.
    Pylkkaenen, L.
    [J]. CEREBRAL CORTEX, 2013, 23 (08) : 1859 - 1873
  • [10] Simple Composition: A Magnetoencephalography Investigation into the Comprehension of Minimal Linguistic Phrases
    Bemis, Douglas K.
    Pylkkaenen, Liina
    [J]. JOURNAL OF NEUROSCIENCE, 2011, 31 (08) : 2801 - 2814