An implemented predictive coding model of lexico-semantic processing explains the dynamics of univariate and multivariate activity within the left ventromedial temporal lobe during reading comprehension

被引:0
作者
Wang, Lin [1 ,2 ,3 ]
Eddine, Samer Nour [3 ]
Brothers, Trevor [3 ,4 ]
Jensen, Ole [5 ,6 ]
Kuperberg, Gina R. [1 ,2 ,3 ]
机构
[1] Harvard Med Sch, Massachusetts Gen Hosp, Dept Psychiat, Charlestown, MA 02129 USA
[2] Harvard Med Sch, Massachusetts Gen Hosp, Athinoula A Martinos Ctr Biomed Imaging, Charlestown, MA 02129 USA
[3] Tufts Univ, Dept Psychol, Medford, MA 02155 USA
[4] North Carolina Agr & Tech State Univ, Greensboro, NC 27411 USA
[5] Univ Oxford, Dept Expt Psychol, Oxford OX2 6GG, England
[6] Univ Oxford, Oxford Ctr Human Brain Act, Wellcome Ctr Integrat Neuroimaging, Dept Psychiat, Oxford OX3 7JX, England
基金
美国国家卫生研究院;
关键词
Predictive coding; Language comprehension; Modeling; MEG; N400; RSA; BAYESIAN-INFERENCE; N400; ACTIVATION; REPRESENTATION; SIMILARITY; COMPONENT; WORDS; MEG; LOCALIZATION; INTEGRATION;
D O I
10.1016/j.neuroimage.2024.120977
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
During language comprehension, the larger neural response to unexpected versus expected inputs is often taken as evidence for predictive coding-a specific computational architecture and optimization algorithm proposed to approximate probabilistic inference in the brain. However, other predictive processing frameworks can also account for this effect, leaving the unique claims of predictive coding untested. In this study, we used MEG to examine both univariate and multivariate neural activity in response to expected and unexpected inputs during word-by-word reading comprehension. We further simulated this activity using an implemented predictive coding model that infers the meaning of words from their orthographic form. Consistent with previous findings, the univariate analysis showed that, between 300 and 500 ms, unexpected words produced a larger evoked response than expected words within a left ventromedial temporal region that supports the mapping of orthographic word-forms onto lexical and conceptual representations. Our model explained this larger evoked response as the enhanced lexico-semantic prediction error produced when prior top-down predictions failed to suppress activity within lexical and semantic "error units". Critically, our simulations showed that despite producing minimal prediction error, expected inputs nonetheless reinstated top-down predictions within the model's lexical and semantic "state" units. Two types of multivariate analyses provided evidence for this functional distinction between state and error units within the ventromedial temporal region. First, within each trial, the same individual voxels that produced a larger response to unexpected inputs between 300 and 500 ms produced unique temporal patterns to expected inputs that resembled the patterns produced within a pre- activation time window. Second, across trials, and again within the same 300-500 ms time window and left ventromedial temporal region, pairs of expected words produced spatial patterns that were more similar to one another than the spatial patterns produced by pairs of expected and unexpected words, regardless of specific item. Together, these findings provide compelling evidence that the left ventromedial temporal lobe employs predictive coding to infer the meaning of incoming words from their orthographic form during reading comprehension.
引用
收藏
页数:17
相关论文
共 93 条
[1]   With or without you: predictive coding and Bayesian inference in the brain [J].
Aitchison, Laurence ;
Lengyel, Mate .
CURRENT OPINION IN NEUROBIOLOGY, 2017, 46 :219-227
[2]   Canonical Microcircuits for Predictive Coding [J].
Bastos, Andre M. ;
Usrey, W. Martin ;
Adams, Rick A. ;
Mangun, George R. ;
Fries, Pascal ;
Friston, Karl J. .
NEURON, 2012, 76 (04) :695-711
[3]   The ''independent components'' of natural scenes are edge filters [J].
Bell, AJ ;
Sejnowski, TJ .
VISION RESEARCH, 1997, 37 (23) :3327-3338
[4]   Prediction Errors but Not Sharpened Signals Simulate Multivoxel fMRI Patterns during Speech Perception [J].
Blank, Helen ;
Davis, Matthew H. .
PLOS BIOLOGY, 2016, 14 (11)
[5]   Toward a Neurobiologically Plausible Model of Language-Related, Negative Event-Related Potentials [J].
Bornkessel-Schlesewsky, Ina ;
Schlesewsky, Matthias .
FRONTIERS IN PSYCHOLOGY, 2019, 10
[6]   A Neurocomputational Model of the N400 and the P600 in Language Processing [J].
Brouwer, Harm ;
Crocker, Matthew W. ;
Venhuizen, Noortje J. ;
Hoeks, John C. J. .
COGNITIVE SCIENCE, 2017, 41 :1318-1352
[7]   SUBTLEX-CH: Chinese Word and Character Frequencies Based on Film Subtitles [J].
Cai, Qing ;
Brysbaert, Marc .
PLOS ONE, 2010, 5 (06)
[8]  
Caramazza A., 1996, Nature, V380, P485, DOI [10.1038/380485a0, DOI 10.1038/380485A0]
[9]   Evidence of a predictive coding hierarchy in the human brain listening to speech [J].
Caucheteux, Charlotte ;
Gramfort, Alexandre ;
King, Jean-Remi .
NATURE HUMAN BEHAVIOUR, 2023, 7 (3) :430-441
[10]   Competition and cooperation among similar representations: Toward a unified account of facilitative and inhibitory effects of lexical neighbors (vol 119, pg 417, 2012) [J].
Chen, Qi ;
Mirman, Daniel .
PSYCHOLOGICAL REVIEW, 2012, 119 (04) :898-898