How meaning unfolds in neural time: Embodied reactivations can precede multimodal semantic effects during language processing

被引:42
作者
Garcia, Adolfo M. [1 ,2 ,3 ]
Moguilner, Sebastian [1 ,4 ,5 ,6 ,7 ]
Torquati, Kathya [1 ]
Garcia-Marco, Enrique [8 ,9 ]
Herrera, Eduar [10 ]
Munoz, Edinson [11 ]
Castillo, Eduardo M. [12 ]
Kleineschay, Tara [12 ]
Sedeno, Lucas [1 ,2 ]
Ibanez, Agustin [1 ,2 ,13 ,14 ,15 ]
机构
[1] Favaloro Univ, INECO Fdn, Inst Cognit & Translat Neurosci INCYT, Lab Expt Psychol & Neurosci LPEN, Pacheco Melo 1860,C1126AAB, Buenos Aires, DF, Argentina
[2] Consejo Nacl Invest Cient & Tecn, Natl Sci & Tech Res Council, Godoy Cruz 2290,C1425FQB, Buenos Aires, DF, Argentina
[3] Natl Univ Cuyo UNCuyo, Fac Educ, Sobremonte 74,M5500, Mendoza, Argentina
[4] Fdn Escuela Med Nucl FUESMEN, Garibaldi 405,M5500, Mendoza, Argentina
[5] CNEA, Garibaldi 405,M5500, Mendoza, Argentina
[6] Univ Nacl Cuyo UNCuyo, Inst Balseiro, Padre Jorge Contreras 1300,M5502 JMA, Mendoza, Argentina
[7] Univ Nacl Cuyo UNCuyo, Fac Ciencias Exactas & Nat, Padre Jorge Contreras 1300,M5502 JMA, Mendoza, Argentina
[8] Univ La Laguna, Inst Univ Neurociencia, Pabellon Gobierno,C Padre Herrera S-N, San Cristobal La Laguna 38200, Santa Cruz De T, Spain
[9] UNED, Paseo Senda Rey 7, E-28040 Madrid, Spain
[10] Univ Icesi, Dept Estudios Psicol, Cali, Colombia
[11] Univ Santiago Chile, Fac Humanidades, Dept Linguist & Literatura, Estn Cent, Av Alameda Libertador Bernardo OHiggins 3363, Santiago 9170022, Chile
[12] Florida Hosp Children, Magnetoencephalog Lab, 601 E Rollins St, Orlando, FL 32803 USA
[13] ARC, Ctr Excellence Cognit & Its Disorders, Sydney, NSW, Australia
[14] Univ Adolfo Ibanez, Sch Psychol, CSCN, Diagonal Las Torres 2640, Santiago 9170022, Region Metropol, Chile
[15] Univ Autonoma Caribe, Calle 90 46-112, Barranquilla 080020, Colombia
关键词
Embodied cognition; Multimodal semantics; Action verbs; Magnetoencephalography; Machine learning; ANTERIOR TEMPORAL-LOBE; DISTORTION-CORRECTED FMRI; PRIMARY MOTOR CORTEX; ACTION-WORDS; ACTION VERBS; SPATIOTEMPORAL DYNAMICS; BRAIN MECHANISMS; MEG; SYSTEM; REPRESENTATIONS;
D O I
10.1016/j.neuroimage.2019.05.002
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Research on how the brain construes meaning during language use has prompted two conflicting accounts. According to the 'grounded view', word understanding involves quick reactivations of sensorimotor (embodied) experiences evoked by the stimuli, with simultaneous or later engagement of multimodal (conceptual) systems integrating information from various sensory streams. Contrariwise, for the 'symbolic view', this capacity depends crucially on multimodal operations, with embodied systems playing epiphenomenal roles after comprehension. To test these contradictory hypotheses, the present magnetoencephalography study assessed implicit semantic access to grammatically constrained action and non-action verbs (n =100 per category) while measuring spatiotemporally precise signals from the primary motor cortex (M1, a core region subserving bodily movements) and the anterior temporal lobe (ATL, a putative multimodal semantic hub). Convergent evidence from sensor- and source-level analyses revealed that increased modulations for action verbs occurred earlier in M1 (similar to 130-190 ms) than in specific ATL hubs (similar to 250-410 ms). Moreover, machine-learning decoding showed that trial-by-trial classification peaks emerged faster in M1 (similar to 100-175 ms) than in the ATL (similar to 345-500 ms), with over 71% accuracy in both cases. Considering their latencies, these results challenge the 'symbolic view' and its implication that sensorimotor mechanisms play only secondary roles in semantic processing. Instead, our findings support the 'grounded view', showing that early semantic effects are critically driven by embodied reactivations and that these cannot be reduced to post-comprehension epiphenomena, even when words are individually classified. Briefly, our study offers non-trivial insights to constrain fine-grained models of language and understand how meaning unfolds in neural time.
引用
收藏
页码:439 / 449
页数:11
相关论文
共 110 条
[1]   Direct Physiologic Evidence of a Heteromodal Convergence Region for Proper Naming in Human Left Anterior Temporal Lobe [J].
Abel, Taylor J. ;
Rhone, Ariane E. ;
Nourski, Kirill V. ;
Kawasaki, Hiroto ;
Oya, Hiroyuki ;
Griffiths, Timothy D. ;
Howard, Matthew A., III ;
Tranel, Daniel .
JOURNAL OF NEUROSCIENCE, 2015, 35 (04) :1513-1520
[2]   Sensitivity of MEG and EEG to Source Orientation [J].
Ahlfors, Seppo P. ;
Han, Jooman ;
Belliveau, John W. ;
Haemaelaeinen, Matti S. .
BRAIN TOPOGRAPHY, 2010, 23 (03) :227-232
[3]  
[Anonymous], 2002, E-prime (version 2.0), Computer Software and Manual
[4]   What do brain lesions tell us about theories of embodied semantics and the human mirror neuron system? [J].
Arevalo, Analia L. ;
Baldo, Juliana V. ;
Dronkers, Nina F. .
CORTEX, 2012, 48 (02) :242-254
[5]   Congruent embodied representations for visually presented actions and linguistic phrases describing actions [J].
Aziz-Zadeh, Lisa ;
Wilson, Stephen M. ;
Rizzolatti, Giacomo ;
Iacoboni, Marco .
CURRENT BIOLOGY, 2006, 16 (18) :1818-1823
[6]   Typical Neural Representations of Action Verbs Develop without Vision [J].
Bedny, M. ;
Caramazza, A. ;
Pascual-Leone, A. ;
Saxe, R. .
CEREBRAL CORTEX, 2012, 22 (02) :286-293
[7]   Perception, action, and word meanings in the human brain: the case from action verbs [J].
Bedny, Marina ;
Caramazza, Alfonso .
YEAR IN COGNITIVE NEUROSCIENCE, 2011, 1224 :81-95
[8]   Sentential negation modulates inhibition in a stop-signal task. Evidence from behavioral and ERP data [J].
Beltran, David ;
Muneton-Ayala, Mercedes ;
de Vega, Manuel .
NEUROPSYCHOLOGIA, 2018, 112 :10-18
[9]   The neurobiology of semantic memory [J].
Binder, Jeffrey R. ;
Desai, Rutvik H. .
TRENDS IN COGNITIVE SCIENCES, 2011, 15 (11) :527-536
[10]   Where Is the Semantic System? A Critical Review and Meta-Analysis of 120 Functional Neuroimaging Studies [J].
Binder, Jeffrey R. ;
Desai, Rutvik H. ;
Graves, William W. ;
Conant, Lisa L. .
CEREBRAL CORTEX, 2009, 19 (12) :2767-2796