Localizing Syntactic Composition with Left-Corner Recurrent Neural Network Grammars

被引:4
作者
Sugimoto, Yushi [1 ]
Yoshida, Ryo [1 ]
Jeong, Hyeonjeong [2 ]
Koizumi, Masatoshi [3 ]
Brennan, Jonathan R. [4 ]
Oseki, Yohei [1 ]
机构
[1] Univ Tokyo, Grad Sch Arts & Sci, Tokyo, Japan
[2] Tohoku Univ, Grad Sch Int & Cultural Studies, Sendai, Japan
[3] Tohoku Univ, Grad Sch Arts & Letters, Dept Linguist, Sendai, Japan
[4] Univ Michigan, Dept Linguist, Ann Arbor, MI USA
来源
NEUROBIOLOGY OF LANGUAGE | 2024年 / 5卷 / 01期
基金
日本科学技术振兴机构; 日本学术振兴会;
关键词
fMRI; left-corner parsing; naturalistic reading; recurrent neural network grammar; surprisal; syntax; ANTERIOR TEMPORAL-LOBE; COMPREHENSION; ORGANIZATION; BRAIN;
D O I
10.1162/nol_a_00118
中图分类号
H0 [语言学];
学科分类号
030303 ; 0501 ; 050102 ;
摘要
In computational neurolinguistics, it has been demonstrated that hierarchical models such as recurrent neural network grammars (RNNGs), which jointly generate word sequences and their syntactic structures via the syntactic composition, better explained human brain activity than sequential models such as long short-term memory networks (LSTMs). However, the vanilla RNNG has employed the top-down parsing strategy, which has been pointed out in the psycholinguistics literature as suboptimal especially for head-final/left-branching languages, and alternatively the left-corner parsing strategy has been proposed as the psychologically plausible parsing strategy. In this article, building on this line of inquiry, we investigate not only whether hierarchical models like RNNGs better explain human brain activity than sequential models like LSTMs, but also which parsing strategy is more neurobiologically plausible, by developing a novel fMRI corpus where participants read newspaper articles in a head-final/left-branching language, namely Japanese, through the naturalistic fMRI experiment. The results revealed that left-corner RNNGs outperformed both LSTMs and top-down RNNGs in the left inferior frontal and temporal-parietal regions, suggesting that there are certain brain regions that localize the syntactic composition with the left-corner parsing strategy.
引用
收藏
页码:201 / 224
页数:24
相关论文
共 69 条
[1]   MEMORY REQUIREMENTS AND LOCAL AMBIGUITIES OF PARSING STRATEGIES [J].
ABNEY, SP ;
JOHNSON, M .
JOURNAL OF PSYCHOLINGUISTIC RESEARCH, 1991, 20 (03) :233-250
[2]   Machine learning for neuroirnaging with scikit-learn [J].
Abraham, Alexandre ;
Pedregosa, Fabian ;
Eickenberg, Michael ;
Gervais, Philippe ;
Mueller, Andreas ;
Kossaifi, Jean ;
Gramfort, Alexandre ;
Thirion, Bertrand ;
Varoquaux, Gael .
FRONTIERS IN NEUROINFORMATICS, 2014, 8
[3]  
Bates D., 2007, LME4 LINEAR MIXED EF
[4]   Basic Linguistic Composition Recruits the Left Anterior Temporal Lobe and Left Angular Gyrus During Both Listening and Reading [J].
Bemis, D. K. ;
Pylkkaenen, L. .
CEREBRAL CORTEX, 2013, 23 (08) :1859-1873
[5]   Simple Composition: A Magnetoencephalography Investigation into the Comprehension of Minimal Linguistic Phrases [J].
Bemis, Douglas K. ;
Pylkkaenen, Liina .
JOURNAL OF NEUROSCIENCE, 2011, 31 (08) :2801-2814
[6]  
Bhattasali S, 2021, FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL-IJCNLP 2021, P3786
[7]   Naturalistic Sentence Comprehension in the Brain [J].
Brennan, Jonathan .
LANGUAGE AND LINGUISTICS COMPASS, 2016, 10 (07) :299-313
[8]   Syntactic structure building in the anterior temporal lobe during natural story listening [J].
Brennan, Jonathan ;
Nir, Yuval ;
Hasson, Uri ;
Malach, Rafael ;
Heeger, David J. ;
Pylkkaenen, Liina .
BRAIN AND LANGUAGE, 2012, 120 (02) :163-173
[9]   Localizing syntactic predictions using recurrent neural network grammars [J].
Brennan, Jonathan R. ;
Dyer, Chris ;
Kuncoro, Adhiguna ;
Hale, John T. .
NEUROPSYCHOLOGIA, 2020, 146
[10]   Hierarchical structure guides rapid linguistic predictions during naturalistic listening [J].
Brennan, Jonathan R. ;
Hale, John T. .
PLOS ONE, 2019, 14 (01)