Localizing Syntactic Composition with Left-Corner Recurrent Neural Network Grammars

被引:4
作者
Sugimoto, Yushi [1 ]
Yoshida, Ryo [1 ]
Jeong, Hyeonjeong [2 ]
Koizumi, Masatoshi [3 ]
Brennan, Jonathan R. [4 ]
Oseki, Yohei [1 ]
机构
[1] Univ Tokyo, Grad Sch Arts & Sci, Tokyo, Japan
[2] Tohoku Univ, Grad Sch Int & Cultural Studies, Sendai, Japan
[3] Tohoku Univ, Grad Sch Arts & Letters, Dept Linguist, Sendai, Japan
[4] Univ Michigan, Dept Linguist, Ann Arbor, MI USA
来源
NEUROBIOLOGY OF LANGUAGE | 2024年 / 5卷 / 01期
基金
日本科学技术振兴机构; 日本学术振兴会;
关键词
fMRI; left-corner parsing; naturalistic reading; recurrent neural network grammar; surprisal; syntax; ANTERIOR TEMPORAL-LOBE; COMPREHENSION; ORGANIZATION; BRAIN;
D O I
10.1162/nol_a_00118
中图分类号
H0 [语言学];
学科分类号
030303 ; 0501 ; 050102 ;
摘要
In computational neurolinguistics, it has been demonstrated that hierarchical models such as recurrent neural network grammars (RNNGs), which jointly generate word sequences and their syntactic structures via the syntactic composition, better explained human brain activity than sequential models such as long short-term memory networks (LSTMs). However, the vanilla RNNG has employed the top-down parsing strategy, which has been pointed out in the psycholinguistics literature as suboptimal especially for head-final/left-branching languages, and alternatively the left-corner parsing strategy has been proposed as the psychologically plausible parsing strategy. In this article, building on this line of inquiry, we investigate not only whether hierarchical models like RNNGs better explain human brain activity than sequential models like LSTMs, but also which parsing strategy is more neurobiologically plausible, by developing a novel fMRI corpus where participants read newspaper articles in a head-final/left-branching language, namely Japanese, through the naturalistic fMRI experiment. The results revealed that left-corner RNNGs outperformed both LSTMs and top-down RNNGs in the left inferior frontal and temporal-parietal regions, suggesting that there are certain brain regions that localize the syntactic composition with the left-corner parsing strategy.
引用
收藏
页码:201 / 224
页数:24
相关论文
共 69 条
[31]  
Kuncoro A, 2018, PROCEEDINGS OF THE 56TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL), VOL 1, P1426
[32]   SYNTACTIC STRUCTURES - CHOMSKY,N [J].
LEES, RB .
LANGUAGE, 1957, 33 (03) :375-408
[33]   Expectation-based syntactic comprehension [J].
Levy, Roger .
COGNITION, 2008, 106 (03) :1126-1177
[34]  
Li J, 2019, MINIMALIST PARSING, P159, DOI DOI 10.1093/OSO/9780198795087.003.0007
[35]   Distinguishing Syntactic Operations in the Brain: Dependency and Phrase-Structure Parsing [J].
Lopopolo, Alessandro ;
van den Bosch, Antal ;
Petersson, Karl-Magnus ;
Willems, Roel M. .
NEUROBIOLOGY OF LANGUAGE, 2021, 2 (01) :152-175
[36]   Using stochastic language models (SLM) to map lexical, syntactic, and phonological information processing in the brain [J].
Lopopolo, Alessandro ;
Frank, Stefan L. ;
van den Bosch, Antal ;
Willems, Roel M. .
PLOS ONE, 2017, 12 (05)
[37]   Balanced corpus of contemporary written Japanese [J].
Maekawa, Kikuo ;
Yamazaki, Makoto ;
Ogiso, Toshinobu ;
Maruyama, Takehiko ;
Ogura, Hideki ;
Kashino, Wakako ;
Koiso, Hanae ;
Yamaguchi, Masaya ;
Tanaka, Makiro ;
Den, Yasuharu .
LANGUAGE RESOURCES AND EVALUATION, 2014, 48 (02) :345-371
[38]   Syntax through the looking glass: A review on two-word linguistic processing across behavioral, neuroimaging and neurostimulation studies [J].
Maran, Matteo ;
Friederici, Angela D. ;
Zaccarella, Emiliano .
NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS, 2022, 142
[39]   Left posterior temporal cortex is sensitive to syntax within conceptually matched Arabic expressions [J].
Matar, Suhail ;
Dirani, Julien ;
Marantz, Alec ;
Pylkkanen, Liina .
SCIENTIFIC REPORTS, 2021, 11 (01)
[40]   The Cortical Organization of Syntax [J].
Matchin, William ;
Hickok, Gregory .
CEREBRAL CORTEX, 2020, 30 (03) :1481-1498