Text Genre and Training Data Size in Human-Like Parsing

被引:0
作者
Hale, John T. [1 ]
Kuncoro, Adhiguna [1 ]
Hall, Keith B. [2 ]
Dyer, Chris [1 ]
Brennan, Jonathan R. [3 ]
机构
[1] DeepMind, London, England
[2] Google Res, New York, NY USA
[3] Univ Michigan, Ann Arbor, MI 48109 USA
来源
2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019): PROCEEDINGS OF THE CONFERENCE | 2019年
基金
美国国家科学基金会;
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Domain-specific training typically makes NLP systems work better. We show that this extends to cognitive modeling as well by relating the states of a neural phrase-structure parser to electrophysiological measures from human participants. These measures were recorded as participants listened to a spoken recitation of the same literary text that was supplied as input to the neural parser. Given more training data, the system derives a better cognitive model - but only when the training examples come from the same textual genre. This finding is consistent with the idea that humans adapt syntactic expectations to particular genres during language comprehension (Kaan and Chun, 2018; Branigan and Pickering, 2017).
引用
收藏
页码:5846 / 5852
页数:7
相关论文
共 43 条
[1]  
[Anonymous], 2012, 1 WORKSH SYNT AN NON
[2]  
[Anonymous], 2000, The Syntactic Process
[3]  
[Anonymous], 2006, COLINGACL 2006 VOLS, DOI DOI 10.3115/1220175.1220230
[4]  
[Anonymous], 2009, P 2009 C EMPIRICAL M
[5]  
Axelrod A., 2011, P C EMPIRICAL METHOD, P355
[6]   The English Lexicon Project [J].
Balota, David A. ;
Yap, Melvin J. ;
Cortese, Michael J. ;
Hutchison, Keith A. ;
Kessler, Brett ;
Loftis, Bjorn ;
Neely, James H. ;
Nelson, Douglas L. ;
Simpson, Greg B. ;
Treiman, Rebecca .
BEHAVIOR RESEARCH METHODS, 2007, 39 (03) :445-459
[7]  
Baucom Eric., 2013, P INT C RECENT ADV N, P56
[8]  
Bies Ann, 1995, MSCIS95060 U PENNS D
[9]   An experimental approach to linguistic representation [J].
Branigan, Holly P. ;
Pickering, Martin J. .
BEHAVIORAL AND BRAIN SCIENCES, 2017, 40
[10]   Hierarchical structure guides rapid linguistic predictions during naturalistic listening [J].
Brennan, Jonathan R. ;
Hale, John T. .
PLOS ONE, 2019, 14 (01)