Text Genre and Training Data Size in Human-Like Parsing

被引:0
作者
Hale, John T. [1 ]
Kuncoro, Adhiguna [1 ]
Hall, Keith B. [2 ]
Dyer, Chris [1 ]
Brennan, Jonathan R. [3 ]
机构
[1] DeepMind, London, England
[2] Google Res, New York, NY USA
[3] Univ Michigan, Ann Arbor, MI 48109 USA
来源
2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019): PROCEEDINGS OF THE CONFERENCE | 2019年
基金
美国国家科学基金会;
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Domain-specific training typically makes NLP systems work better. We show that this extends to cognitive modeling as well by relating the states of a neural phrase-structure parser to electrophysiological measures from human participants. These measures were recorded as participants listened to a spoken recitation of the same literary text that was supplied as input to the neural parser. Given more training data, the system derives a better cognitive model - but only when the training examples come from the same textual genre. This finding is consistent with the idea that humans adapt syntactic expectations to particular genres during language comprehension (Kaan and Chun, 2018; Branigan and Pickering, 2017).
引用
收藏
页码:5846 / 5852
页数:7
相关论文
共 43 条
[11]  
Daume III H., 2007, P 45 ANN M ASS COMPU, P256
[12]  
DavidWeiss Christopher Alberti, 2015, P ACL
[13]  
Devlin J, 2019, 2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, P4171
[14]  
Dyer C, 2016, P 2016 C N AM CHAPT, P199, DOI [DOI 10.18653/V1/N16-1024, 10.18653/v1/N16-1024]
[15]  
Dyer C, 2015, PROCEEDINGS OF THE 53RD ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 7TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING, VOL 1, P334
[16]  
Frank Robert, 2011, CAMBRIDGE ENCY LANGU, P621
[17]  
Frank Stefan L., 2019, P 41 NUAL M COGN SCI
[18]  
Futrell Richard, 2019, P 18 ANN C N AM ASS
[19]  
Gildea Daniel, 2001, P 2001 C EMP METH NA
[20]  
Goodkind Adam., 2018, P 8 WORKSH COGN MOD, P10, DOI DOI 10.18653/V1/W18-0102