Simple and Effective Few-Shot Named Entity Recognition with Structured Nearest Neighbor Learning

被引:0
作者
Yang, Yi [1 ]
Katiyar, Arzoo [2 ]
机构
[1] ASAPP Inc, New York, NY 10007 USA
[2] Penn State Univ, University Pk, PA 16802 USA
来源
PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP) | 2020年
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present a simple few-shot named entity recognition (NER) system based on nearest neighbor learning and structured inference. Our system uses a supervised NER model trained on the source domain, as a feature extractor. Across several test domains, we show that a nearest neighbor classifier in this feature-space is far more effective than the standard meta-learning approaches. We further propose a cheap but effective method to capture the label dependencies between entity tags without expensive CRF training. We show that our method of combining structured decoding with nearest neighbor learning achieves state-of-the-art performance on standard few-shot NER evaluation tasks, improving F1 scores by 6% to 16% absolute points over prior meta-learning based systems.
引用
收藏
页码:6365 / 6375
页数:11
相关论文
共 24 条
  • [1] Bao Y., 2020, P ICLR
  • [2] Cherry Colin, 2019, P 2 WORKSH DEEP LEAR
  • [3] Derczynski Leon, 2017, P 3 WORKSH NOIS US G, P140, DOI 10.18653/v1/W17-4418,eprint:https://aclanthology.org/W17-4418.pdf
  • [4] Devlin J, 2019, 2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, P4171
  • [5] VITERBI ALGORITHM
    FORNEY, GD
    [J]. PROCEEDINGS OF THE IEEE, 1973, 61 (03) : 268 - 278
  • [6] Fritzler Alexander, 2019, P 34 ACM SIGAPP S AP
  • [7] Geng Ruiying, 2019, P EMP METH NAT LANG
  • [8] Gu Jiatao, 2018, P EMP METH NAT LANG
  • [9] Han Xu, 2018, P EMP METH NAT LANG
  • [10] Hofer M., 2018, ARXIV PREPRINT ARXIV