Cheap and easy entity evaluation

被引：0
|
作者：
Hachey, Ben [1 ]
Nothman, Joel [1 ]
Radford, Will [1 ]
机构：
[1] Univ Sydney, Sch Informat Technol, Sydney, NSW 2006, Australia
来源：
PROCEEDINGS OF THE 52ND ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, VOL 2 | 2014年
基金：
澳大利亚研究理事会;
关键词：
D O I：
暂无
中图分类号：
TP39 [计算机的应用];
学科分类号：
081203 ; 0835 ;
摘要：
The AIDA-YAGO dataset is a popular target for whole-document entity recognition and disambiguation, despite lacking a shared evaluation tool. We review evaluation regimens in the literature while comparing the output of three approaches, and identify research opportunities. This utilises our open, accessible evaluation tool. We exemplify a new paradigm of distributed, shared evaluation, in which evaluation software and standardised, versioned system outputs are provided online.
引用
收藏
页码：464 / 469
页数：6
相关论文
共 50 条
  • [31] An easy-to-use evaluation framework for benchmarking entity recognition and disambiguation systems
    Chen, Hui
    Wei, Bao-gang
    Li, Yi-ming
    Liu, Yong-huai
    Zhu, Wen-hao
    FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING, 2017, 18 (02) : 195 - 205
  • [32] An easy-to-use evaluation framework for benchmarking entity recognition and disambiguation systems
    Hui Chen
    Bao-gang Wei
    Yi-ming Li
    Yong-huai Liu
    Wen-hao Zhu
    Frontiers of Information Technology & Electronic Engineering, 2017, 18 : 195 - 205
  • [33] Evaluation of the Quick, Easy, Cheap, Effective, Rugged, and Safe (QuEChERS) approach to pesticide residue analysis
    Schenck, FJ
    Hobbs, JE
    BULLETIN OF ENVIRONMENTAL CONTAMINATION AND TOXICOLOGY, 2004, 73 (01) : 24 - 30
  • [34] Evaluation of the Quick, Easy, Cheap, Effective, Rugged, and Safe (QuEChERS) Approach to Pesticide Residue Analysis
    F. J. Schenck
    J. E. Hobbs
    Bulletin of Environmental Contamination and Toxicology, 2004, 73 : 24 - 30
  • [35] Probiotics to prevent necrotizing enterocolitis: Too cheap and easy?
    Taylor, Richard S.
    PAEDIATRICS & CHILD HEALTH, 2014, 19 (07) : 351 - +
  • [36] Giving back - It's easy and cheap being green
    Nachtigal, Jeff
    FORTUNE, 2006, 154 (08) : 53 - 53
  • [37] CHEAP, EASY, OR CONNECTED: THE CONDITIONS FOR CREATING GROUP COORDINATION
    McCuebins, Mathew D.
    Rodriguez, Daniel
    Weller, Nicholas
    SOUTHERN CALIFORNIA LAW REVIEW, 2013, 86 (03) : 495 - 516
  • [38] EASY, CHEAP, AND RELIABLE IDENTIFICATION OF GANGLION-CELLS
    HEATON, ND
    HOWARD, ER
    GARRETT, JR
    AMERICAN JOURNAL OF CLINICAL PATHOLOGY, 1986, 86 (02) : 260 - 260
  • [39] Cheap and easy systematic CMOS transistor mismatch characterization
    Serrano-Gotarredona, T
    Linares-Barranco, B
    ISCAS '98 - PROCEEDINGS OF THE 1998 INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOLS 1-6, 1998, : A466 - A469
  • [40] Endolaryngeal Anterior Commissure Stent-Cheap and Easy
    McGuire, Jessica K.
    Govender, Reuben
    Park-Ross, Penny
    Fagan, Johannes J.
    LARYNGOSCOPE, 2017, 127 (08): : 1869 - 1872
12345