Evaluating Word Sense Induction and Disambiguation Methods

被引:7
|
作者
Klapaftis, Ioannis P. [1 ]
Manandhar, Suresh [2 ]
机构
[1] Microsoft Corp, Redmond, WA 98052 USA
[2] Univ York, Dept Comp Sci, York YO10 5DD, N Yorkshire, England
基金
英国工程与自然科学研究理事会; 美国国家科学基金会;
关键词
Word Sense Induction; Word Sense Disambiguation; Lexical Semantics;
D O I
10.1007/s10579-012-9205-0
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Word Sense Induction (WSI) is the task of identifying the different uses (senses) of a target word in a given text in an unsupervised manner, i.e. without relying on any external resources such as dictionaries or sense-tagged data. This paper presents a thorough description of the SemEval-2010 WSI task and a new evaluation setting for sense induction methods. Our contributions are two-fold: firstly, we provide a detailed analysis of the Semeval-2010 WSI task evaluation results and identify the shortcomings of current evaluation measures. Secondly, we present a new evaluation setting by assessing participating systems' performance according to the skewness of target words' distribution of senses showing that there are methods able to perform well above the Most Frequent Sense (MFS) baseline in highly skewed distributions.
引用
收藏
页码:579 / 605
页数:27
相关论文
共 50 条
  • [31] Word Sense Disambiguation for Assamese
    Sarmah, Jumi
    Sarma, Shikhar Kr
    2016 IEEE 6TH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTING (IACC), 2016, : 146 - 151
  • [32] Soft Word Sense Disambiguation
    Ramakrishnan, Ganesh
    Prithviraj, B. P.
    Deepa, A.
    Bhattacharyya, Pushpak
    Chakrabarti, Soumen
    GWC 2004: SECOND INTERNATIONAL WORDNET CONFERENCE, PROCEEDINGS, 2003, : 291 - 298
  • [33] Word Sense Disambiguation for Turkish
    Mert, Ezgi
    Dalkilic, Goekhan
    2009 24TH INTERNATIONAL SYMPOSIUM ON COMPUTER AND INFORMATION SCIENCES, 2009, : 205 - 210
  • [34] Smoothing and Word Sense Disambiguation
    Agirre, E
    Martinez, D
    ADVANCES IN NATURAL LANGUAGE PROCESSING, 2004, 3230 : 360 - 371
  • [35] MSC+: Language pattern learning for word sense induction and disambiguation
    Goularte, Fabio Bif
    Sorato, Danielly
    Nassar, Silvia Modesto
    Fileto, Renato
    Saggion, Horacio
    KNOWLEDGE-BASED SYSTEMS, 2020, 188 (188)
  • [36] Fusion Techniques for Named Entity Recognition and Word Sense Induction and Disambiguation
    Soriano-Morales, Edmundo-Pavel
    Ah-Pine, Julien
    Loudcher, Sabine
    DISCOVERY SCIENCE, DS 2017, 2017, 10558 : 340 - 355
  • [37] SensPick: Sense Picking for Word Sense Disambiguation
    Zobaed, Sm
    Haque, Md Enamul
    Rabby, Md Fazle
    Salehi, Mohsen Amini
    2021 IEEE 15TH INTERNATIONAL CONFERENCE ON SEMANTIC COMPUTING (ICSC 2021), 2021, : 318 - 324
  • [38] Graph and Word Similarity for Word Sense Disambiguation
    Meng, Fanqing
    2020 13TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, BIOMEDICAL ENGINEERING AND INFORMATICS (CISP-BMEI 2020), 2020, : 1114 - 1118
  • [39] Biomedical Word Sense Disambiguation with Word Embeddings
    Antunes, Rui
    Matos, Sergio
    11TH INTERNATIONAL CONFERENCE ON PRACTICAL APPLICATIONS OF COMPUTATIONAL BIOLOGY & BIOINFORMATICS, 2017, 616 : 273 - 279
  • [40] Evaluating n-gram Models for a Bilingual Word Sense Disambiguation Task
    Pinto, David
    Vilarino, Darnes
    Balderas, Carlos
    Tovar, Mireya
    Beltran, Beatriz
    COMPUTACION Y SISTEMAS, 2011, 15 (02): : 209 - 220