Evaluating Word Sense Induction and Disambiguation Methods

被引:7
|
作者
Klapaftis, Ioannis P. [1 ]
Manandhar, Suresh [2 ]
机构
[1] Microsoft Corp, Redmond, WA 98052 USA
[2] Univ York, Dept Comp Sci, York YO10 5DD, N Yorkshire, England
基金
英国工程与自然科学研究理事会; 美国国家科学基金会;
关键词
Word Sense Induction; Word Sense Disambiguation; Lexical Semantics;
D O I
10.1007/s10579-012-9205-0
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Word Sense Induction (WSI) is the task of identifying the different uses (senses) of a target word in a given text in an unsupervised manner, i.e. without relying on any external resources such as dictionaries or sense-tagged data. This paper presents a thorough description of the SemEval-2010 WSI task and a new evaluation setting for sense induction methods. Our contributions are two-fold: firstly, we provide a detailed analysis of the Semeval-2010 WSI task evaluation results and identify the shortcomings of current evaluation measures. Secondly, we present a new evaluation setting by assessing participating systems' performance according to the skewness of target words' distribution of senses showing that there are methods able to perform well above the Most Frequent Sense (MFS) baseline in highly skewed distributions.
引用
收藏
页码:579 / 605
页数:27
相关论文
共 50 条
  • [41] Combining Supervised and Unsupervised Lexical Knowledge Methods for Word Sense Disambiguation
    E. Agirre
    G. Rigau
    L. Padró
    J. Atserias
    Computers and the Humanities, 2000, 34 : 103 - 108
  • [42] Combining supervised and unsupervised lexical knowledge methods for word sense disambiguation
    Agirre, E
    Rigau, G
    Padró, L
    Atserias, J
    COMPUTERS AND THE HUMANITIES, 2000, 34 (1-2): : 103 - 108
  • [43] Investigating the Feasibility of Deep Learning Methods for Urdu Word Sense Disambiguation
    Saeed, Ali
    Nawab, Rao Muhammad Adeel
    Stevenson, Mark
    ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2022, 21 (02)
  • [44] Word Sense Indicators: Effective Feature for Chinese Word Sense Disambiguation
    Quan, Changqin
    Ren, Fuji
    He, Tingting
    INFORMATION-AN INTERNATIONAL INTERDISCIPLINARY JOURNAL, 2009, 12 (05): : 1157 - 1164
  • [45] An Improved Word Sense Disambiguation Method
    Yu, Linlin
    Song, Lifang
    Sun, Jianyan
    Li, Lin
    2016 6TH INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY FOR MANUFACTURING SYSTEMS (ITMS 2016), 2016, : 153 - 155
  • [46] Genetic Word Sense Disambiguation Algorithm
    Zhang, ChunHui
    Zhou, Yiming
    Martin, Trevor
    2008 INTERNATIONAL SYMPOSIUM ON INTELLIGENT INFORMATION TECHNOLOGY APPLICATION, VOL I, PROCEEDINGS, 2008, : 123 - +
  • [47] Word sense disambiguation in evolutionary manner
    Abed, Saad Adnan
    Tiun, Sabrina
    Omar, Nazlia
    CONNECTION SCIENCE, 2016, 28 (03) : 226 - 241
  • [48] A Word Sense Disambiguation Technique for Sinhala
    Arukgoda, Janindu
    Bandara, Vidudaya
    Bashani, Samiththa
    Gamage, Vijayindu
    Wimalasuriya, Daya
    PROCEEDINGS 2014 4TH INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE WITH APPLICATIONS IN ENGINEERING AND TECHNOLOGY ICAIET 2014, 2014, : 207 - 211
  • [49] Minimal Semantics and Word Sense Disambiguation
    Gasparri, Luca
    DISPUTATIO-INTERNATIONAL JOURNAL OF PHILOSOPHY, 2014, 6 (39): : 147 - 171
  • [50] Arabic Word Sense Disambiguation - Survey
    Alian, Marwah
    Awajan, Arafat
    Al-Kouz, Akram
    2017 INTERNATIONAL CONFERENCE ON NEW TRENDS IN COMPUTING SCIENCES (ICTCS), 2017, : 236 - 240