A generalized kernel approach to dissimilarity-based classification

被引:246
作者
Pekalska, E [1 ]
Paclík, P [1 ]
Duin, RPW [1 ]
机构
[1] Delft Univ Technol, Fac Sci Appl, Pattrn Recognit Grp, NL-2628 CJ Delft, Netherlands
关键词
dissimilarity; embedding; pseudo-Euclidean space; nearest mean classifier; support vector classifier; Fisher linear discriminant;
D O I
10.1162/15324430260185592
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Usually, objects to be classified are represented by features. In this paper, we discuss an alternative object representation based on dissimilarity values. If such distances separate the classes well, the nearest neighbor method offers a good solution. However, dissimilarities used in practice are usually far from ideal and the performance of the nearest neighbor rule suffers from its sensitivity to noisy examples. We show that other, more global classification techniques are preferable to the nearest neighbor rule, in such cases. For classification purposes, two different ways of using generalized dissimilarity kernels are considered. In the first one, distances are isometrically embedded in a pseudo-Euclidean space and the classification task is performed there. In the second approach, classifiers are built directly on distance kernels. Both approaches are described theoretically and then compared using experiments with different dissimilarity measures and datasets including degraded data simulating the problem of missing values.
引用
收藏
页码:175 / 211
页数:37
相关论文
共 34 条
  • [1] [Anonymous], MULTIDIMENSIONAL SCA
  • [2] ARKADEV AG, 1966, COMPUTERS PATTERN RE
  • [3] BENNETT KP, 1992, OPTIMIZATION METHODS, V1, P23, DOI DOI 10.1080/10556789208805504
  • [4] Borg I., 1997, MODERN MULTIDIMENSIO
  • [5] Bradley P. S., 1998, INFORMS Journal on Computing, V10, P209, DOI 10.1287/ijoc.10.2.209
  • [6] BURGES CJC, 1998, ADV KERNAL METHODS S
  • [7] DUBUISSON MP, 1994, INT C PATT RECOG, P566, DOI 10.1109/ICPR.1994.576361
  • [8] Duin R. P. W., 1999, International Symposium on Pattern Recognition `In Memoriam Pierre Devijver', P124
  • [9] Duin RPW, 2000, INT C PATT RECOG, P1, DOI 10.1109/ICPR.2000.906006
  • [10] Relational discriminant analysis
    Duin, RPW
    Pekalska, E
    de Ridder, D
    [J]. PATTERN RECOGNITION LETTERS, 1999, 20 (11-13) : 1175 - 1181