Semi-supervised generalized eigenvalues classification

被引:5
作者
Viola, Marco [1 ]
Sangiovanni, Mara [3 ]
Toraldo, Gerardo [2 ]
Guarracino, Mario R. [3 ]
机构
[1] Sapienza Univ Rome, Dept Comp Control & Management Engn, Rome, Italy
[2] Univ Naples Federico II, Dept Math & Applicat, Naples, Italy
[3] Natl Res Council Italy, High Performance Comp & Networking Inst, Naples, Italy
关键词
Semi-supervised classification; Laplacian regularization; Manifold regularization; Generalized eigenvalues classifiers; SUPPORT VECTOR MACHINE; STEEPEST DESCENT; GRADIENT-METHOD; REDUCTION;
D O I
10.1007/s10479-017-2674-1
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
Supervised classification is one of the most powerful techniques to analyze data, when a-priori information is available on the membership of data samples to classes. Since the labeling process can be both expensive and time-consuming, it is interesting to investigate semi-supervised algorithms that can produce classification models taking advantage of unlabeled samples. In this paper we propose LapReGEC, a novel technique that introduces a Laplacian regularization term in a generalized eigenvalue classifier. As a result, we produce models that are both accurate and parsimonious in terms of needed labeled data. We empirically prove that the obtained classifier well compares with other techniques, using as little as 5% of labeled points to compute the models.
引用
收藏
页码:249 / 266
页数:18
相关论文
共 42 条
  • [1] [Anonymous], 2005, P INT WORKSH ART INT
  • [2] [Anonymous], 2006, IEEE T NEURAL NETWOR
  • [3] [Anonymous], 2002, LANCZOS ALGORITHMS L, DOI [10.1137/1.9780898719192, DOI 10.1137/1.9780898719192]
  • [4] On the Application of the Spectral Projected Gradient Method in Image Segmentation
    Antonelli, Laura
    De Simone, Valentina
    di Serafino, Daniela
    [J]. JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2016, 54 (01) : 106 - 116
  • [5] Data preprocessing in semi-supervised SVM classification
    Astorino, A.
    Gorgone, E.
    Gaudioso, M.
    Pallaschke, D.
    [J]. OPTIMIZATION, 2011, 60 (1-2) : 143 - 151
  • [6] 1ST-ORDER AND 2ND-ORDER METHODS FOR LEARNING - BETWEEN STEEPEST DESCENT AND NEWTON METHOD
    BATTITI, R
    [J]. NEURAL COMPUTATION, 1992, 4 (02) : 141 - 166
  • [7] Belkin M, 2006, J MACH LEARN RES, V7, P2399
  • [8] Bennett K.P., 1999, ADV NEURAL INFORM PR, V11
  • [9] Spectral Projected Gradient Methods: Review and Perspectives
    Birgin, Ernesto G.
    Martinez, Jose Mario
    Raydan, Marcos
    [J]. JOURNAL OF STATISTICAL SOFTWARE, 2014, 60 (03): : 1 - 21
  • [10] Convergence analysis of an inexact potential reduction method for convex quadratic programming
    Cafieri, S.
    D'Apuzzo, M.
    De Simone, V.
    di Serafino, D.
    Toraldo, G.
    [J]. JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2007, 135 (03) : 355 - 366