A new approach for training Lagrangian twin support vector machine via unconstrained convex minimization

被引:22
作者
Balasundaram, S. [1 ]
Gupta, Deepak [1 ]
Prasad, Subhash Chandra [1 ]
机构
[1] Jawaharlal Nehru Univ, Sch Comp & Syst Sci, New Delhi 110067, India
关键词
Generalized Hessian approach; Smooth approximation formulation; Twin support vector machine; FINITE NEWTON METHOD; CLASSIFICATION;
D O I
10.1007/s10489-016-0809-8
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, a novel unconstrained convex minimization problem formulation for the Lagrangian dual of the recently introduced twin support vector machine (TWSVM) in simpler form is proposed for constructing binary classifiers. Since the objective functions of the modified minimization problems contain non-smooth 'plus' function, we solve them by Newton iterative method either by considering their generalized Hessian matrices or replacing the 'plus' function by a smooth approximation function. Numerical experiments were performed on a number of interesting real-world benchmark data sets. Computational results clearly illustrates the effectiveness and the applicability of the proposed approach as comparable or better generalization performance with faster learning speed is obtained in comparison with SVM, least squares TWSVM (LS-TWSVM) and TWSVM.
引用
收藏
页码:124 / 134
页数:11
相关论文
共 26 条
  • [1] [Anonymous], EUR C MACH LEARN CHE
  • [2] [Anonymous], 2000, NATURE STAT LEARNING, DOI DOI 10.1007/978-1-4757-3264-1
  • [3] [Anonymous], P 1997 IEEE COMP SOC, DOI DOI 10.1109/CVPR.1997.609310
  • [4] Training Lagrangian twin support vector regression via unconstrained convex minimization
    Balasundaram, S.
    Gupta, Deepak
    [J]. KNOWLEDGE-BASED SYSTEMS, 2014, 59 : 85 - 96
  • [5] CORTES C, 1995, MACH LEARN, V20, P273, DOI 10.1023/A:1022627411411
  • [6] Demsar J, 2006, J MACH LEARN RES, V7, P1
  • [7] Finite Newton method for Lagrangian support vector machine classification
    Fung, G
    Mangasarian, OL
    [J]. NEUROCOMPUTING, 2003, 55 (1-2) : 39 - 55
  • [8] Golub GH., 2012, MATRIX COMPUTATIONS, V3
  • [9] Gene selection for cancer classification using support vector machines
    Guyon, I
    Weston, J
    Barnhill, S
    Vapnik, V
    [J]. MACHINE LEARNING, 2002, 46 (1-3) : 389 - 422
  • [10] GENERALIZED HESSIAN MATRIX AND 2ND-ORDER OPTIMALITY CONDITIONS FOR PROBLEMS WITH C1,1 DATA
    HIRIARTURRUTY, JB
    STRODIOT, JJ
    NGUYEN, VH
    [J]. APPLIED MATHEMATICS AND OPTIMIZATION, 1984, 11 (01) : 43 - 56