Simultaneous feature selection and classification via Minimax Probability Machine

被引:0
作者
Yang, Liming [1 ]
Wang, Laisheng [1 ]
Sun, Yuhua [2 ]
Zhang, Ruiyan [3 ]
机构
[1] China Agr Univ, Coll Sci, Beijing 100083, Peoples R China
[2] USTB, Dept Math & Mech, Beijing 100083, Peoples R China
[3] Sci China Press, Beijing 100717, Peoples R China
关键词
Minimax probability machine; Feature selection; Probability of misclassification; Machine learning;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents a novel method for simultaneous feature selection and classification by incorporating a robust L-1-norm into the objective function of Minimax Probability Machine (MPM). A fractional programming framework is derived by using a bound on the misclassification error involving the mean and covariance of the data. Furthermore, the problems are solved by the Quadratic Interpolation method. Experiments show that our methods can select fewer features to improve the generalization compared to MPM, which illustrates the effectiveness of the proposed algorithms.
引用
收藏
页码:754 / 760
页数:7
相关论文
共 18 条
  • [1] [Anonymous], USING SEDUMI 1 03 MA
  • [2] Bazarra M.S., 2008, NONLINEAR PROGRAMMIN
  • [3] Bhattacharyya C, 2004, J MACH LEARN RES, V5, P1417
  • [4] Simultaneous classification and relevant feature identification in high-dimensional spaces: application to molecular profiling data
    Bhattacharyya, C
    Grate, LR
    Rizki, A
    Radisky, D
    Molina, FJ
    Jordan, MI
    Bissell, MJ
    Mian, IS
    [J]. SIGNAL PROCESSING, 2003, 83 (04) : 729 - 743
  • [5] BLAKE CL, 1992, UCI REPOSITORY MACHI
  • [6] A tutorial on Support Vector Machines for pattern recognition
    Burges, CJC
    [J]. DATA MINING AND KNOWLEDGE DISCOVERY, 1998, 2 (02) : 121 - 167
  • [7] Uncertainty principles and ideal atomic decomposition
    Donoho, DL
    Huo, XM
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2001, 47 (07) : 2845 - 2862
  • [8] An introduction to ROC analysis
    Fawcett, Tom
    [J]. PATTERN RECOGNITION LETTERS, 2006, 27 (08) : 861 - 874
  • [9] Solving the sum-of-ratios problem by an interior-point method
    Freund, RW
    Jarre, F
    [J]. JOURNAL OF GLOBAL OPTIMIZATION, 2001, 19 (01) : 83 - 102
  • [10] Maximizing sensitivity in medical diagnosis using biased minimax probability machine
    Huang, KZ
    Yang, HQ
    King, I
    Lyu, MR
    [J]. IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2006, 53 (05) : 821 - 831