A MIXED INTEGER PROGRAMMING MODEL FOR MULTIPLE-CLASS DISCRIMINANT ANALYSIS

被引:6
作者
Sun, Minghe [1 ]
机构
[1] Univ Texas San Antonio, Coll Business, Dept Management Sci & Stat, San Antonio, TX 78249 USA
关键词
Discriminant analysis; classification; mixed integer programming; optimization; nonparametric procedures; PROTEIN LOCALIZATION SITES; OPTIMAL CRITERION WEIGHTS; STATISTICAL CLASSIFICATION; 3-GROUP CLASSIFICATION; UNACCEPTABLE SOLUTIONS; VARIABLE SELECTION; FORMULATIONS; DIFFICULTIES; GAP;
D O I
10.1142/S0219622011004476
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A mixed integer programming model is proposed for multiple-class discriminant and classification analysis. When multiple discriminant functions, one for each class, are constructed with the mixed integer programming model, the number of misclassified observations in the sample is minimized. This model is an extension of the linear programming models for multiple-class discriminant analysis but may be considered as a generalization of mixed integer programming formulations for two-class classification analysis. Properties of the model are studied. The model is immune from any difficulties of many mathematical programming formulations for two-class classification analysis, such as nonexistence of optimal solutions, improper solutions, and instability under linear data transformation. In addition, meaningful discriminant functions can be generated under conditions where other techniques fail. Examples are provided. Results on publically accessible datasets show that this model is very effective in generating powerful discriminant functions.
引用
收藏
页码:589 / 612
页数:24
相关论文
共 57 条
[1]  
[Anonymous], 1988, BIOMETRICS
[2]  
[Anonymous], 1992, 9202 J COOK U N QUEE
[3]  
[Anonymous], 2007, Uci machine learning repository
[4]  
[Anonymous], P 4 INT C INT SYST M
[5]   Oscillation heuristics for the two-group classification problem [J].
Asparouhov, O ;
Rubin, PA .
JOURNAL OF CLASSIFICATION, 2004, 21 (02) :255-277
[6]  
BAJAIER SM, 1982, DECISION SCI, V13, P604
[7]  
Bennett K. P., 1994, Optimiz Methods Softw, V3, P27, DOI [DOI 10.1080/10556789408805554, 10.1080/10556789408805554]
[8]   Classification and regression via integer optimization [J].
Bertsimas, Dimitris ;
Shioda, Romy .
OPERATIONS RESEARCH, 2007, 55 (02) :252-271
[9]   DISCRIMINANT-ANALYSIS VIA MATHEMATICAL-PROGRAMMING - CERTAIN PROBLEMS AND THEIR CAUSES [J].
CAVALIER, TM ;
IGNIZIO, JP ;
SOYSTER, AL .
COMPUTERS & OPERATIONS RESEARCH, 1989, 16 (04) :353-362
[10]   Hybrid misclassification minimization [J].
Chen, CH ;
Mangasarian, OL .
ADVANCES IN COMPUTATIONAL MATHEMATICS, 1996, 5 (2-3) :127-136