Classification by vertical and cutting multi-hyperplane decision tree induction

被引:10
作者
Better, Marco [1 ]
Glover, Fred [1 ]
Samorani, Michele [2 ]
机构
[1] OptTek Syst Inc, Boulder, CO 80302 USA
[2] Univ Colorado, Leeds Sch Business, Boulder, CO 80309 USA
关键词
Data mining; Discrimination analysis; Piecewise-linear models; Mathematical programming; DISCRIMINANT-ANALYSIS; PROGRAMMING-MODELS; SELECTION; SYSTEM;
D O I
10.1016/j.dss.2009.06.004
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Two-group classification is a key task in decision making and data mining applications. We introduce two new mixed integer programming formulations that make use of multiple separating hyperplanes. They represent a generalization of previous piecewise-linear models that embed rules having the form of hyperplanes, which are used to successively separate the two groups. In fact, the classifiers obtained are particular types of decision trees which are allowed to grow in depth and not in width. Computational results show that our models achieve better classification accuracy in less time than previous approaches. (C) 2009 Elsevier B.V. All rights reserved.
引用
收藏
页码:430 / 436
页数:7
相关论文
共 28 条
[1]   NEW LP BASED HEURISTICS FOR THE CLASSIFICATION PROBLEM [J].
ABAD, PL ;
BANKS, WJ .
EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 1993, 67 (01) :88-100
[2]  
Bennett KP, 1998, IEEE WORLD CONGRESS ON COMPUTATIONAL INTELLIGENCE, P2396, DOI 10.1109/IJCNN.1998.687237
[3]   OPTIMAL ESTIMATION OF EXECUTIVE COMPENSATION BY LINEAR PROGRAMMING [J].
Charnes, A. ;
Cooper, W. W. ;
Ferguson, R. O. .
MANAGEMENT SCIENCE, 1955, 1 (02) :138-151
[4]  
Charnes A., 1961, Management Models and Industrial Applications of Linear Programming
[5]   A machine learning approach to web page filtering using content and structure analysis [J].
Chau, Michael ;
Chen, Hsinchun .
DECISION SUPPORT SYSTEMS, 2008, 44 (02) :482-494
[6]   Mining customer product rating for personalized marketing [J].
Cheung, KW ;
Kwok, JT ;
Law, MH ;
Tsui, KC .
DECISION SUPPORT SYSTEMS, 2003, 35 (02) :231-243
[7]  
Christianini N., 2000, INTRO SUPPORT VECTOR, P189
[8]  
FEELDERS AJ, 2003, STAT CONCEPTS INTELL
[9]   SIMPLE BUT POWERFUL GOAL PROGRAMMING-MODELS FOR DISCRIMINANT PROBLEMS [J].
FREED, N ;
GLOVER, F .
EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 1981, 7 (01) :44-60
[10]   Mathematical programming models for piecewise-linear discriminant analysis [J].
Glen, JJ .
JOURNAL OF THE OPERATIONAL RESEARCH SOCIETY, 2005, 56 (03) :331-341