A novel piecewise linear classifier based on polyhedral conic and max-min separabilities

被引:24
作者
Bagirov, Adil M. [1 ]
Ugon, Julien [1 ]
Webb, Dean [1 ]
Ozturk, Gurkan [2 ]
Kasimbeyli, Refail [3 ]
机构
[1] Univ Ballarat, Sch Sci Informat Technol & Engn, Ballarat, Vic 3353, Australia
[2] Anadolu Univ, Dept Ind Engn, TR-26480 Eskisehir, Turkey
[3] Izmir Univ Econ, Dept Ind Syst Engn, Fac Comp Sci, TR-35330 Izmir, Turkey
关键词
Nonsmooth optimization; Piecewise linear separability; Data mining; Supervised learning; Piecewise linear classifiers; MINIMIZATION; DESIGN;
D O I
10.1007/s11750-011-0241-5
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
In this paper, an algorithm for finding piecewise linear boundaries between pattern classes is developed. This algorithm consists of two main stages. In the first stage, a polyhedral conic set is used to identify data points which lie inside their classes, and in the second stage we exclude those points to compute a piecewise linear boundary using the remaining data points. Piecewise linear boundaries are computed incrementally starting with one hyperplane. Such an approach allows one to significantly reduce the computational effort in many large data sets. Results of numerical experiments are reported. These results demonstrate that the new algorithm consistently produces a good test set accuracy on most data sets comparing with a number of other mainstream classifiers.
引用
收藏
页码:3 / 24
页数:22
相关论文
共 21 条
[1]  
[Anonymous], 1994, MACHINE LEARNING NEU
[2]  
[Anonymous], 2007, Uci machine learning repository
[3]   Polyhedral separability through successive LP [J].
Astorino, A ;
Gaudioso, M .
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2002, 112 (02) :265-293
[4]   Discrete gradient method:: Derivative-free method for nonsmooth optimization [J].
Bagirov, A. M. ;
Karasoezen, B. ;
Sezer, M. .
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2008, 137 (02) :317-334
[5]   An efficient algorithm for the incremental construction of a piecewise linear classifier [J].
Bagirov, A. M. ;
Ugon, J. ;
Webb, D. .
INFORMATION SYSTEMS, 2011, 36 (04) :782-790
[6]   Piecewise partially separable functions and a derivative-free algorithm for large scale nonsmooth optimization [J].
Bagirov, Adil M. ;
Ugon, Julien .
JOURNAL OF GLOBAL OPTIMIZATION, 2006, 35 (02) :163-195
[7]   Classification through incremental max-min separability [J].
Bagirov, Adil M. ;
Ugon, Julien ;
Webb, Dean ;
Karasozen, B. .
PATTERN ANALYSIS AND APPLICATIONS, 2011, 14 (02) :165-174
[8]   Max-min separability [J].
Bagirov, AM .
OPTIMIZATION METHODS & SOFTWARE, 2005, 20 (2-3) :271-290
[9]   A method for minimization of quasidifferentiable functions [J].
Bagirov, AM .
OPTIMIZATION METHODS & SOFTWARE, 2002, 17 (01) :31-60
[10]  
Bagirov AM, 2005, APPL OPTIMIZAT, V99, P175