Facing the classification of binary problems with a hybrid system based on quantum-inspired binary gravitational search algorithm and K-NN method

被引:23
作者
Han, XiaoHong [1 ]
Quan, Long [1 ]
Xiong, XiaoYan [1 ]
Wu, Bing [1 ]
机构
[1] Taiyuan Univ Technol, Minist Educ China, Key Lab Adv Transducers & Intelligent Control Sys, Taiyuan 030024, Peoples R China
关键词
Feature selection; Binary classification; Gravitational search algorithm; Binary gravitational search algorithm; Quantum computing; K-nearest neighbor; FEATURE-SELECTION; EVOLUTIONARY ALGORITHM; TABU SEARCH;
D O I
10.1016/j.engappai.2013.05.011
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Since given classification data often contains redundant, useless or misleading features, feature selection is an important pre-processing step for solving classification problems. This problem is often solved by applying evolutionary algorithms to decrease the dimensional number of features involved. Removing irrelevant features in the feature space and identifying relevant features correctly is the primary objective, which can increase classification accuracy. In this paper, a novel QBGSA-K-NN hybrid system which hybridizes the quantum-inspired binary gravitational search algorithm (QBGSA) with the K-nearest neighbor (K-NN) method with leave-one-out cross-validation (LOOCV) is proposed. The main aim of this system is to improve classification accuracy with an appropriate feature subset in binary problems. We evaluate the proposed hybrid system on several UCI machine learning benchmark examples. The experimental results show that the proposed method is able to select the discriminating input features correctly and achieve high classification accuracy which is comparable to or better than well-known similar classifier systems. (C) 2013 Elsevier Ltd. All rights reserved.
引用
收藏
页码:2424 / 2430
页数:7
相关论文
共 35 条
[1]  
[Anonymous], P 1 JOINT C FUZZ INT
[2]   Two step particle swarm optimization to solve the feature selection problem [J].
Bello, Rafael ;
Gomez, Yudel ;
Nowe, Ann ;
Garcia, Maria M. .
PROCEEDINGS OF THE 7TH INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS DESIGN AND APPLICATIONS, 2007, :691-+
[3]   Chaotic maps based on binary particle swarm optimization for feature selection [J].
Chuang, Li-Yeh ;
Yang, Cheng-Hong ;
Li, Jung-Chike .
APPLIED SOFT COMPUTING, 2011, 11 (01) :239-248
[4]   NEAREST NEIGHBOR PATTERN CLASSIFICATION [J].
COVER, TM ;
HART, PE .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1967, 13 (01) :21-+
[5]  
Dash M., 1997, Intelligent Data Analysis, V1
[6]   Feature selection for clustering - A filter solution [J].
Dash, M ;
Choi, K ;
Scheuermann, P ;
Liu, H .
2002 IEEE INTERNATIONAL CONFERENCE ON DATA MINING, PROCEEDINGS, 2002, :115-122
[7]   DISCRIMINATORY ANALYSIS - NONPARAMETRIC DISCRIMINATION - CONSISTENCY PROPERTIES [J].
FIX, E ;
HODGES, JL .
INTERNATIONAL STATISTICAL REVIEW, 1989, 57 (03) :238-247
[8]  
Guyon I., 2003, Journal of Machine Learning Research, V3, P1157, DOI 10.1162/153244303322753616
[9]   Quantum-inspired evolutionary algorithm for a class of combinatorial optimization [J].
Han, KH ;
Kim, JH .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2002, 6 (06) :580-593
[10]   Quantum computing: an introduction [J].
Hey, T .
COMPUTING & CONTROL ENGINEERING JOURNAL, 1999, 10 (03) :105-112