Feature Subset Selection Based on Bio-Inspired Algorithms

被引:0
作者
Yun, Chulmin [1 ]
Oh, Byonghwa [1 ]
Yang, Jihoon [1 ]
Nang, Jongho [1 ]
机构
[1] Sogang Univ, Dept Comp Sci & Engn, Seoul 121742, South Korea
关键词
genetic algorithm; particle swarm optimization; feature redundancy and relevance; wrapper approach; inductive learning algorithm; CLASSIFICATION; INFORMATION;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Many feature subset selection algorithms have been proposed and discussed for years. However, the problem of finding the optimal feature subset from full data still remains to be a difficult problem. In this paper, we propose novel methods to find the relevant feature subset by using biologically-inspired algorithms such as Genetic Algorithm and Particle Swarm Optimization. We also propose a variant of the approach considering the significance of each feature. We verified the performance of the proposed methods by experiments with various real-world datasets. Our feature selection methods based on the biologically-inspired algorithms produced better performance than other methods in terms of the classification accuracy and the feature relevance. In particular, the modified method considering feature significance demonstrated even more improved performance.
引用
收藏
页码:1667 / 1686
页数:20
相关论文
共 34 条
  • [1] LEARNING BOOLEAN CONCEPTS IN THE PRESENCE OF MANY IRRELEVANT FEATURES
    ALMUALLIM, H
    DIETTERICH, TG
    [J]. ARTIFICIAL INTELLIGENCE, 1994, 69 (1-2) : 279 - 305
  • [2] [Anonymous], 1990, P 10 INT C PATT REC, DOI DOI 10.1109/ICPR.1990.118160
  • [3] [Anonymous], 1973, Pattern Classification and Scene Analysis
  • [4] [Anonymous], 2007, Uci machine learning repository
  • [5] [Anonymous], 2006, Pattern recognition and machine learning
  • [6] Selection of relevant features and examples in machine learning
    Blum, AL
    Langley, P
    [J]. ARTIFICIAL INTELLIGENCE, 1997, 97 (1-2) : 245 - 271
  • [7] Cherkassky V, 1997, IEEE Trans Neural Netw, V8, P1564, DOI 10.1109/TNN.1997.641482
  • [8] Claeskens G, 2008, J MACH LEARN RES, V9, P541
  • [9] Dash M., 1997, Intelligent Data Analysis, V1
  • [10] On the optimality of the simple Bayesian classifier under zero-one loss
    Domingos, P
    Pazzani, M
    [J]. MACHINE LEARNING, 1997, 29 (2-3) : 103 - 130