Optimal feature selection using distance-based discrete firefly algorithm with mutual information criterion

被引:43
作者
Zhang, Long [1 ,2 ]
Shan, Linlin [3 ]
Wang, Jianhua [1 ]
机构
[1] Harbin Normal Univ, Coll Comp Sci & Informat Engn, Harbin 150025, Heilongjiang, Peoples R China
[2] Harbin Inst Technol, Sch Comp Sci & Technol, Harbin 150001, Heilongjiang, Peoples R China
[3] Heilongjiang Univ, Sch Art, Harbin 150080, Heilongjiang, Peoples R China
基金
黑龙江省自然科学基金;
关键词
Feature selection; Firefly algorithm; Mutual information; Adaptive parameter; CLASSIFICATION; SEARCH;
D O I
10.1007/s00521-016-2204-0
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we investigate feature subset selection problem by a new self-adaptive firefly algorithm (FA), which is denoted as DbFAFS. In classical FA, it uses constant control parameters to solve different problems, which results in the premature of FA and the fireflies to be trapped in local regions without potential ability to explore new search space. To conquer the drawbacks of FA, we introduce two novel parameter selection strategies involving the dynamical regulation of the light absorption coefficient and the randomization control parameter. Additionally, as an important issue of feature subset selection problem, the objective function has a great effect on the selection of features. In this paper, we propose a criterion based on mutual information, and the criterion can not only measure the correlation between two features selected by a firefly but also determine the emendation of features among the achieved feature subset. The proposed approach is compared with differential evolution, genetic algorithm, and two versions of particle swarm optimization algorithm on several benchmark datasets. The results demonstrate that the proposed DbFAFS is efficient and competitive in both classification accuracy and computational performance.
引用
收藏
页码:2795 / 2808
页数:14
相关论文
共 41 条
  • [1] Al-Ani A., 2005, INT J COMPUTATIONAL, V2, P53
  • [2] [Anonymous], INT J BIOINSPIRED CO
  • [3] [Anonymous], 2004, Wiley InterScience electronic collection.
  • [4] [Anonymous], 2012, ARXIV12045165
  • [5] Firefly Algorithm for Cardinality Constrained Mean-Variance Portfolio Optimization Problem with Entropy Diversity Constraint
    Bacanin, Nebojsa
    Tuba, Milan
    [J]. SCIENTIFIC WORLD JOURNAL, 2014,
  • [6] USING MUTUAL INFORMATION FOR SELECTING FEATURES IN SUPERVISED NEURAL-NET LEARNING
    BATTITI, R
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 1994, 5 (04): : 537 - 550
  • [7] Defining a standard for particle swarm optimization
    Bratton, Daniel
    Kennedy, James
    [J]. 2007 IEEE SWARM INTELLIGENCE SYMPOSIUM, 2007, : 120 - +
  • [8] Improved binary PSO for feature selection using gene expression data
    Chuang, Li-Yeh
    Chang, Hsueh-Wei
    Tu, Chung-Jui
    Yang, Cheng-Hong
    [J]. COMPUTATIONAL BIOLOGY AND CHEMISTRY, 2008, 32 (01) : 29 - 38
  • [9] Coelho LD, 2011, IEEE C EVOL COMPUTAT, P517
  • [10] POSSIBLE ORDERINGS IN MEASUREMENT SELECTION PROBLEM
    COVER, TM
    VANCAMPENHOUT, JM
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1977, 7 (09): : 657 - 661