Enriched ant colony optimization and its application in feature selection

被引:47
作者
Forsati, Rana [1 ]
Moayedikia, Alireza [1 ,2 ]
Jensen, Richard [3 ]
Shamsfard, Mehrnoush [1 ]
Meybodi, Mohammad Reza [4 ]
机构
[1] Shahid Beheshti Univ, Fac Elect & Comp Engn, NLP Res Lab, Tehran, Iran
[2] Asia Pacific Univ, Dept Comp, Kuala Lumpur, Malaysia
[3] Aberystwyth Univ, Dept Comp Sci, Aberystwyth, Ceredigion, Wales
[4] Amirkabir Univ Technol, Dept Comp Engn & Informat Technol, Tehran, Iran
关键词
Ant colony optimization; Feature selection; Hybrid algorithms; Swarm intelligence; HYBRID GENETIC ALGORITHM; ATTRIBUTE REDUCTION; ROUGH SETS; SYSTEM;
D O I
10.1016/j.neucom.2014.03.053
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents a new variant of ant colony optimization (ACO), called enRiched Ant Colony Optimization (RACO). This variation tries to consider the previously traversed edges in the earlier executions to adjust the pheromone values appropriately and prevent premature convergence. Feature selection (FS) is the task of selecting relevant features or disregarding irrelevant features from data. In order to show the efficacy of the proposed algorithm, RACO is then applied to the feature selection problem. In the RACO-based feature selection (RACOFS) algorithm, it might be assumed that the proposed algorithm considers later features with a higher priority. Hence in another variation, the algorithm is integrated with a capability local search procedure to demonstrate that this is not the case. The modified RACO algorithm is able to find globally optimal solutions but suffers from entrapment in local optima. Hence, in the third variation, the algorithm is integrated with a local search procedure to tackle this problem by searching the vicinity of the globally optimal solution. To demonstrate the effectiveness of the proposed algorithms, experiments were conducted using two measures, kappa statistics and classification accuracy, on several standard datasets. The comparisons were made with a wide variety of other swarm-based algorithms and other feature selection methods. The results indicate that the proposed algorithms have superiorities over competitors. (C) 2014 Elsevier B.V. All rights reserved.
引用
收藏
页码:354 / 371
页数:18
相关论文
共 36 条
[1]   A maximum entropy approach to feature selection in knowledge-based authentication [J].
Chen, Ye ;
Liginlal, Divakaran .
DECISION SUPPORT SYSTEMS, 2008, 46 (01) :388-398
[2]   A rough set approach to feature selection based on ant colony optimization [J].
Chen, Yumin ;
Miao, Duoqian ;
Wang, Ruizhi .
PATTERN RECOGNITION LETTERS, 2010, 31 (03) :226-233
[3]   Improved binary particle swarm optimization using catfish effect for feature selection [J].
Chuang, Li-Yeh ;
Tsai, Sheng-Wei ;
Yang, Cheng-Hong .
EXPERT SYSTEMS WITH APPLICATIONS, 2011, 38 (10) :12699-12707
[4]  
Chyzhyk D., 2013, NEUROCOMPUTING NOV
[5]   A COEFFICIENT OF AGREEMENT FOR NOMINAL SCALES [J].
COHEN, J .
EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1960, 20 (01) :37-46
[6]  
Diao R, 2010, IEEE INT CONF FUZZY
[7]   Ant algorithms for discrete optimization [J].
Dorigo, M ;
Di Caro, G ;
Gambardella, LM .
ARTIFICIAL LIFE, 1999, 5 (02) :137-172
[8]   Ant system: Optimization by a colony of cooperating agents [J].
Dorigo, M ;
Maniezzo, V ;
Colorni, A .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 1996, 26 (01) :29-41
[9]   Feature selection for sentiment analysis based on content and syntax models [J].
Duric, Adnan ;
Song, Fei .
DECISION SUPPORT SYSTEMS, 2012, 53 (04) :704-711
[10]  
Forsati R., 2012, INT J COMPUT APPL TE, V43, P30