Feature selection using the hybrid of ant colony optimization and mutual information for the forecaster

被引:0
作者
Zhang, CK [1 ]
Hu, H [1 ]
机构
[1] Harbin Inst Technol, Shenzhen Grad Sch, Dept Mech Engn & Automat, Shenzhen, Peoples R China
来源
PROCEEDINGS OF 2005 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-9 | 2005年
关键词
feature selection; ANNs; ant colony optimization; mutual information;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Feature selection in the forecaster based on artificial neural network is a well-researehed problem, which can improve the network performance and speed up the training of the network. In this paper, we proposed an effective feature selection scheme called ACOMI, which utilizes the hybrid of ant colony optimization (ACO) and mutual information (MI). In this method, mutual information between each input and each output of the data set is employed in search process to purposefully guide search direction of every ant in ant system, and the parameter Exploit can adjust the balance between the ability of the cooperation among ants and the inherent ability to exploit. By examining the forecasters at the Australian Bureau of Meteorology, the simulation of three different methods of feature selection shows that ACOMI can reduce the dimensionality of inputs, speed up the training of the network and get better performance. In addition, the performance and cost time can be adjusted by the parameter of Exploit.
引用
收藏
页码:1728 / 1732
页数:5
相关论文
共 13 条
[1]  
Choi B, 2004, LECT NOTES COMPUT SC, V3029, P1
[2]   Variable selection with neural networks [J].
Cibas, T ;
Soulie, FF ;
Gallinari, P ;
Raudys, S .
NEUROCOMPUTING, 1996, 12 (2-3) :223-248
[3]  
Cover TM, 2006, Elements of Information Theory
[4]  
Dash M., 1997, Intelligent Data Analysis, V1
[5]  
DORIGO M, 2004, IEEE T EVOLUTIONARY, V8
[6]  
EMMANOUILIDIS C, 1999, ARTIFICIAL NEURAL NE, P749
[7]   INDEPENDENT COORDINATES FOR STRANGE ATTRACTORS FROM MUTUAL INFORMATION [J].
FRASER, AM ;
SWINNEY, HL .
PHYSICAL REVIEW A, 1986, 33 (02) :1134-1140
[8]  
HOLZ HJ, 1994, PATTERN RECOGN, V4, P473
[9]  
John GH, 1994, P 11 INT C MACH LEAR, P121, DOI 10.1016/B978-1-55860-335-6.50023-4
[10]   Input feature selection by mutual information based on Parzen window [J].
Kwak, N ;
Choi, CH .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (12) :1667-1671