Determining the relevance of input features for multilayer perceptrons

被引:0
作者
Zeng, XQ [1 ]
Huang, YJ [1 ]
Yeung, DS [1 ]
机构
[1] Hohai Univ, Nanjing, Peoples R China
来源
2003 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS, VOLS 1-5, CONFERENCE PROCEEDINGS | 2003年
关键词
neural networks; multilayer perceptron; input feature; relevance; sensitivity;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
dThis paper presents an approach to determine the relevance of individual input attributes for trained Multilayer Perceptrons (MLPS). To reflect the impact of an input attribute on the output of an MLP, the relevance is aimed at representing the output sensitivity of the MLP to the attribute variation. The sensitivity is defined as the mathematical expectation of output deviations of an MLP due to its input deviation with respect to overall input patterns. The basic idea for the introduction of such a relevance measure is that a well-trained MLP can capture salient features of the problem it deals with and thus become more sensitive to those input attributes that make more contributions to the MLP's behavior. The relevance can be employed as a relative criterion for assessing individual input attributes. The results from the experiments on two typical problems demonstrate the effectiveness of the relevance in identifying irrelevant input attribute.
引用
收藏
页码:874 / 879
页数:6
相关论文
共 15 条
[1]   USING MUTUAL INFORMATION FOR SELECTING FEATURES IN SUPERVISED NEURAL-NET LEARNING [J].
BATTITI, R .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1994, 5 (04) :537-550
[2]   DETERMINING INPUT FEATURES FOR MULTILAYER PERCEPTRONS [J].
BELUE, LM ;
BAUER, KW .
NEUROCOMPUTING, 1995, 7 (02) :111-121
[3]   Assessing the importance of features for multi-layer perceptrons [J].
Egmont-Petersen, M ;
Talmon, JL ;
Hasman, A ;
Ambergen, AW .
NEURAL NETWORKS, 1998, 11 (04) :623-635
[4]  
Engelbrecht AP, 2001, IEEE IJCNN, P2019, DOI 10.1109/IJCNN.2001.938474
[5]  
KARNIN ED, 1990, IEEE T NEURAL NETWOR, V1, P293
[6]   Input feature selection for classification problems [J].
Kwak, N ;
Choi, CH .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2002, 13 (01) :143-159
[7]  
Mozer M. C., 1989, ADV NEURAL INFORMATI, P107
[8]  
Robel A., 1994, ICANN '94. Proceedings of the International Conference on Artificial Neural Networks, P643
[9]   Neural-network feature selector [J].
Setiono, R ;
Liu, H .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1997, 8 (03) :654-662
[10]   Improved feature screening in feedforward neural networks [J].
Steppe, JM ;
Bauer, KW .
NEUROCOMPUTING, 1996, 13 (01) :47-58