On mapping decision trees and neural networks

被引:29
作者
Setiono, R [1 ]
Leow, WK [1 ]
机构
[1] Natl Univ Singapore, Sch Comp, Singapore 119260, Singapore
关键词
decision trees; neural networks; pruning;
D O I
10.1016/S0950-7051(99)00009-X
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
There exist several methods for transforming decision trees to neural networks. These methods typically construct the networks by directly mapping decision nodes or rules to the neural units. As a result, the networks constructed are often larger than necessary. This article describes a pruning-based method for mapping decision trees to neural networks, which can compress the network by removing unimportant and redundant units and connections. In addition, equivalent decision trees extracted from the pruned networks are simpler than those induced by well-known algorithms such as ID3 and C4.5. (C) 1999 Elsevier Science B.V. All rights reserved.
引用
收藏
页码:95 / 99
页数:5
相关论文
共 11 条
[1]  
DATTATREYA GR, 1983, P IEEE C SYST MAN CY, P393
[2]   Initialization of neural networks by means of decision trees [J].
Ivanova, I ;
Kubat, M .
KNOWLEDGE-BASED SYSTEMS, 1995, 8 (06) :333-344
[3]  
PARK Y, 1994, P IEEE INT C NEUR NE, P94
[4]  
Quinlan J. R., 1986, Machine Learning, V1, P81, DOI 10.1023/A:1022643204877
[5]  
Quinlan J. R., 1987, Proceedings of the Fourth International Workshop on Machine Learning, P31
[6]   A DECISION THEORETIC APPROACH TO HIERARCHICAL CLASSIFIER DESIGN [J].
SCHUERMANN, J ;
DOSTER, W .
PATTERN RECOGNITION, 1984, 17 (03) :359-369
[7]   ENTROPY NETS - FROM DECISION TREES TO NEURAL NETWORKS [J].
SETHI, IK .
PROCEEDINGS OF THE IEEE, 1990, 78 (10) :1605-1613
[8]   NEURAL IMPLEMENTATION OF TREE CLASSIFIERS [J].
SETHI, IK .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1995, 25 (08) :1243-1249
[9]   A penalty-function approach for pruning feedforward neural networks [J].
Setiono, R .
NEURAL COMPUTATION, 1997, 9 (01) :185-204
[10]   USE OF A QUASI-NEWTON METHOD IN A FEEDFORWARD NEURAL-NETWORK CONSTRUCTION ALGORITHM [J].
SETIONO, R ;
HUI, LCK .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1995, 6 (01) :273-277