Effective data mining using neural networks

被引:187
作者
Lu, HJ
Setiono, R
Liu, H
机构
[1] Department of Information Systems and Computer Science, National University of Singapore, Singapore 119260, Lower Kent Ridge Rd.
关键词
data mining; neural networks; rule extraction; network pruning; classification;
D O I
10.1109/69.553163
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Classification is one of the data mining problems receiving great attention recently in the database community. This paper presents an approach to discover symbolic classification rules using neural networks. Neural networks have not been thought suited for data mining because how the classifications were made is not explicitly stated as symbolic rules that are suitable for verification or interpretation by humans. With the proposed approach, concise symbolic rules with high accuracy can be extracted from a neural network. The network is first trained to achieve the required accuracy rate. Redundant connections of the network are then removed by a network pruning algorithm. The activation values of the hidden units in the network are analyzed, and classification rules are generated using the result of this analysis. The effectiveness of the proposed approach is clearly demonstrated by the experimental results on a set of standard data mining test problems.
引用
收藏
页码:957 / 961
页数:5
相关论文
共 10 条
  • [1] Agrawal R., 1993, IEEE T KNOWLEDGE DAT, V5
  • [2] [Anonymous], P 1995 INT C VER LAR
  • [3] Dennis, 1996, NUMERICAL METHODS UN
  • [4] LIU H, 1995, P IEEE INT C SYSTEMS
  • [5] Michie D., 1994, Technometrics, V37, P459, DOI DOI 10.2307/1269742
  • [6] Quinlan J. R., 1993, C4 5 PROGRAMS MACHIN
  • [7] QUINLAN JR, 1994, COMPUTATIONAL LEARNING THEORY AND NATURAL LEARNING SYSTEMS, VOL I: CONSTRAINTS AND PROSPECTS, P445
  • [8] Setiono R., 1995, Connection Science, V7, P147, DOI 10.1080/09540099550039327
  • [9] A penalty-function approach for pruning feedforward neural networks
    Setiono, R
    [J]. NEURAL COMPUTATION, 1997, 9 (01) : 185 - 204
  • [10] SYMBOLIC AND NEURAL LEARNING ALGORITHMS - AN EXPERIMENTAL COMPARISON
    SHAVLIK, JW
    MOONEY, RJ
    TOWELL, GG
    [J]. MACHINE LEARNING, 1991, 6 (02) : 111 - 143