Extracting decision trees from trained neural networks

被引:70
|
作者
Krishnan, R [1 ]
Sivakumar, G [1 ]
Bhattacharya, P [1 ]
机构
[1] Indian Inst Technol, Dept Comp Sci & Engn, Bombay 400076, Maharashtra, India
关键词
rule extraction; decision trees; data mining; knowledge discovery; classification;
D O I
10.1016/S0031-3203(98)00181-2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper we present a methodology for extracting decision trees from input data generated from trained neural networks instead of doing it directly from the data. A genetic algorithm is used to query the trained network and extract prototypes. A prototype selection mechanism is then used to select a subset of the prototypes. Finally, a standard induction method like ID3 or C5.0 is used to extract the decision tree. The extracted decision trees can be used to understand the working of the neural network besides performing classification. This method is able to extract different decision trees of high accuracy and comprehensibility from the trained neural network. (C) 1999 Pattern Recognition Society. Published by Elsevier Science Ltd. All rights reserved.
引用
收藏
页码:1999 / 2009
页数:11
相关论文
共 50 条
  • [1] Extracting rules from trained neural networks
    Tsukimoto, H
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2000, 11 (02): : 377 - 389
  • [2] EXTRACTING RULES FROM TRAINED RBF NEURAL NETWORKS
    Grabusts, Peter
    ENVIRONMENT, TECHNOLOGY, RESOURCES, PROCEEDINGS, 2005, : 33 - 39
  • [3] CLASSIFICATION AND PREDICTION BY DECISION TREES AND NEURAL NETWORKS
    Prochazka, Michal
    Kouril, Lukas
    Zelinka, Ivan
    MENDELL 2009, 2009, : 177 - 181
  • [4] Extracting boolean and probabilistic rules from trained neural networks
    Liu, Pengyu
    Melkman, Avraham A.
    Akutsu, Tatsuya
    NEURAL NETWORKS, 2020, 126 (300-311) : 300 - 311
  • [5] Extracting Rules from Neural Networks as Decision Diagrams
    Chorowski, Jan
    Zurada, Jacek M.
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2011, 22 (12): : 2435 - 2446
  • [6] Extracting M-of-N rules from trained neural networks
    Setiono, R
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2000, 11 (02): : 512 - 519
  • [7] A Survey of Neural Trees: Co-Evolving Neural Networks and Decision Trees
    Li, Haoling
    Song, Jie
    Xue, Mengqi
    Zhang, Haofei
    Song, Mingli
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024,
  • [8] Survey and critique of techniques for extracting rules from trained artificial neural networks
    Andrews, R
    Diederich, J
    Tickle, AB
    KNOWLEDGE-BASED SYSTEMS, 1995, 8 (06) : 373 - 389
  • [9] On mapping decision trees and neural networks
    Setiono, R
    Leow, WK
    KNOWLEDGE-BASED SYSTEMS, 1999, 12 (03) : 95 - 99
  • [10] Effectively extracting rules from trained neural networks based on the characteristcs of the classification hypersurfaces
    Zhang, DX
    Liu, Y
    Wang, ZQ
    PROCEEDINGS OF 2005 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-9, 2005, : 1541 - 1546