Rule Extraction from Training Data Using Neural Network

被引:28
作者
Biswas, Saroj Kumar [1 ]
Chakraborty, Manomita [1 ]
Purkayastha, Biswajit [1 ]
Roy, Pinki [1 ]
Thounaojam, Dalton Meitei [1 ]
机构
[1] Natl Inst Technol, Comp Sci & Engn Dept, Silchar 788010, Assam, India
关键词
Data mining; artificial neural networks; rule extraction; pedagogical; RxREN algorithm; classification; TREE;
D O I
10.1142/S0218213017500063
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Data Mining is a powerful technology to help organization to concentrate on most important data by extracting useful information from large database. One of the most commonly used techniques in data mining is Artificial Neural Network due to its high performance in many application domains. Despite many advantages of Artificial Neural Network, one of its main drawbacks is its inherent black box nature which is the main problem of using Artificial Neural Network in data mining. Therefore, this paper proposes a rule extraction algorithm from neural network using classified and misclassified data to convert the black box nature of Artificial Neural Network into a white box. The proposed algorithm is a modification of the existing algorithm, Rule Extraction by Reverse Engineering (RxREN). The proposed algorithm extracts rules from trained neural network for datasets with mixed mode attributes using pedagogical approach. The proposed algorithm uses both classified as well as misclassified data to find out the data ranges of significant attributes in respective classes, which is the innovation of the proposed algorithm. The experimental results clearly show that the performance of the proposed algorithm is superior to existing algorithms.
引用
收藏
页数:26
相关论文
共 31 条
[1]  
Anbananthen SK., 2006, Inf Commun Technol, V1, P1350
[2]   Reverse Engineering the Neural Networks for Rule Extraction in Classification Problems [J].
Augasta, M. Gethsiyal ;
Kathirvalavakumar, T. .
NEURAL PROCESSING LETTERS, 2012, 35 (02) :131-150
[3]  
Bengio Y, 2000, IEEE T NEURAL NETWOR, V11, P545
[4]   Hybrid case-based reasoning system by cost-sensitive neural network for classification [J].
Biswas, Saroj Kr ;
Chakraborty, Manomita ;
Singh, Heisnam Rohen ;
Devi, Debashree ;
Purkayastha, Biswajit ;
Das, Akhil Kr .
SOFT COMPUTING, 2017, 21 (24) :7579-7596
[5]   Using neural networks for data mining [J].
Craven, MW ;
Shavlik, JW .
FUTURE GENERATION COMPUTER SYSTEMS, 1997, 13 (2-3) :211-229
[6]  
Craven MW, 1996, ADV NEUR IN, V8, P24
[7]   Orthogonal search-based rule extraction (OSRE) for trained neural networks: A practical and efficient approach [J].
Etchells, TA ;
Lisboa, PJG .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2006, 17 (02) :374-384
[8]   RULE GENERATION FROM NEURAL NETWORKS [J].
FU, LM .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1994, 24 (08) :1114-1124
[9]   Symbolic knowledge extraction from trained neural networks: A sound approach [J].
Garcez, ASD ;
Broda, K ;
Gabbay, DM .
ARTIFICIAL INTELLIGENCE, 2001, 125 (1-2) :155-207
[10]  
Han J., 2006, Data mining: Concepts and Techniques