Rule extraction from expert heuristics: A comparative study of rough sets with neural networks and ID3

被引:67
作者
Mak, B [1 ]
Munakata, T
机构
[1] San Francisco State Univ, Coll Business, Dept Informat Syst & Business Anal, San Francisco, CA 94132 USA
[2] Cleveland State Univ, Dept Comp & Informat Sci, Cleveland, OH 44115 USA
关键词
rough sets; neural networks; heuristics; rule extraction;
D O I
10.1016/S0377-2217(01)00062-5
中图分类号
C93 [管理学];
学科分类号
12 ; 1201 ; 1202 ; 120202 ;
摘要
The rule extraction capability of neural networks is an issue of interest to many researchers. Even though neural networks offer high accuracy in classification and prediction, there are criticisms on the complicated and non-linear transformation performed in the hidden layers. It is difficult to explain the relationships between inputs and outputs and derive simple rules governing the relationships between them. As alternatives, some researchers recommend the use of rough sets or ID3 for rule extraction. This paper reviews and compares the rule extraction capabilities of rough sets with neural networks and ID3. We apply the methods to analyze expert heuristic judgments. Strengths and weaknesses of the methods are compared, and implications for the use of the methods are suggested. (C) 2002 Elsevier Science B.V. All rights reserved.
引用
收藏
页码:212 / 229
页数:18
相关论文
共 68 条
[1]   DATABASE MINING - A PERFORMANCE PERSPECTIVE [J].
AGRAWAL, R ;
IMIELINSKI, T ;
SWAMI, A .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 1993, 5 (06) :914-925
[2]  
[Anonymous], 1998, ROUGH SETS KNOWLEDGE
[3]  
[Anonymous], 1998, ROUGH SETS KNOWLEDGE
[4]   Rough fuzzy MLP: Knowledge encoding and classification [J].
Banerjee, M ;
Mitra, S ;
Pal, SK .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1998, 9 (06) :1203-1216
[5]   Data mining: An overview from a database perspective [J].
Chen, MS ;
Han, JW ;
Yu, PS .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 1996, 8 (06) :866-883
[6]   NEURAL NETWORKS, DECISION TREE INDUCTION AND DISCRIMINANT-ANALYSIS - AN EMPIRICAL-COMPARISON [J].
CURRAM, SP ;
MINGERS, J .
JOURNAL OF THE OPERATIONAL RESEARCH SOCIETY, 1994, 45 (04) :440-450
[7]   ABSTRACT-DRIVEN PATTERN DISCOVERY IN DATABASES [J].
DHAR, V ;
TUZHILIN, A .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 1993, 5 (06) :926-938
[8]   Business failure prediction using rough sets [J].
Dimitras, AI ;
Slowinski, R ;
Susmaga, R ;
Zopounidis, C .
EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 1999, 114 (02) :263-280
[9]   Data mining and knowledge discovery in databases [J].
Fayyad, U ;
Uthurusamy, R .
COMMUNICATIONS OF THE ACM, 1996, 39 (11) :24-26
[10]   The KDD process for extracting useful knowledge from volumes of data [J].
Fayyad, U ;
PiatetskyShapiro, G ;
Smyth, P .
COMMUNICATIONS OF THE ACM, 1996, 39 (11) :27-34