Computational intelligence methods for rule-based data understanding

被引:130
作者
Duch, W [1 ]
Setiono, R
Zurada, JM
机构
[1] Nicholas Copernicus Univ, Dept Informat, PL-87100 Torun, Poland
[2] Nanyang Technol Univ, Sch Comp Engn, Singapore 639798, Singapore
[3] Natl Univ Singapore, Sch Comp, Singapore 119260, Singapore
[4] Univ Louisville, Dept Elect & Comp Engn, Louisville, KY 40292 USA
关键词
data mining; decision support; decision trees; feature selection; fuzzy systems; inductive learning; logical rule extraction; machine learning (ML); neural networks; neurofuzzy systems;
D O I
10.1109/JPROC.2004.826605
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In many applications, black-box prediction is not satisfactory, and understanding the data is of critical importance. Typically;, approaches useful for understanding of data involve logical rules, evaluate similarity to prototypes, or are based on visualization or graphical methods. This paper is focused on the extraction and use of logical rules for data understanding. All aspects of rule generation, optimization, and application ore described, including the problem of finding good symbolic descriptors for continuous data, tradeoffs between accuracy and simplicity at the rule-extraction stage, and tradeoffs between rejection and error level at the rule optimization stage. Stability of rule-based description, calculation of probabilities front rules, and other related issues are also discussed. Major approaches to extraction of logical rules based oil neural networks, decision trees, machine learning, and statistical methods are introduced. Optimization and application issues for sets of logical rules are described. Applications of such methods to benchmark and real-life problems are reported and illustrated with simple logical rules for many datasets. Challenges and new directions for research are outlined.
引用
收藏
页码:771 / 805
页数:35
相关论文
共 153 条
  • [81] Kanal L., 1988, SEARCH ARTIFICIAL IN
  • [82] KASABOV N, 1998, P 4 INT C NEUR NETW, P403
  • [83] Kasabov N.K., 1998, Foundations of Neural Networks, Fuzzy Systems, And Knowledge Engineering, V2nd
  • [84] KECMAN V, 2001, LEARNING SOFT COMPU
  • [85] KOHAVI R, 1996, P 2 INT C KNOWL DISC, P114
  • [86] KORDOS M, 2003, P INT C ART NEUR NET, P106
  • [87] KORDOS M, 2003, P INT C ART NEUR NET, P86
  • [88] Kosko B., 1992, NEURAL NETWORKS FUZZ
  • [89] How good are fuzzy if-then classifiers?
    Kuncheva, LI
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2000, 30 (04): : 501 - 509
  • [90] Langley P.W., 1987, Scientific Discovery: Computational Explorations of the Creative Process