Lossless fitness inheritance in genetic algorithms for decision trees

被引:14
作者
Kalles, Dimitris [1 ,2 ]
Papagelis, Athanasios [3 ]
机构
[1] Hellen Open Univ, Patras, Greece
[2] Open Univ Cyprus, Nicosia, Cyprus
[3] Univ Patras, Dept Comp Engn & Informat, Patras, Greece
关键词
Decision trees; Genetic algorithms; Fitness inheritance; Fitness approximation; Learning speedup; CLASSIFICATION;
D O I
10.1007/s00500-009-0489-y
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
When genetic algorithms are used to evolve decision trees, key tree quality parameters can be recursively computed and re-used across generations of partially similar decision trees. Simply storing instance indices at leaves is sufficient for fitness to be piecewise computed in a lossless fashion. We show the derivation of the (substantial) expected speedup on two bounding case problems and trace the attractive property of lossless fitness inheritance to the divide-and-conquer nature of decision trees. The theoretical results are supported by experimental evidence.
引用
收藏
页码:973 / 993
页数:21
相关论文
共 46 条
  • [1] Altenberg L., 1997, Handbook of Evolutionary Computation, pB2.7:5
  • [2] [Anonymous], 2007, Uci machine learning repository
  • [3] [Anonymous], CI7699 U DORTM
  • [4] SmcHD1, containing a structural-maintenance-of-chromosomes hinge domain, has a critical role in X inactivation
    Blewitt, Marnie E.
    Gendrel, Anne-Valerie
    Pang, Zhenyi
    Sparrow, Duncan B.
    Whitelaw, Nadia
    Craig, Jeffrey M.
    Apedaile, Anwyn
    Hilton, Douglas J.
    Dunwoodie, Sally L.
    Brockdorff, Neil
    Kay, Graham F.
    Whitelaw, Emma
    [J]. NATURE GENETICS, 2008, 40 (05) : 663 - 669
  • [5] BOT M, 2000, P GEN EV COMP C LAS
  • [6] Random forests
    Breiman, L
    [J]. MACHINE LEARNING, 2001, 45 (01) : 5 - 32
  • [7] Inducing oblique decision trees with evolutionary algorithms
    Cantú-Paz, E
    Kamath, C
    [J]. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2003, 7 (01) : 54 - 68
  • [8] CATLETT J, 1992, P 9 INT C MACH LEARN, P49
  • [9] Piecewise linear classifiers using binary tree structure and genetic algorithm
    Chai, BB
    Huang, T
    Zhuang, XH
    Zhao, YX
    Sklansky, J
    [J]. PATTERN RECOGNITION, 1996, 29 (11) : 1905 - 1917
  • [10] EHRENBURGH H, 1996, P 1 GEN PROGR C