Optimization and analysis of decision trees and rules: dynamic programming approach

被引:12
作者
Alkhalid, Abdulaziz [1 ]
Amin, Talha [2 ]
Chikalov, Igor [2 ]
Hussain, Shahid [2 ]
Moshkov, Mikhail [2 ]
Zielosko, Beata [2 ,3 ]
机构
[1] Carleton Univ, Dept Syst & Comp Engn, Ottawa, ON K1S 5B6, Canada
[2] King Abdullah Univ Sci & Technol, Comp Elect & Math Sci & Engn Div, Thuwal, Saudi Arabia
[3] Univ Silesia, Inst Comp Sci, Sosnowiec, Poland
关键词
dynamic programming; decision trees; decision rules; optimization; ALGORITHMS; INDUCTION;
D O I
10.1080/03081079.2013.798902
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
This paper is devoted to the consideration of software system Dagger created in KAUST. This system is based on extensions of dynamic programming. It allows sequential optimization of decision trees and rules relative to different cost functions, derivation of relationships between two cost functions (in particular, between number of misclassifications and depth of decision trees), and between cost and uncertainty of decision trees. We describe features of Dagger and consider examples of this system's work on decision tables from UCI Machine Learning Repository. We also use Dagger to compare 16 different greedy algorithms for decision tree construction.
引用
收藏
页码:614 / 634
页数:21
相关论文
共 50 条
  • [1] Agrawal R., 1994, P 20 INT C VER LARG, P487, DOI DOI 10.5555/645920.672836
  • [2] Alkhalid A., 2013, EMERGING PARADIGMS M, V13, P11
  • [3] Alkhalid A., 2011, CSP2011: Proceedings of the International Workshop on Concurrency, Specification and Programming, P1
  • [4] Alkhalid A., 2011, COMPUTATIONAL INFORM, P29
  • [5] Alkhalid A, 2011, KDIR 2011: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND INFORMATION RETRIEVAL, P438
  • [6] Alkhalid A, 2011, LECT NOTES ARTIF INT, V6954, P178, DOI 10.1007/978-3-642-24425-4_25
  • [7] Alkhalid A, 2010, LECT NOTES ARTIF INT, V6401, P353, DOI 10.1007/978-3-642-16248-0_51
  • [8] Alkhalid A, 2010, LECT NOTES ARTIF INT, V6086, P438, DOI 10.1007/978-3-642-13529-3_47
  • [9] Amin T., 2011, 20 INT WORKSH CONC S, P10
  • [10] Amin T., 2013, ROUGH SETS INTELLIGE, VVolume 42, P211