Recent advances in decision trees: an updated survey

被引:223
作者
Costa, Vinicius G. [1 ]
Pedreira, Carlos E. [1 ]
机构
[1] Fed Univ Rio de Janeiro UFRJ, Syst Engn & Comp Sci Dept, Rio De Janeiro, Brazil
关键词
Decision trees; Machine learning; Interpretable models; Classification algorithms; STRUCTURED CLASSIFICATION; DISCRIMINANT-ANALYSIS; INDUCTION; MACHINE; ALGORITHMS; ENTROPY;
D O I
10.1007/s10462-022-10275-5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Decision Trees (DTs) are predictive models in supervised learning, known not only for their unquestionable utility in a wide range of applications but also for their interpretability and robustness. Research on the subject is still going strong after almost 60 years since its original inception, and in the last decade, several researchers have tackled key matters in the field. Although many great surveys have been published in the past, there is a gap since none covers the last decade of the field as a whole. This paper proposes a review of the main recent advances in DT research, focusing on three major goals of a predictive learner: issues regarding the fitting of training data, generalization, and interpretability. Moreover, by organizing several topics that have been previously analyzed in isolation, this survey attempts to provide an overview of the field, its key concerns, and future trends, serving as a good entry point for both researchers and newcomers to the machine learning community.
引用
收藏
页码:4765 / 4800
页数:36
相关论文
共 152 条
[1]   Single and multiple outputs decision tree classification using bi-level discrete-continues genetic algorithm [J].
Adibi, Mohammad Amin .
PATTERN RECOGNITION LETTERS, 2019, 128 :190-196
[2]  
Aghaei S, 2019, AAAI CONF ARTIF INTE, P1418
[3]  
Aglin G, 2020, AAAI CONF ARTIF INTE, V34, P3146
[4]  
Alvarez-Melis David, 2018, arXiv
[5]  
Amodei D, 2016, PR MACH LEARN RES, V48
[6]  
Angelino E, 2017, KDD'17: PROCEEDINGS OF THE 23RD ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, P35, DOI [arXiv:1704.01701, 10.1145/3097983.3098047]
[7]  
Avellaneda F, 2020, AAAI CONF ARTIF INTE, V34, P3195
[8]   Example-dependent cost-sensitive decision trees [J].
Bahnsen, Alejandro Correa ;
Aouada, Djamila ;
Ottersten, Bjoern .
EXPERT SYSTEMS WITH APPLICATIONS, 2015, 42 (19) :6609-6619
[9]   The number of classes as a source for instability of decision tree algorithms in high dimensional datasets [J].
Baranauskas, Jose Augusto .
ARTIFICIAL INTELLIGENCE REVIEW, 2015, 43 (02) :301-310
[10]  
Barros R. C., 2015, Encyclopedia of Membranes, DOI [10.1007/978-3-319-14231-9, DOI 10.1007/978-3-642-40872-41634]