Variable selection using random forests

被引:75
作者
Sandri, Marco [1 ]
Zuccolotto, Paola [1 ]
机构
[1] Univ Brescia, Dipartimento Metodi Quantitat, cda S Chiara 50, I-25122 Brescia, Italy
来源
DATA ANALYSIS, CLASSIFICATION AND THE FORWARD SEARCH | 2006年
关键词
D O I
10.1007/3-540-35978-8_30
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
One of the main topic in the development of predictive models is the identification of variables which axe predictors of a given outcome. Automated model selection methods, such as backward or forward stepwise regression, are classical solutions to this problem, but are generally based on strong assumptions about the functional form of the model or the distribution of residuals. In this paper an alternative selection method, based on the technique of Random Forests, is proposed in the context of classification, with an application to a real dataset.
引用
收藏
页码:263 / +
页数:2
相关论文
共 14 条
[1]   Bootstrap methods for developing predictive models [J].
Austin, PC ;
Tu, JV .
AMERICAN STATISTICIAN, 2004, 58 (02) :131-137
[2]  
Breiman L, 1996, ANN STAT, V24, P2350
[3]   Random forests [J].
Breiman, L .
MACHINE LEARNING, 2001, 45 (01) :5-32
[4]   Random forests [J].
Breiman, L .
MACHINE LEARNING, 2001, 45 (01) :5-32
[5]   Statistical modeling: The two cultures [J].
Breiman, L .
STATISTICAL SCIENCE, 2001, 16 (03) :199-215
[6]  
Breiman Leo, 2002, Manual on setting up, using, and understanding random forests v3. 1, V1, P58, DOI DOI 10.2776/85168
[7]   An experimental comparison of three methods for constructing ensembles of decision trees: Bagging, boosting, and randomization [J].
Dietterich, TG .
MACHINE LEARNING, 2000, 40 (02) :139-157
[8]  
Ennis M, 1998, STAT MED, V17, P2501
[9]   Risk assessment and prediction of rebleeding in bleeding gastroduodenal ulcer [J].
Guglielmi, A ;
Ruzzenente, A ;
Sandri, M ;
Kind, R ;
Lombardo, F ;
Rodella, L ;
Catalano, F ;
de Manzoni, G ;
Cordiano, C .
ENDOSCOPY, 2002, 34 (10) :778-786
[10]   ANALYSIS AND SELECTION OF VARIABLES IN LINEAR-REGRESSION [J].
HOCKING, RR .
BIOMETRICS, 1976, 32 (01) :1-49