Using and understanding cross-validation strategies Perspectives on Saeb et al

被引:105
作者
Little, Max A. [1 ]
Varoquaux, Gael [2 ]
Saeb, Sohrab [3 ]
Lonini, Luca [4 ]
Jayaraman, Arun [4 ]
Mohr, David C. [3 ]
Kording, Konrad P. [3 ,4 ]
机构
[1] Astun Univ, Dept Math, Birmingham B4 7ET, W Midlands, England
[2] CEA Saclay, Parietal, NeuroSpin, INRIA, Bat 145, F-91191 Gif Sur Yvette, France
[3] Northwestern Univ, Dept Prevent Med, 750 N Lake Shore Dr, Chicago, IL 60611 USA
[4] Rehabil Inst Chicago, 345 E Super, Chicago, IL 60611 USA
关键词
machine learning; clinical applications; cross-validation;
D O I
10.1093/gigascience/gix020
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
This three-part review takes a detailed look at the complexities of cross-validation, fostered by the peer review of Saeb et al.'s paper entitled "The need to approximate the use-case in clinical machine learning." It contains perspectives by reviewers and by the original authors that touch upon cross-validation: the suitability of different strategies and their interpretation.
引用
收藏
页数:6
相关论文
共 17 条
[1]  
Abraham A, 2016, NEUROIMAGE IN PRESS
[2]   Permutation tests for linear models [J].
Anderson, MJ ;
Robinson, J .
AUSTRALIAN & NEW ZEALAND JOURNAL OF STATISTICS, 2001, 43 (01) :75-88
[3]   A survey of cross-validation procedures for model selection [J].
Arlot, Sylvain ;
Celisse, Alain .
STATISTICS SURVEYS, 2010, 4 :40-79
[4]  
Blitzer J, 2008, NIPS P ADV NEURAL IN, V20
[5]   SUBMODEL SELECTION AND EVALUATION IN REGRESSION - THE X-RANDOM CASE [J].
BREIMAN, L ;
SPECTOR, P .
INTERNATIONAL STATISTICAL REVIEW, 1992, 60 (03) :291-319
[6]   Classifier technology and the illusion of progress [J].
Hand, David J. .
STATISTICAL SCIENCE, 2006, 21 (01) :1-14
[7]  
Hastie T., 2009, ELEMENTS STAT LEARNI, V2, DOI [10.1007/978-0-387-84858-7, DOI 10.1007/978-0-387-84858-7]
[8]  
Kaufman S., 2011, ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, P556, DOI [DOI 10.1145/2382577.2382579, 10.1145/2382577.2382579]
[9]  
Kohavi R., 1995, IJCAI-95. Proceedings of the Fourteenth International Joint Conference on Artificial Intelligence, P1137
[10]  
Liem F, 2016, NEUROIMAGE IN PRESS