Evaluation of clinical prediction models (part 2): how to undertake an external validation study

被引：59

作者：

Riley, Richard ^{[1
,2
]}

Archer, Lucinda ^{[1
,2
]}

Snell, Kym I. E. ^{[1
,2
]}

Ensor, Joie ^{[1
,2
]}

Dhiman, Paula ^{[3
]}

Martin, Glen P. ^{[4
]}

Bonnett, Laura J. ^{[5
]}

Collins, Gary S. ^{[3
]}

机构：

[1] Univ Birmingham, Inst Appl Hlth Res, Coll Med & Dent Sci, Birmingham B15 2TT, England

[2] Univ Birmingham, Natl Inst Hlth & Care Res NIHR, Birmingham Biomed Res Ctr, Birmingham, England

[3] Univ Oxford, Ctr Stat Med, Nuffield Dept Orthopaed Rheumatol & Musculoskeleta, Oxford, England

[4] Univ Manchester, Fac Biol Med & Hlth, Manchester Acad Hlth Sci Ctr, Div Informat Imaging & Data Sci, Manchester, Lancashire, England

[5] Univ Liverpool, Dept Biostat, Liverpool, England

来源：

BMJ-BRITISH MEDICAL JOURNAL | 2024年 / 384卷

基金：

英国工程与自然科学研究理事会; 英国医学研究理事会;

关键词：

DECISION CURVE ANALYSIS; PROGNOSTIC MODELS; MISSING DATA; RISK MODELS; ROC CURVES; CALIBRATION; IMPACT; RULES; TOOL; APPLICABILITY;

D O I：

10.1136/bmj-2023-074820

中图分类号：

R5 [内科学];

学科分类号：

1002 ; 100201 ;

摘要：

External validation studies are an important but often neglected part of prediction model research. In this article, the second in a series on model evaluation, Riley and colleagues explain what an external validation study entails and describe the key steps involved, from establishing a high quality dataset to evaluating a model's predictive performance and clinical usefulness.

引用

页数：12

共 50 条

[1] Evaluation of clinical prediction models (part 1): from development to external validation
Collins, Gary S.
Dhiman, Paula
Ma, Jie
Schlussel, Michael M.
Archer, Lucinda
Van Calster, Ben
Harrell Jr, Frank E.
Martin, Glen P.
Moons, Karel G. M.
van Smeden, Maarten
Sperrin, Matthew
Bullock, Garrett S.
Riley, Richard
BMJ-BRITISH MEDICAL JOURNAL, 2024, 384
[2] Evaluation of clinical prediction models (part 3): calculating the sample size required for an external validation study
Riley, Richard
Snell, Kym I. E.
Archer, Lucinda
Ensor, Joie
Debray, Thomas P. A.
Van Calster, Ben
van Smeden, Maarten
Collins, Gary S.
BMJ-BRITISH MEDICAL JOURNAL, 2024, 384
[3] Clinical prediction models for bronchopulmonary dysplasia: a systematic review and external validation study
Wes Onland
Thomas P Debray
Matthew M Laughon
Martijn Miedema
Filip Cools
Lisa M Askie
Jeanette M Asselin
Sandra A Calvert
Sherry E Courtney
Carlo Dani
David J Durand
Neil Marlow
Janet L Peacock
J Jane Pillow
Roger F Soll
Ulrich H Thome
Patrick Truffert
Michael D Schreiber
Patrick Van Reempts
Valentina Vendettuoli
Giovanni Vento
Anton H van Kaam
Karel G Moons
Martin Offringa
BMC Pediatrics, 13
[4] Clinical prediction models for bronchopulmonary dysplasia: a systematic review and external validation study
Onland, Wes
Debray, Thomas P.
Laughon, Matthew M.
Miedema, Martijn
Cools, Filip
Askie, Lisa M.
Asselin, Jeanette M.
Calvert, Sandra A.
Courtney, Sherry E.
Dani, Carlo
Durand, David J.
Marlow, Neil
Peacock, Janet L.
Pillow, J. Jane
Soll, Roger F.
Thome, Ulrich H.
Truffert, Patrick
Schreiber, Michael D.
Van Reempts, Patrick
Vendettuoli, Valentina
Vento, Giovanni
van Kaam, Anton H.
Moons, Karel G.
Offringa, Martin
BMC PEDIATRICS, 2013, 13
[5] Minimum sample size for external validation of a clinical prediction model with a continuous outcome
Archer, Lucinda
Snell, Kym I. E.
Ensor, Joie
Hudda, Mohammed T.
Collins, Gary S.
Riley, Richard D.
STATISTICS IN MEDICINE, 2021, 40 (01) : 133 - 146
[6] Minimum sample size for external validation of a clinical prediction model with a binary outcome
Riley, Richard D.
Debray, Thomas P. A.
Collins, Gary S.
Archer, Lucinda
Ensor, Joie
van Smeden, Maarten
Snell, Kym I. E.
STATISTICS IN MEDICINE, 2021, 40 (19) : 4230 - 4251
[7] External validation and clinical utility of prognostic prediction models for gestational diabetes mellitus: A prospective cohort study
Meertens, Linda J. E.
Scheepers, Hubertina C. J.
van Kuijk, Sander M. J.
Roeleveld, Nel
Aardenburg, Robert
van Dooren, Ivo M. A.
Langenveld, Josje
Zwaan, Iris M.
Spaanderman, Marc E. A.
van Gelder, Marleen M. H. J.
Smits, Luc J. M.
ACTA OBSTETRICIA ET GYNECOLOGICA SCANDINAVICA, 2020, 99 (07) : 891 - 900
[8] A new framework to enhance the interpretation of external validation studies of clinical prediction models
Debray, Thomas P. A.
Vergouwe, Yvonne
Koffijberg, Hendrik
Nieboer, Daan
Steyerberg, Ewout W.
Moons, Karel G. M.
JOURNAL OF CLINICAL EPIDEMIOLOGY, 2015, 68 (03) : 280 - 289
[9] Assessing Discriminative Performance at External Validation of Clinical Prediction Models
Nieboer, Daan
van der Ploeg, Tjeerd
Steyerberg, Ewout W.
PLOS ONE, 2016, 11 (02):
[10] Prediction Models for Clinical Outcome After a Carotid Revascularization Procedure: An External Validation Study
Volkers, Eline J.
Algra, Ale
Kappelle, L. Jaap
Jansen, Olav
Howard, George
Hendrikse, Jeroen
Halliday, Alison
Gregson, John
Fraedrich, Gustav
Eckstein, Hans-Henning
Calvet, David
Bulbulia, Richard
Brown, Martin M.
Becquemin, Jean-Pierre
Ringleb, Peter A.
Mas, Jean-Louis
Bonati, Leo H.
Brott, Thomas G.
Greving, Jacoba P.
STROKE, 2018, 49 (08) : 1880 - 1885

← 1 2 3 4 5 →