Evaluation of clinical prediction models (part 2): how to undertake an external validation study

被引：59
|
作者：
Riley, Richard [1 ,2 ]
Archer, Lucinda [1 ,2 ]
Snell, Kym I. E. [1 ,2 ]
Ensor, Joie [1 ,2 ]
Dhiman, Paula [3 ]
Martin, Glen P. [4 ]
Bonnett, Laura J. [5 ]
Collins, Gary S. [3 ]
机构：
[1] Univ Birmingham, Inst Appl Hlth Res, Coll Med & Dent Sci, Birmingham B15 2TT, England
[2] Univ Birmingham, Natl Inst Hlth & Care Res NIHR, Birmingham Biomed Res Ctr, Birmingham, England
[3] Univ Oxford, Ctr Stat Med, Nuffield Dept Orthopaed Rheumatol & Musculoskeleta, Oxford, England
[4] Univ Manchester, Fac Biol Med & Hlth, Manchester Acad Hlth Sci Ctr, Div Informat Imaging & Data Sci, Manchester, Lancashire, England
[5] Univ Liverpool, Dept Biostat, Liverpool, England
来源：
BMJ-BRITISH MEDICAL JOURNAL | 2024年 / 384卷
基金：
英国工程与自然科学研究理事会; 英国医学研究理事会;
关键词：
DECISION CURVE ANALYSIS; PROGNOSTIC MODELS; MISSING DATA; RISK MODELS; ROC CURVES; CALIBRATION; IMPACT; RULES; TOOL; APPLICABILITY;
D O I：
10.1136/bmj-2023-074820
中图分类号：
R5 [内科学];
学科分类号：
1002 ; 100201 ;
摘要：
External validation studies are an important but often neglected part of prediction model research. In this article, the second in a series on model evaluation, Riley and colleagues explain what an external validation study entails and describe the key steps involved, from establishing a high quality dataset to evaluating a model's predictive performance and clinical usefulness.
引用
收藏
页数：12
相关论文
共 50 条
  • [41] External validation and comparison of four cardiovascular risk prediction models with data from the Australian Diabetes, Obesity and Lifestyle study
    Albarqouni, Loai
    Doust, Jennifer A.
    Magliano, Dianna
    Barr, Elizabeth L. M.
    Shaw, Jonathan E.
    Glasziou, Paul P.
    MEDICAL JOURNAL OF AUSTRALIA, 2019, 210 (04) : 161 - 167
  • [42] External validation and comparison of six cardiovascular risk prediction models in the Prospective Urban Rural Epidemiology (PURE)-Colombia study
    Lopez-Lopez, Jose P.
    Garcia-Pena, Angel A.
    Martinez-Bello, Daniel
    Gonzalez, Ana M.
    Perez-Mayorga, Maritza
    Velandia, Oscar Mauricio Munoz
    Ruiz-Uribe, Gabriela
    Campo, Alfonso
    Rangarajan, Sumathy
    Yusuf, Salim
    Lopez-Jaramillo, Patricio
    EUROPEAN JOURNAL OF PREVENTIVE CARDIOLOGY, 2024,
  • [43] Targeted validation: validating clinical prediction models in their intended population and setting
    Sperrin, Matthew
    Riley, Richard D.
    Collins, Gary S.
    Martin, Glen P.
    DIAGNOSTIC AND PROGNOSTIC RESEARCH, 2022, 6 (01)
  • [44] Development and validation of clinical prediction models for breast cancer incidence and mortality: a protocol for a dual cohort study
    Clift, Ashley Kieran
    Hippisley-Cox, Julia
    Dodwell, David
    Lord, Simon
    Brady, Mike
    Petrou, Stavros
    Collins, Gary S.
    BMJ OPEN, 2022, 12 (03): : e050828
  • [45] External Validation of Mortality Prediction Models for Critical Illness Reveals Preserved Discrimination but Poor Calibration
    Cox, Eline G. M.
    Wiersema, Renske
    Eck, Ruben J.
    Kaufmann, Thomas
    Granholm, Anders
    Vaara, Suvi T.
    Moller, Morten Hylander
    van Bussel, Bas C. T.
    Snieder, Harold
    Pleijhuis, Rick G.
    van der Horst, Iwan C. C.
    Keus, Frederik
    CRITICAL CARE MEDICINE, 2023, 51 (01) : 80 - 90
  • [46] A systematic review and external validation of stroke prediction models demonstrates poor performance in dialysis patients
    de Jong, Ype
    Ramspek, Chava L.
    van der Endt, Vera H. W.
    Rookmaaker, Maarten B.
    Blankestijn, Peter J.
    Vernooij, Robin W. M.
    Verhaar, Marianne C.
    Bos, Willem Jan W.
    Dekker, Friedo W.
    Ocak, Gurbey
    van Diepen, Merel
    JOURNAL OF CLINICAL EPIDEMIOLOGY, 2020, 123 : 69 - 79
  • [47] External validation of novel magnetic resonance imaging-based models for prostate cancer prediction
    Puellen, Lukas
    Radtke, Jan P.
    Wiesenfarth, Manuel
    Roobol, Monique J.
    Verbeek, Jan F. M.
    Wetter, Axel
    Guberina, Nika
    Pandey, Abhishek
    Huettenbrink, Clemens
    Tschirdewahn, Stephan
    Pahernik, Sascha
    Hadaschik, Boris A.
    Distler, Florian A.
    BJU INTERNATIONAL, 2020, 125 (03) : 407 - 416
  • [48] Predicting proliferative vitreoretinopathy: temporal and external validation of models based on genetic and clinical variables
    Rojas, Jimena
    Fernandez, Itziar
    Pastor, Jose C.
    MacLaren, Robert E.
    Ramkissoon, Yashin
    Harsum, Steven
    Charteris, David G.
    Van Meurs, Jan C.
    Amarakoon, Sankha
    Garcia-Arumi, Jose
    Ruiz-Moreno, Jose M.
    Rocha-Sousa, Amandio
    Brion, Maria
    Carracedo, Angel
    BRITISH JOURNAL OF OPHTHALMOLOGY, 2015, 99 (01) : 41 - 48
  • [49] Prediction models for development of retinopathy in people with type 2 diabetes: systematic review and external validation in a Dutch primary care setting
    van der Heijden, Amber A.
    Nijpels, Giel
    Badloe, Fariza
    Lovejoy, Heidi L.
    Peelen, Linda M.
    Feenstra, Talitha L.
    Moons, Karel G. M.
    Slieker, Roderick C.
    Herings, Ron M. C.
    Elders, Petra J. M.
    Beulens, Joline W.
    DIABETOLOGIA, 2020, 63 (06) : 1110 - 1119
  • [50] External validation of a clinical pharmacy intervention in geriatric inpatients: a controlled study
    Van der Linden, Lorenz
    Decoutere, Liesbeth
    Beerten, Leen
    Delva, Toon
    Spriet, Isabel
    Flamaing, Johan
    Tournoy, Jos
    INTERNATIONAL JOURNAL OF CLINICAL PHARMACY, 2019, 41 (04) : 853 - 858
12345