How to Develop, Validate, and Compare Clinical Prediction Models Involving Radiological Parameters: Study Design and Statistical Methods

被引:66
作者
Han, Kyunghwa [1 ,2 ]
Song, Kijun [3 ]
Choi, Byoung Wook [1 ,2 ]
机构
[1] Yonsei Univ, Coll Med, Severance Hosp, Dept Radiol, Seoul 03722, South Korea
[2] Yonsei Univ, Coll Med, Severance Hosp, Res Inst Radiol Sci, Seoul 03722, South Korea
[3] Yonsei Univ, Coll Med, Dept Biostat & Med Informat, 50-1 Yonsei Ro, Seoul 03722, South Korea
关键词
Prediction model; Prognosis; Diagnosis; Patient outcome; EXTERNAL VALIDATION; INTEGRATED DISCRIMINATION; INDIVIDUAL PROGNOSIS; INCREMENTAL VALUE; DIAGNOSIS TRIPOD; RISK SCORE; ROC CURVE; REGRESSION; EVENTS; PERFORMANCE;
D O I
10.3348/kjr.2016.17.3.339
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
Clinical prediction models are developed to calculate estimates of the probability of the presence/occurrence or future course of a particular prognostic or diagnostic outcome from multiple clinical or non-clinical parameters. Radiologic imaging techniques are being developed for accurate detection and early diagnosis of disease, which will eventually affect patient outcomes. Hence, results obtained by radiological means, especially diagnostic imaging, are frequently incorporated into a clinical prediction model as important predictive parameters, and the performance of the prediction model may improve in both diagnostic and prognostic settings. This article explains in a conceptual manner the overall process of developing and validating a clinical prediction model involving radiological parameters in relation to the study design and statistical methods. Collection of a raw dataset; selection of an appropriate statistical model; predictor selection; evaluation of model performance using a calibration plot, Hosmer-Lemeshow test and c-index; internal and external validation; comparison of different models using c-index, net reclassification improvement, and integrated discrimination improvement; and a method to create an easy-to-use prediction score system will be addressed. This article may serve as a practical methodological reference for clinical researchers.
引用
收藏
页码:339 / 350
页数:12
相关论文
共 57 条
  • [1] STATISTICS NOTES - ABSENCE OF EVIDENCE IS NOT EVIDENCE OF ABSENCE
    ALTMAN, DG
    BLAND, JM
    [J]. BRITISH MEDICAL JOURNAL, 1995, 311 (7003) : 485 - 485
  • [2] Automated variable selection methods for logistic regression produced unstable models for predicting acute myocardial infarction mortality
    Austin, PC
    Tu, JV
    [J]. JOURNAL OF CLINICAL EPIDEMIOLOGY, 2004, 57 (11) : 1138 - 1146
  • [3] Bootstrap methods for developing predictive models
    Austin, PC
    Tu, JV
    [J]. AMERICAN STATISTICIAN, 2004, 58 (02) : 131 - 137
  • [4] Austin PC, 2008, J CLIN EPIDEMIOL, V61, P1009
  • [5] Bossuyt PM, 2015, BMJ-BRIT MED J, V351, DOI [10.1136/bmj.h5527, 10.1148/radiol.2015151516, 10.1373/clinchem.2015.246280]
  • [6] Bossuyt PM, 2008, COCHRANE HDB SYSTEMA
  • [7] Sample size considerations for the external validation of a multivariable prognostic model: a resampling study
    Collins, Gary S.
    Ogundimu, Emmanuel O.
    Altman, Douglas G.
    [J]. STATISTICS IN MEDICINE, 2016, 35 (02) : 214 - 226
  • [8] Collins GS, 2015, J CLIN EPIDEMIOL, V68, P112, DOI [10.7326/M14-0697, 10.1038/bjc.2014.639, 10.1186/s12916-014-0241-z, 10.1136/bmj.g7594, 10.7326/M14-0698, 10.1016/j.jclinepi.2014.11.010, 10.1016/j.eururo.2014.11.025, 10.1002/bjs.9736]
  • [9] External validation of multivariable prediction models: a systematic review of methodological conduct and reporting
    Collins, Gary S.
    de Groot, Joris A.
    Dutton, Susan
    Omar, Omar
    Shanyinde, Milensu
    Tajar, Abdelouahid
    Voysey, Merryn
    Wharton, Rose
    Yu, Ly-Mee
    Moons, Karel G.
    Altman, Douglas G.
    [J]. BMC MEDICAL RESEARCH METHODOLOGY, 2014, 14
  • [10] Use and misuse of the receiver operating characteristic curve in risk prediction
    Cook, Nancy R.
    [J]. CIRCULATION, 2007, 115 (07) : 928 - 935