External validation of SAPS 3 and MPM0-III scores in 48,816 patients from 72 Brazilian ICUs

被引:18
作者
Moralez, Giulliana Martines [1 ]
Cunha Farah Rabello, Ligia Sarmet [2 ,3 ]
Lisboa, Thiago Costa [4 ]
Andrade Lima, Mariza da Fonte [5 ]
Hatum, Rodrigo Marques [6 ]
Cesar De Marco, Fernando Vinicius [7 ]
Alves, Alessandra [8 ]
da Silva Soares Pinto, Jorge Eduardo [9 ]
Nunes de Araujo, Helia Beatriz [10 ]
Ramos, Grazielle Viana [11 ]
Silva, Aline Reis [11 ]
Fernandes, Guilherme Cortes [12 ]
Alves Faria, Guilherme Brenande [13 ]
Mendes, Ciro Leite [14 ]
Ramos Filho, Roberto Alvaro [15 ]
de Souza, Valdenia Pereira [16 ]
Alvarenga Americano do Brasil, Pedro Emmanuel [11 ,17 ]
Bozza, Fernando Augusto [11 ,17 ]
Figueira Salluh, Jorge Ibrain [2 ,18 ,19 ]
Soares, Marcio [2 ,18 ,19 ,20 ]
机构
[1] DOr Inst Res & Educ IDOR, Grad Program Translat Med, Rio De Janeiro, Brazil
[2] Univ Fed Rio de Janeiro, PPG Internal Med, Rio De Janeiro, Brazil
[3] Hosp Copa DOr, ICU, Rio De Janeiro, Brazil
[4] Santa Casa de Misericordia Porto Alegre, Complexo Hosp, Porto Alegre, RS, Brazil
[5] Hosp Esperanca Recife, ICU, Recife, PE, Brazil
[6] Hosp Total Cor, ICU, Rio De Janeiro, Brazil
[7] Hosp viValle, ICU, Sao Jose Dos Campos, Brazil
[8] Hosp Rios DOr, ICU, Rio De Janeiro, Brazil
[9] Hosp Norte DOr, ICU, Rio De Janeiro, Brazil
[10] Hosp Coracao Brasil, Brasilia, DF, Brazil
[11] DOr Inst Res & Educ IDOR, Dept Crit Care, Rio De Janeiro, Brazil
[12] Santa Casa Misericordia Juiz de Fora, ICU, Juiz De Fora, Brazil
[13] Hosp Oeste DOr, ICU, Rio De Janeiro, Brazil
[14] Hosp Univ Lauro Wanderley, ICU, Joao Pessoa, Paraiba, Brazil
[15] Hosp Sao Luiz, ICU, Unidade Jabaquara, Sao Paulo, Brazil
[16] Complexo Hosp Niteroi, Niteroi, RJ, Brazil
[17] Fundacao Oswaldo Cruz Fiocruz, Inst Nacl Infectol Evandro Chagas, Rio De Janeiro, Brazil
[18] DOr Inst Res & Educ IDOR, Dept Crit Care, Rio De Janeiro, Brazil
[19] DOr Inst Res & Educ IDOR, Grad Program Translat Med, Rio De Janeiro, Brazil
[20] DOr Inst Res & Educ, Dept Crit Care, Rua Diniz Cordeiro 30, BR-22281100 Rio De Janeiro, Brazil
来源
ANNALS OF INTENSIVE CARE | 2017年 / 7卷
关键词
Severity-of-illness scores; Validation; Intensive care units; Outcomes; Standardized mortality rate; INTENSIVE-CARE-UNIT; HOSPITAL MORTALITY; APACHE IV; PROGNOSTIC MODEL; ACUTE PHYSIOLOGY; PERFORMANCE; SEVERITY; COHORT;
D O I
10.1186/s13613-017-0276-3
中图分类号
R4 [临床医学];
学科分类号
1002 ; 100602 ;
摘要
Background: The performance of severity-of-illness scores varies in different scenarios and must be validated prior of being used in a specific settings and geographic regions. Moreover, models' calibration may deteriorate overtime and performance of such instruments should be reassessed regularly. Therefore, we aimed at to validate the SAPS 3 in a large contemporary cohort of patients admitted to Brazilian ICUs. In addition, we also compared the performance of the SAPS 3 with the MPM0-III. Methods: This is a retrospective cohort study in which 48,816 (medical admissions = 67.9%) adult patients are admitted to 72 Brazilian ICUs during 2013. We evaluated models' discrimination using the area under the receiver operating characteristic curve (AUROC). We applied the calibration belt to evaluate the agreement between observed and expected mortality rates (calibration). Results: Mean SAPS 3 score was 44.3 +/- 15.4 points. ICU and hospital mortality rates were 11.0 and 16.5%. We estimated predicted mortality using both standard (SE) and Central and South American (CSA) customized equations. Predicted mortality rates were 16.4 +/- 19.3% (SAPS 3-SE), 21.7 +/- 23.2% (SAPS 3-CSA) and 14.3 +/- 14.0% (MPM0-III). Standardized mortality ratios (SMR) obtained for each model were: 1.00 (95% CI, 0.98-0.102) for the SAPS 3-SE, 0.75 (0.74-0.77) for the SAPS 3-CSA and 1.15 (1.13-1.18) for the MPM0-III. Discrimination was better for SAPS 3 models (AUROC = 0.85) than for MPM0-III (AUROC = 0.80) (p < 0.001). We applied the calibration belt to evaluate the agreement between observed and expected mortality rates (calibration): the SAPS 3-CSA overestimated mortality throughout all risk classes while the MPM0-III underestimated it uniformly. The SAPS 3-SE did not show relevant deviations from ideal calibration. Conclusions: In a large contemporary database, the SAPS 3-SE was accurate in predicting outcomes, supporting its use for performance evaluation and benchmarking in Brazilian ICUs.
引用
收藏
页数:8
相关论文
共 27 条
  • [1] Alves Carlos José, 2009, Rev. bras. ter. intensiva, V21, P1
  • [2] Associacao de Medicina Intensiva Brasileira (AMIB), 2009, REG TECN FUNC UN TER
  • [3] A NEW METHOD OF CLASSIFYING PROGNOSTIC CO-MORBIDITY IN LONGITUDINAL-STUDIES - DEVELOPMENT AND VALIDATION
    CHARLSON, ME
    POMPEI, P
    ALES, KL
    MACKENZIE, CR
    [J]. JOURNAL OF CHRONIC DISEASES, 1987, 40 (05): : 373 - 383
  • [4] Performance of the third-generation models of severity scoring systems (APACHE IV, SAPS 3 and MPM-III) in acute kidney injury critically ill patients
    Costa e Silva, Veronica Torres
    de Castro, Isac
    Liano, Fernando
    Muriel, Alfonso
    Rodriguez-Palomares, Jose R.
    Yu, Luis
    [J]. NEPHROLOGY DIALYSIS TRANSPLANTATION, 2011, 26 (12) : 3894 - 3901
  • [5] de Oliveira VM, 2013, CLINICS, V68, P153, DOI [10.6061/clinics/2013(02)OA06, 10.6061/CLINICS/2013(02)OA06]
  • [6] COMPARING THE AREAS UNDER 2 OR MORE CORRELATED RECEIVER OPERATING CHARACTERISTIC CURVES - A NONPARAMETRIC APPROACH
    DELONG, ER
    DELONG, DM
    CLARKEPEARSON, DI
    [J]. BIOMETRICS, 1988, 44 (03) : 837 - 845
  • [7] Calibration Belt for Quality-of-Care Assessment Based on Dichotomous Outcomes
    Finazzi, Stefano
    Poole, Daniele
    Luciani, Davide
    Cogo, Paola E.
    Bertolini, Guido
    [J]. PLOS ONE, 2011, 6 (02):
  • [8] Assessing contemporary intensive care unit outcome:: An updated Mortality Probability Admission Model (MPM0-III)
    Higgins, Thomas L.
    Teres, Daniel
    Copes, Wayne S.
    Nathanson, Brian H.
    Stark, Maureen
    Kramer, Andrew A.
    [J]. CRITICAL CARE MEDICINE, 2007, 35 (03) : 827 - 835
  • [9] Severity of illness scoring systems in the intensive care unit
    Keegan, Mark T.
    Gajic, Ognjen
    Afessa, Bekele
    [J]. CRITICAL CARE MEDICINE, 2011, 39 (01) : 163 - 169
  • [10] Assessing the calibration of mortality benchmarks in critical care: The Hosmer-Lemeshow test revisited
    Kramer, Andrew A.
    Zimmerman, Jack E.
    [J]. CRITICAL CARE MEDICINE, 2007, 35 (09) : 2052 - 2056