External validation of the Madrid Acute Kidney Injury Prediction Score

Background. The Madrid Acute Kidney Injury Prediction Score (MAKIPS) is a recently described tool capable of performing automatic calculations of the risk of hospital-acquired acute kidney injury (HA-AKI) using data from from electronic clinical records that could be easily implemented in clinical practice. However, to date, it has not been externally validated. The aim of our study was to perform an external validation of the MAKIPS in a hospital with different characteristics and variable case mix. Methods. This external validation cohort study of the MAKIPS was conducted in patients admitted to a single tertiary hospital between April 2018 and September 2019. Performance was assessed by discrimination using the area under the receiver operating characteristics curve and calibration plots. Results. A total of 5.3% of the external validation cohort had HA-AKI. When compared with the MAKIPS cohort, the validation cohort showed a higher percentage of men as well as a higher prevalence of diabetes, hypertension, cardiovascular disease, cerebrovascular disease, anaemia, congestive heart failure, chronic pulmonary disease, connective tissue diseases and renal disease, whereas the prevalence of peptic ulcer disease, liver disease, malignancy, metastatic solid tumours and acquired immune deficiency syndrome was significantly lower. In the validation cohort, the MAKIPS showed an area under the curve of 0.798 (95% confidence interval 0.788-0.809). Calibration plots showed that there was a tendency for the MAKIPS to overestimate the risk of HA-AKI at probability rates ?0.19 and to underestimate at probability rates between 0.22 and 0.67. Conclusions. The MAKIPS can be a useful tool, using data that are easily obtainable from electronic records, to predict the risk of HA-AKI in hospitals with different case mix characteristics.