Predicting death and lost to follow-up among adults initiating antiretroviral therapy in resource-limited settings: Derivation and external validation of a risk score in Haiti

Background Over 18 million adults have initiated life-saving antiretroviral therapy (ART) in resource-poor settings; however, mortality and lost-to-follow-up rates continue to be high among patients in their first year after treatment start. Clinical decision tools are needed to identify patients at high risk for poor outcomes in order to provide individualized risk assessment and intervention. This study aimed to develop and externally validate risk prediction tools that estimate the probability of dying or of being lost to follow-up (LTF) during the year after starting ART. Methods We used a derivation cohort of 7,031 adults age 15-70 years initiating ART from 2007 to 2013 at 6 clinics in Haiti; 242 (3.5%) had documented death and 1,521 (21.6%) were LTF at 1 year after starting ART. The following routinely collected data were used as predictors in two logistic regression models (one to predict death and another to predict LTF): age, gender, weight, CD4 count, WHO Stage, and diagnosis of tuberculosis (TB). The validation cohort consisted of 1,835 adults initiating ART at a different HIV clinic in Haiti during 2012. We assessed model discrimination by measuring the C-statistic, and measured model calibration by how closely the predicted probabilities approximated actual probabilities of the two outcomes. We derived a nomogram and a point-based risk score from the predictive models. Findings The model predicting death within the year after starting ART had a C-statistic of 0.75 (95% CI 0.74 to 0.81). There was no evidence for significant overfitting and the predictions were well calibrated. The strongest predictors of 1-year mortality were male gender, low weight, low CD4 count, advanced WHO stage, and the absence of TB. In the validation cohort, the C-statistic was 0.69 (95% CI 0.59 to 0.77). A point-based risk score for death had a C-statistic 0.73 (95% CI 0.69 to 0.76) and categorizes patients as low risk (< 2% risk of death), average risk (3-4%), and high-risk (8-10%) and very high-risk (14-19%) with likelihood ratios to be used in settings where the baseline risk is different from our study population. The model predicting LTF did not discriminate well (C-statistic 0.59). Conclusions A simple risk-score using routinely collected data can predict 1-year mortality after ART initiation for HIV-positive adults in Haiti. However, predicting lost to follow-up using routinely collected data was not as successful. The next step is to assess whether use of this risk score can identify patients who need tailored services to reduce mortality in resource-poor settings such as Haiti.