Background This study assessed the validity, sensitivity, and specificity of the Substance Use Risk Profile Scale (SURPS), a measure of personality risk factors for substance use and other behavioral problems in adolescence. Methods The concurrent and predictive validity of the SURPS was tested in a sample of 1,162 adolescents (mean age: 13.7 years) using linear and logistic regressions, while its sensitivity and specificity were examined using the receiver operating characteristics curve analyses. Results Concurrent and predictive validity tests showed that all 4 brief scaleshopelessness (H), anxiety sensitivity (AS), impulsivity (IMP), and sensation seeking (SS)were related, in theoretically expected ways, to measures of substance use and other behavioral and emotional problems. Results also showed that when using the 4 SURPS subscales to identify adolescents at risk, one can identify a high number of those who developed problems (high sensitivity scores ranging from 72 to 91%). And, as predicted, because each scale is related to specific substance and mental health problems, good specificity was obtained when using the individual personality subscales (e.g., most adolescents identified at high risk by the IMP scale developed conduct or drug use problems within the next 18 months [a high specificity score of 70 to 80%]). Conclusions The SURPS is a valuable tool for identifying adolescents at high risk for substance misuse and other emotional and behavioral problems. Implications of findings for the use of this measure in future research and prevention interventions are discussed.