The Structured Assessment of Violence Risk in Youth Demonstrates Measurement Invariance Between Black and White Justice-Referred Youths

Objective: Identification and implementation of effective methods for reducing racial/ethnic bias and disparities in legal settings are paramount in the United States and other countries. One procedure originally thought to reduce bias in legal decisions is the use of risk assessment instruments, which is now being heavily scrutinized. Measurement invariance, a latent trait technique, is a robust method for assessing one form of bias. Measurement invariance involves determining whether risk items in an instrument appear to be functioning the same between racial or other groups. Thus, the present study examined measurement invariance of the Structured Assessment of Violence Risk in Youth (SAVRY) between non-Latino Black and White youths to examine racial bias. Hypotheses: We expected the SAVRY to be invariant (lacking measurement bias) between Black and White youths. Method: The sample included 687 Black and 361 White youths, and the study used a large, multistate data set of SAVRYs conducted by probation officers. We conducted measurement invariance testing in a series of hierarchical steps including testing configural and scalar invariance. Results: The SAVRY demonstrated scalar invariance (equal thresholds for ratings from "low" to "moderate" and "moderate" to "high") for all items except one-community disorganization. Conclusions: The findings lend further credibility to the SAVRY, and the structured professional judgment approach, as a method to assess violence risk and case planning needs among youths involved in the legal system. These findings provide more confidence that significant differences in SAVRY risk level or items between Black and White youths are not based in measurement bias, with the exception of the community disorganization item. Potential fixes discussed include eliminating or deemphasizing this item in final risk level ratings.