Reliability of Decision-Making Frameworks for Response to Intervention for Reading

The current study examines the consistency of two response-to-intervention (RTI) decision-making models. Weekly progress monitoring data for 30 students participating in a Tier II intervention were collected for 30 weeks. The data were examined by comparing them to an aimline with a yearly goal and by computing a dual discrepancy (DD) using numerical slope and postintervention reading level. A kappa coefficient was computed between the two models regarding student growth using three categorical decisions of making sufficient progress, not making sufficient progress, and exceeding expected progress. The resulting coefficient of .29 represents fair agreement. Data were also assigned to one of two sets in an every-other order, with resulting new aimlines and new DDs. The consistency between the two sets of data resulted in coefficients of kappa = .29 for aimline and kappa = .58 for DD. Finally, the standard error of measurement for the baseline data point affected the decision made (kappa = .13) for aimline but not for DD (kappa = .93). Implications for research, practice, and special education decision making are included.