Measurement Issues in High Stakes Testing: Validity and Reliability

Validity and reliability of the new high stakes testing systems initiated in school systems across the United States in recent years in response to the accountability features mandated in the No Child Left Behind Legislation largely depend on item response theory and new rules of measurement. Reliability and validity in item response theory and classical test theory are reviewed. Additionally, practices in the states are considered. The conclusion of the paper is that the new test technology is theoretically better suited to assess achievement than classical test theory, but has not been shown to be valid and reliable enough for use as the sole criterion for determination of what was learned in school. Further, there is no evidence that they will ever be found to be valid and reliable enough for that purpose. Areas of additional needed research are considered. (C) 2007 by The Haworth Press, Inc. All rights reserved.