The U.S. Department of Education recently granted Ohio relief from No Child Left Behind’s (NCLB) most awkward mandates. To receive this relief, Ohio was required to present a school accountability plan that would put its kids on a college- and career-ready path. Ohio’s NCLB waiver request proposes a revamped accountability system based on three indicators of school quality: (1) student achievement, (2) student growth, and (3) achievement gap closure. The three indicator scores (reported as percentages) are summed and averaged—each given equal weight—to determine a school’s overall performance.
The proposed system’s third indicator, gap closure, is a newly-conceived measure of how well nationally-defined student subgroups (e.g., racial, economically disadvantaged, special education, English language learners) perform on standardized tests compared to a state-designated baseline test score—an annual measureable objective (AMO). Any school building with more than 30 students in a subgroup must report its subgroup scores.
To gauge how well schools would perform under the proposed accountability system, the Ohio Department of Education (ODE) simulated schools’ performance using 2010-11 data. ODE’s simulated results, however, put into question the validity of the gap closure indicator, as currently designed.
The following charts show ODE’s simulated results. Consider the distribution of Ohio school buildings’ overall rating (Figure 1). The vertical axis indicates the number of school buildings that received a certain rating, and the horizontal axis shows the rating scale, which is expressed as a percentage. We observe that most school ratings fall within a relatively narrow band between 75 and 95...