Evaluation of the D.C. Opportunity Scholarship Program: Impacts After Three Years
April 14, 2009
Patrick Wolf, Babette Gutmann, Michael Puma, Brian Kisida, Lou Rizzo, Nada Eissa
Institute of Education Sciences
Amid all the sound and fury surrounding the D.C. voucher program, this study is a significant feather in the cap of the program's supporters. Why? Because despite the study's rigorous methods (a gold-standard, randomized, controlled trial, which usually finds "no effect"-see here), students offered a voucher were performing at statistically higher levels in reading after three years (equivalent to a 3.1 month gain) than students not offered a scholarship. The reading finding is even more striking since the treatment group was highly mobile-a factor that likely contributed to the null findings in years one and two.
Unsurprisingly, both groups performed similarly in math and the program did not have a significant impact in reading or math for those students who applied from the worst-performing public schools. While this latter finding is unfortunate and has been cited as reason to shut down the program, we should remember that students coming from the very worst schools are the hardest to remediate and require the most time to do so. This study only measures three years.
The researchers also discovered that the voucher program had improved reading achievement for five subgroups: students not previously attending a school in need of improvement, those with higher levels of performance at time of entry into the program, those entering grades K-8 when they applied (i.e., everyone but high school students), female students, and first-year students (though these last two are less reliable than the other three). Read the report here.