Flypaper

Editor's note: This post is the sixth and final entry in an ongoing discussion between Fordham's Michael Petrilli and the University of Arkansas's Jay Greene that seeks to answer this question: Are math and reading test results strong enough indicators of school quality that regulators can rely on them to determine which schools should be closed and which should be expanded—even if parental demand is inconsistent with test results? Prior entries can be found herehereherehere, and here.

Shoot, Jay, maybe I should have quit while we were ahead—or at least while we were closer to rapprochement.

Let me admit to being perplexed by your latest post, which has an Alice in Wonderland aspect to it—a suggestion that down is up and up is down. “Short-term changes in test scores are not very good predictors of success,” you write. But that’s not at all what the research I’ve pointed to shows.

Start with the David Deming study of Texas’s 1990s-era accountability system. Low-performing Lone Star State schools faced low ratings and responded by doing something to boost the achievement of their low-performing students. That yielded short-term test-score gains, which were related to positive long-term outcomes. This is the sort of thing we’d...

Editor's note: This post is the fifth in an ongoing discussion between Fordham's Michael Petrilli and the University of Arkansas's Jay Greene that seeks to answer this question: Are math and reading test results strong enough indicators of school quality that regulators can rely on them to determine which schools should be closed and which should be expanded—even if parental demand is inconsistent with test results? Prior entries can be found hereherehere, and here.

Mike, you say that we agree on the limitations of using test results for judging school quality, but I’m not sure how true that is. In order not to get too bogged down in the details of that question, I’ll try to keep this reply as brief as possible.

First, the evidence you’re citing actually supports the opposite of what you are arguing. You mention the Project Star study showing that test scores in kindergarten correlated with later life outcomes as proof that test scores are reliable indicators of school or program quality. But you don’t emphasize an important point: Whatever benefits students experienced in kindergarten that resulted in higher test scores, they did not cause higher test scores in later grades—even though they produced better later-life outcomes....

I have two requests. The first is modest. The second is…well, let’s focus on the first for the time being.

Please go to your calendar and block off thirty minutes. You can call the item “Districts and the Achievement Gap.” It’s easy work; you’ll just need to do look at some pictures.

A new project by a team of researchers associated with Stanford’s Center for Education Policy Analysis has produced a database that includes school district test scores, poverty rates, and racial demographics (report on the database’s creation here).

short article in the New York Times explains some of the findings that emerge when you start analyzing the data. But the major contributions of the article are its two interactive graphics.

The first displays the well-known relationship between family income and student achievement: Students from more affluent families have higher average achievement levels. The upshot, per the article, is that “children in the school districts with the highest concentrations of poverty score an average of more than four grade levels below children in the richest districts.” The graphic allows you to search for any traditional school district in America. I did a quick comparison of one of New Jersey’s highest-performing and one of...

Editor's note: This post is the fourth in an ongoing discussion between Fordham's Michael Petrilli and the University of Arkansas's Jay Greene that seeks to answer this question: Are math and reading test results strong enough indicators of school quality that regulators can rely on them to determine which schools should be closed and which should be expanded—even if parental demand is inconsistent with test results? Prior entries can be found herehere, and here.

I think we’re approaching the outline of a consensus, Jay—at least regarding the most common situations in the charter quality debate. We both agree that closing low-performing schools is something to be done with great care, and with broad deference to parents. Neither of us wants “distant regulators” to pull the trigger based on test scores alone. And we both find it unacceptable that some states still use test score levels as measures of school quality.

I think you’re right that in the vast majority of cases, charter schools that are closed by their authorizers are weak academically and financially. Parents have already started to “vote with their feet,” leaving the schools under-enrolled and financially unsustainable. Closures, then, are akin to euthanasia. That’s certainly been our experience at...

Under President Obama’s stewardship, initiatives to expand access to high-quality early childhood programs have sparked heated political debate. Aiming to ground policy makers and education leaders in this conversation, a recent report from the American Enterprise Institute examines the effectiveness of early childhood education by analyzing and summarizing studies of the country’s ten best-known pre-K programs. It finds that high-quality pre-K works for some students, but the research is inconclusive as to whether it’s beneficial for all.

The report starts with an overview of the four most common research methodologies used to evaluate pre-K programs. These include assessing a program’s long-term impact with Randomized Control Trials, i.e., randomly assigning students to either a program (treatment) or non-program (control) group to measure differences in outcomes; comparing results for participating pre-K students against those for children who were eligible for pre-K but did not enroll; comparing results for participating students with a comparison group based on observable characteristics; and comparing outcomes for pre-K participants before and after the program.

One of the most positive takeaways from the research is that low-income children reap short-term and long-term benefits from high-quality pre-K programs. In Boston’s program, for example, students eligible for free or reduced-price lunch showed...

Previous research has found that oversubscribed urban charter schools produce large academic gains for their students. But are these results related to test score inflation (defined by one assessment expert as increases in scores that do not signal a commensurate increase in proficiency in the domain of interest)? In other words, do these schools merely figure out how to prepare their students to do well on the high-stakes exam, or are they contributing to real learning writ large?

To explore this question, a recent study examines state testing data from 2006 to 2011 at nine Boston middle school charters with lottery-based admissions. By exploiting the random nature of the lottery system, prior studies have found that these schools produce substantial learning gains on the Massachusetts Comprehensive Assessment System (MCAS).

To carry out the analysis, author Sarah Cohodes breaks down the learning gains by the various components of the state assessment—akin to how one might disaggregate overall gains by student subgroup. A math assessment might contain several different testing domains (e.g., geometry versus statistics), with some topics being tested more frequently than others. Cohodes’s hypothesis is as follows: If the gains are attributable to score inflation, we might expect to see stronger results on...

This new research report from Educational Testing Services is a solid contribution to the evidence base—rather than the opinion base—about the so-called “opt-out” movement. Author Randy E. Bennett finds that parents’ refusal to let their children sit for standardized tests is “a complicated, politically charged issue made more so by its social class and racial/ethnic associations. It is also an issue that appears to be as much about test use as about tests themselves.”

Opt-out true believers will likely dismiss out of hand anything coming from a testing outfit. but they ought to take a long look. The report does a good job synthesizing data from both the national and state departments of education, published surveys, and other sources to put between two covers exactly what is known—and can be sensibly divined—about who is opting out and why. “Parents who opt their children out appear to represent a distinct subpopulation,” the report notes. In New York, for example, “opt-outs were more likely to be white and not to have achieved proficiency on the previous year’s state examinations.” Test refusers are also less likely to be poor or to attend a school district serving large numbers of low-income families or ELL students. None...

This is the first in a series of essays marking the twenty-fifth anniversary of America’s first charter school law. These commentaries are informed and inspired by our forthcoming book (co-authored with Bruno V. Manno), Charter Schools at the Crossroads: Predicaments, Paradoxes, Possibilities, to be published this fall by Harvard Education Press. Read the other essays here, here, here, and here.

Next month marks the twenty-fifth anniversary of the enactment of America’s first charter school law, which Minnesota Governor Arne Carlson signed on June 4, 1991. This statute birthed a sector that has become not just a source of new schools for kids who need them, but also a structural reform of public education’s governance and delivery systems. It’s as close as K–12 schooling has come to what Clayton Christenson calls “disruptive innovation.”

This is worth celebrating—and charter advocates across the country have planned many festivities and events. But as we applaud this movement and the bold Minnesota lawmakers who launched it, let’s also recall what led up to it and, one might say, made it almost inevitable.

The onset of chartering was no lightning bolt. This audacious innovation had multiple ancestors and antecedents. School choice...

Dave Yost

I am a conflicted man.

Professionally, I lead Ohio’s auditing staff, a team of financial experts whose job it is to verify that tax dollars are being properly spent and to root out any misuse or theft of public money. That includes charter school spending.

Yet personally, I’m a strong proponent of the charter school movement. I believe in the lifetime benefits of school choice and affording all parents the ability to choose the school that will best serve their children.

My friends sometimes question how I can be so tough on charters when I personally support them. The answer, I tell them, is simple: We don’t play favorites. We can’t. We shouldn’t. Doing so would erode the public’s trust in our office, which we must faithfully and ardently protect. To ignore the misdeeds of the few problem charters would stain the great work of many. Turning a blind eye to the problems in a charter school, or any school, would mean that we failed our children, which is never an option.

It’s a conflict that public officials often face when their official duties require them to make decisions running counter to their personal beliefs.

The mission of the auditor...

Joan Franklin Smutny

Although we consider creativity and critical thinking two of the most important skills today, children often have limited opportunities to flex their creative muscles. Parents and teachers need to encourage creative children to find at least one outlet, along with venues and audiences to showcase their work. With summer on the way, now is the right time for parents and teachers to help gifted children look for ways to expand their creative horizons.

The International Torrance Legacy Creativity Awards competition is one way gifted children ages from ages eight to eighteen can nurture their inventiveness in the areas of writing, visual arts, musical composition, and inventions. Judged by professionals in those fields, the competition (now in its eighth year) has grown to include original submissions from hundreds of students around the world, including Australia, Bahrain, China, New Zealand, Poland, Singapore, South Korea, Turkey, and the United States.

The awards honor the fundamental contributions of psychologist E. Paul Torrance (1915–2003), who devoted his life to examining correlations between intelligence and creativity. Throughout his career, Torrance wrote over 1,500 books and articles and enabled thousands of young people around the world to realize their potential. He described the talents and abilities of gifted children in...

Pages