Was Phil Jackson really a great coach? Despite his reputation as the Zen master of hoops, I’ve never been convinced. After all, Kobe, Shaq, and His Airness would have made any coach look like a genius, and there’s never been a natural experiment quantifying Jackson’s impact.
Inside the classroom, a similar question lingers. In a recent study of district evaluation systems, Grover Whitehurst, Matthew Chingos, and Katharine Lindquist found that teachers with high-performing students were far more likely to be rated highly by observers than those with low-performing students. Moreover, this pattern was not the result of better teachers being matched with better students. Rather, observers were biased towards teachers with higher-performing students—the Phil Jacksons of the teaching world.
As the authors of the study make clear, eliminating this bias by adjusting for student background characteristics is relatively straightforward. So why aren’t we doing this already? A few weeks ago, Luke Kohlmoos of the Tennessee Department of Education argued against such adjustments, suggesting they were a “disservice to students and teachers” that would take us back to the bad old days of lower expectations for black and brown students. According to Kohlmoos, if we “systematize” lower expectations through classroom observations, teachers and students will stoop to meet them.
Obviously, we don’t want “lower expectations” for teachers or students, but when it comes to adjusting observation scores, it’s worth asking how those expectations are communicated and whether they are really “lower” in any meaningful sense.
Start with teachers: Why...