News came down, or up, late last month about the indictment of the former Atlanta schools chief Beverly Hall and 34 other current and former officials for their alleged roles in a massive cheating scandal that has rocked the city for the past three years.
The best is by Atlanta Journal-Constitution reporter Heather Vogell and her colleagues, whose fine journalism uncovered the muck.
There is nothing good to say about cheating on tests, which, in this extraordinary case, involves allegations of tampering with student answers, racketeering, theft, influencing witnesses, conspiracy, and making false statements. It鈥檚 wrong, period, and if Ms. Hall et al. are found guilty, they will hopefully use their time in jail to think about the damage they have caused to the kids, to the system, and to the public鈥檚 trust in schools and in the measures we use to gauge their quality.
Still, some of the reactions to the scandal have been surprising, if not scandalous in their own right. The most troubling response comes from people opposed to standardized testing generally and to current federal policy specifically. They somewhat gleefully use this sorry episode as the ultimate smoking gun, the perfect we-told-you-so case that clinches their claims about the evils of testing, and, by extension, the entire reform movement. It鈥檚 a big nail, they hope, in the coffin of test-based accountability.
Shall we excuse individual or group criminality because certain social institutions create pressures for greed and misconduct?"
Among the more remarkable statements is one posted by William C. Ayers on Valerie Strauss鈥 . For Bill Ayers, an education professor emeritus from the University of Illinois at Chicago, the Atlanta story proves that 鈥渢eaching toward a simple standardized measure and relentlessly applying state-administered (but privately developed and quite profitable) tests to determine the 鈥榦utcomes鈥 both incentivizes cheating and is a worthless proxy for learning.鈥
Mr. Ayers goes further. Not only does he attribute the alleged cheating to the testing policy, thereby essentially absolving Ms. Hall and her colleagues of their own ethical and professional lapses, but he uses the example to issue a sprawling condemnation of the U.S. Department of Education, Secretary of Education Arne Duncan, and even the president. As he puts it, 鈥渢he road to the massive cheating scandal in Atlanta runs right through the White House.鈥
I have four problems with this logic (echoed in other commentaries, such as Jason Stanford鈥檚 in the Huffington Post that 鈥渉igh-stakes testing makes cheating inevitable鈥; and FairTest鈥檚 in an Atlanta Journal-Constitution op-ed last year that 鈥淸t]hese scandals are the predictable result of overreliance on test scores鈥).
First, shifting the blame for egregious mischief away from the perpetrators and onto the system strikes me as morally and politically bankrupt. Here鈥檚 an analogy to consider: Do we react to the worst instances of tax evasion by condemning the concept of taxation rather than by prosecuting the evaders? I assume that Mr. Ayers would not call for abolition of the graduated income tax as a way to finance public goods and redistribute wealth just because the system has its imperfections and because some people lie on their tax returns. Shall we excuse individual or group criminality because certain social institutions create pressures for greed and misconduct? Banking executives accused of fraud will be delighted.
Second, even if one could make an evidence-informed case that testing 鈥渋nevitably鈥 leads to illegal behavior鈥攁s if high-stakes testing overwhelms the human capacity for moral choice鈥攖here is the added problem of guilt by association. Pinning the responsibility for the Atlanta disaster on the White House is an extravagant example of misdirected blame. Maybe current federal policies lead to unwanted outcomes, such as narrowing of the curriculum and teaching to the test, but that鈥檚 a far cry from the outright fraud of the sort listed in the Atlanta indictment. Nothing in the No Child Left Behind law requires states or districts to use test scores to fire teachers and principals or to protect and reward those who achieve targets by tampering with answer sheets. In any case, there鈥檚 no evidence that federal policy causes cheating, or that 鈥渃heating is inevitable.鈥
Third, indicting testing, rather than cheating, undermines the possibility for reform in the design and uses of tests. The compelling logic in Campbell鈥檚 Law鈥斺淭he more any quantitative social indicator is used for social decisionmaking, the more subject it will be to corruption pressures ...鈥 鈥攊s supported by on the effects of .
But what鈥檚 often ignored in the popular frenzy against testing, especially in the wake of cheating scandals, is the benefits side of the argument: Tests can help gauge individual learning, give teachers additional information about their students鈥 progress, provide objective indicators of student achievement, and expose inequalities in the allocation of educational resources.
We may never be able to completely 鈥渙verturn鈥 Campbell鈥檚 Law, but what鈥檚 needed is a sensible approach to assessing the ratio of benefits to costs and to the design of mechanisms meant to keep the ratio strongly positive.
Fourth, it turns out that in Atlanta there were schools, and kids, that actually did improve during Ms. Hall鈥檚 tenure, according to data from the National Assessment of Educational Progress. As U.S. Commissioner of Education Statistics Sean P. 鈥淛ack鈥 Buckley noted, 鈥淭here were obviously rampant violations of testing integrity going on there, but there were also schools there that were legitimately improving.鈥
We shouldn鈥檛 allow score gains inflated from cheating to be misconstrued as evidence that any measured improvement in student learning鈥攅specially among poor and minority children鈥攎ust always be the result of cheating or other mischief. This kind of smoking-gun logic saps the morale of educators, parents, and policymakers working in behalf of our most disadvantaged students and provides free ammunition to .
Just when we education researchers and social scientists are facing increasingly mean-spirited political challenges to our profession, Bill Ayers鈥 and others鈥 evidence-free diatribes further erode public confidence in the credibility of our work. One can only hope that the temptations of guilt by association won鈥檛 prevail, and that the research community as a whole won鈥檛 be blamed for the shoddy logic of some of its members.