Ten years ago this month, President George W. Bush signed into law the No Child Left Behind Act, setting the stage for a new鈥攁nd more aggressive鈥攑hase of accountability in American education.
The United States isn鈥檛 alone in promoting accountability in elementary and secondary education. The notion in recent years has become a global phenomenon among nations looking to improve their school systems.
What accountability practices look like in other countries, however, varies considerably, from publicly reporting school results on assessments to conducting school inspections and administering high-stakes 鈥済ateway鈥 exams that play a big role in determining students鈥 academic and career prospects.
Experts say the U.S. approach appears to be something of an outlier, at least as defined in the No Child Left Behind era, with the main focus on grade-by-grade standardized testing that drives an escalating set of sanctions for schools that fail to meet specific achievement targets over time.
鈥淩ight now, it鈥檚 very much an American experiment,鈥 says Yong Zhao, an education professor at the University of Oregon who has studied comparative education and is a critic of NCLB testing and accountability provisions. He was a member of the Quality Counts 2012 advisory panel.
At a time when American policymakers are rethinking elements of accountability, and amid increased concern about how U.S. students stack up globally, questions arise about how the American approach compares and contrasts with that of other nations and whether there are practices from abroad to consider.
One such possibility: school inspections. A number of countries, such as England, the Netherlands, New Zealand, and Singapore, require these external reviews to help gauge academic quality and hold schools accountable for improvement.
Also, as the idea of making student achievement a central element of teacher evaluations appears to be building steam in the United States, experts note that the professional judgments of supervisors and sometimes of peers, rather than test scores, remain the mainstay in most developed nations, including top-achievers. Indeed, some analysts say the most powerful lessons may well come from places like Finland and Singapore that have taken a comprehensive approach to ramp up the quality of their teaching forces. (鈥淎mong Top-Performing Nations, Teacher Quality, Status Entwined,鈥 this issue.)
Meanwhile, the main weight of accountability in many industrialized nations tends to fall on students, rather than schools or teachers, as seen through the gateway-exam systems common in Europe and East Asia.
鈥淲e go very heavy on school accountability,鈥 says Tom Loveless, a senior fellow at the Brookings Institution, a Washington-based think tank. 鈥淭he rest of the world is fairly light on that but is much heavier on student accountability, where they hold students accountable for what they鈥檙e supposed to know, and there are consequences attached to that, such as the track or stream they鈥檙e placed into.鈥
Although a gateway system may not be deemed politically feasible or desirable in the United States, some observers suggest it鈥檚 worth exploring ways to foster more student accountability.
The design of educational accountability in the United States has long been the subject of fierce debate, especially in the years since the NCLB law鈥檚 enactment. A central concern is the perceived rigidity of the law鈥檚 mandates for identifying low-performing schools and the steps required to intervene, including corrective actions and restructuring that may involve removing teachers or converting to a charter school.
In addition, many educators and analysts say U.S. policymakers rely too heavily on standardized tests to measure student learning and school quality. The pushback is especially pronounced given the widespread belief that the tests most states administer for accountability purposes under the law provide limited information on student achievement.
Daniel Koretz, a professor at the Harvard Graduate School of Education, laments the intense 鈥渨eight and faith given to test scores鈥 in the United States.
鈥淵ou generally don鈥檛 find people [in other countries] saying, 鈥榃e鈥檙e going to impose a 90-minute math exam and we鈥檙e going to evaluate a school based on that,鈥 鈥 he says.
Although U.S. Secretary of Education Arne Duncan has made clear that he sees testing as a vital ingredient to accountability, he has pushed to improve the quality of assessments used for that purpose, saying the nation must move beyond 鈥渇ill-in-the-bubble鈥 tests that measure basic skills.
Fueled by more than $350 million from the federal Race to the Top program, two state consortia are developing common assessments鈥攑egged to the common standards in English/language arts and math recently adopted by most states鈥攊ntended to be more rigorous and to better evaluate learning.
Global Outlier
Speaking at a global education forum last year, Duncan said the work to devise strong common standards and aligned assessments reflects a 鈥渟ea change鈥 in American education in line with top-achieving countries. The new exams, he said, 鈥渨ill test higher-order thinking skills, much like the high-quality assessments used overseas.鈥
Duncan observed: 鈥淗igh-performing nations may differ on how they assess learning. Yet every top-performer is using data in one form or another to inform instruction and to monitor and improve performance.鈥
Some key aspects of U.S. federal policy on testing and accountability appear to be unusual in the global sphere. For one, analysts say that national or state standardized tests typically occur far less often overseas than is required under the NCLB law, which calls for annual testing in grades 3-8 and once again in high school.
Another apparent outlier is the U.S. mandate to disaggregate performance data at the school level by student subgroups, including race, ethnicity, and income status.
鈥淚 don鈥檛 know of any other countries that do that,鈥 says Sir Michael Barber, a former top education adviser to then-British Prime Minister Tony Blair and a student of education globally. 鈥淕iven the history of race and civil rights in the United States, I think that is unusual, and I personally think it is important. It really puts the [achievement] gaps on the agenda.鈥
Many nations do, however, make school-level achievement data publicly available.
The United States benchmarks against three major international tests:
The Program for International Student Assessment, or PISA, administered by the Organization for Economic Cooperation and Development, evaluates reading, math, and science among 15-year-olds every three years. It is considered to use more open-ended and essay questions than other international tests and requires students to transfer knowledge or skills from one content area to another. Seventy-four countries and jurisdictions participated in the most recent assessment.
The Trends in International Mathematics and Science Study, or TIMSS, administered by the International Association for the Evaluation of Educational Achievement, evaluates math and science in 4th and 8th grades every four years. In 2011, 78 countries and states participated. It is considered to have a structure more similar to that of the National Assessment of Educational Progress, or NAEP, although it puts different weight on content areas.
The Progress in International Reading Literacy Study, or PIRLS, also administered by IEA, evaluates reading among 4th graders every five years. In 2011, 57 countries and states participated in the test.
U.S. Performance
The United States鈥 performance on international tests is often described as middle-of-the-pack. The country鈥檚 showing on nation-by-nation comparisons varies somewhat, depending on the exam and the academic skills it measures.
SOURCE: Institute of Education Sciences
Australia, which launched national exams in 2008, recently unveiled a federal website with a snapshot of individual schools, including test results as well as a comparison of any given school鈥檚 achievement with others that have similar student demographics.
Although analysts say tying penalties to schools based on test scores is unusual, that is not to say nothing happens with struggling schools overseas.
Many nations use test data to 鈥済uide intervention, reveal best practices, and identify shared problems ... in order to encourage teachers and schools to develop more supportive and productive learning environments,鈥 the Paris-based Organization for Economic Cooperation and Development explains in a 2010 , 鈥淪trong Performers and Successful Reformers in Education.鈥
鈥淲e don鈥檛 declare our schools to be failing,鈥 says Ben Levin, an education professor at the University of Toronto and a former deputy education minister in Ontario. 鈥淏ut we differentiate our support for schools based on their level of performance. ... So if you鈥檙e in a school that has not very good performance, you鈥檙e going to get more support both from the district and the province.鈥
In Singapore, notes a 2005 report from the Washington-based American Institutes of Research, schools use a national exam to identify upper-elementary students who struggle in math. Those students receive specialized instruction based on an adapted curriculum, as well as more instruction so that they can cover the same rigorous content, only at a slower pace, the study says. (Singapore also provides financial rewards to schools that show better-than-expected performance on value-added measures of school outcomes, according to the study.)
The United States鈥 closest cousin when it comes to school accountability may well be England, experts say. In addition to publicly reporting achievement data down to the school level, the country sets 鈥渇loor targets鈥 for schools based on national tests at the end of primary school and again in secondary school, though those results do not take into account student demographics. A school鈥檚 failure to meet the targets can result in government-mandated intervention and possible takeover, closure, or conversion into a government-managed academy.
(In 2010, about one-quarter of England鈥檚 primary schools boycotted the exams, according to the BBC, citing concern about pressure to 鈥渢each to the test鈥 and frustration with the news media鈥檚 use of the results to rank schools based on achievement in so-called league tables.)
School Inspections
But England brings another dimension to accountability lacking in the United States: a national school inspection system. Such systems exist in a number of countries, especially in Europe, and in some instances date back more than a century.
Craig D. Jerald, a Washington-based education consultant who recently wrote a on the English inspectorate, the Office for Standards in Education, Social Services and Skills鈥攌nown as 鈥攕uggests that this approach may be a promising option for states looking to move beyond a simple reliance on test scores.
鈥淲e need to bring expert judgment into school evaluation and accountability, and one way to do that is inspection,鈥 he says. 鈥淚t鈥檚 a way to handle a multiple-measure approach to evaluating schools. You can either hand that over to a spreadsheet or a trained expert.鈥
Under the English system, inspectors typically visit a school for two days. Schools are rated 鈥渙utstanding,鈥 鈥済ood,鈥 鈥渟atisfactory,鈥 or 鈥渋nadequate.鈥 Test data are used in the evaluation, but so are other factors, including classroom observations to determine the quality of instruction. Schools rated inadequate can be placed into 鈥渟pecial measures,鈥 which involves developing an improvement plan and more regular inspections. If the school fails to improve, more-severe consequences may follow, such as replacing the principal or closing the school.
England last fall revised its inspection framework, amid concern that the inspections have focused on an overly lengthy list of topics. The new framework narrows the scope to four areas: student achievement, teaching and learning, school leadership and management, and standards of behavior and safety. A key objective, OFSTED explained, was for inspectors to spend more time observing classrooms, including listening to children read in primary schools, assessing their progress, and observing student behavior.
At least a few U.S. school systems have recently tried conducting formal inspections, including in New York City, Charlotte, N.C., and Sacramento, Calif.
鈥淲e wanted to give a qualitative assessment of a school, and to do that, we developed a highly specific rubric,鈥 said Jerry Winkeljohn, the former director of school improvement in the 134,000-student Charlotte-Mecklenburg district, which halted the inspections last year amid budget cuts.
Melanie Ehren, an education researcher at the University of Twente, in Enschede, the Netherlands, who has studied school inspections, said that given the limits of testing, inspections could be a powerful tool for the United States to home in on 鈥渋nstructional quality.鈥 Given the expense involved, she said, a state might consider only visiting struggling schools or those deemed at risk of falling behind. In fact, her country just instituted such a policy for 鈥渞isk-based鈥 inspections as a cost-saving measure, she said.
Use of Testing
Experts say one core dimension of accountability lacking in the United States is the use of high-stakes, government-sponsored gateway exams.
鈥淰irtually all high-performing countries have a system of gateways marking the key transition points,鈥 such as from basic to upper-secondary education and from upper-secondary education to university, writes Marc S. Tucker, the president of the National Center on Education and the Economy, a Washington-based research and advocacy group, in a 2010 report, 鈥淪tanding on the Shoulders of Giants.鈥
Such exams, which typically are set to national standards and derived from a national curriculum, create strong incentives for students to work hard and take tough courses, explains Tucker, who served on the advisory board for Quality Counts 2012. 鈥淪tudents who do not do that will not earn the credentials they need to achieve their dream, whether that dream is becoming a brain surgeon or an auto mechanic.鈥
John H. Bishop, a Cornell University professor who has studied gateway exams, said the pressure has ripple effects. 鈥淚t automatically produces stakes for the teachers, even if there is nothing formal about it,鈥 he says.
In a 2005 , Bishop noted that the high school exit exams in many countries, typically developed by the education ministry, last two weeks or more, with the curriculum-based tests for each subject lasting three hours or longer. They generally require students to write essays, describe science experiments, and show how they solve multistep mathematics problems, he explained. Also, the exams usually signal different levels of achievement, not just whether a student has met a minimum standard.
But many U.S. analysts are skeptical of importing European- or Asian-style gateway exams.
鈥淚 think we have a wonderfully different system,鈥 says Marshall 鈥淢ike鈥 Smith, a former U.S. deputy secretary of education and a visiting scholar at Harvard University. 鈥淲e have multiple opportunities for kids to get to college, and I think that鈥檚 one of our greatest strengths.鈥 (鈥淓ven With Educated Workforce, U.S. College, Career Issues Loom,鈥 this issue.)
Some external exams do count for U.S. students, but there are significant differences. First, nearly half of states have exit exams students must pass to graduate, but analysts say they generally set a low bar. Also, U.S. universities generally don鈥檛 consider the results in making admissions decisions. The privately run SAT and ACT certainly are high-stakes exams, but those voluntary tests are not directly connected to the curriculum, and analysts say schools feel little responsibility for student performance on them.
In any case, some observers suggest the United States could benefit from more incentives for students to take high school assessments more seriously. In fact, the effort to develop common standards may create a new avenue. A variety of higher education institutions have signaled that they would recognize in making placement decisions the high school exams being crafted by two state consortia as part of the common-standards initiative. They would not determine admission, but would allow students to skip the remedial courses many universities require some students to complete.
鈥淲e鈥檝e always thought about these college-ready assessments as door openers, not door closers, not the same as exit exams,鈥 says Michael Cohen, the president of Achieve, a Washington-based group working with the Partnership for Assessment of Readiness for College and Careers, or PARCC, a consortium composed of 23 states, plus the District of Columbia.
Tests and Incentives
Meanwhile, teacher evaluation has become a core theme in U.S. discussions of accountability, with a push to base those evaluations鈥攁s well as decisions on pay, tenure, or dismissal鈥攁t least in part on student test scores.
A 2011 notes that across the organization鈥檚 34 countries, teachers are judged, and in some cases rewarded, on a range of criteria. They include qualifications, how teachers operate in a classroom setting (such as attitudes, expectations, and instructional strategies), and measures of effectiveness. Instruments include standardized assessments, classroom observations, teacher interviews, and parent ratings.
Andreas Schleicher, the OECD鈥檚 education director, says Singapore has developed an especially 鈥渟ystematic and thoughtful鈥 evaluation system.
鈥淭hey have a range of criteria that feed into this judgment, including test scores, including professional judgments, including inspections,鈥 he said. 鈥淭here are a lot of things you need to do as a teacher to demonstrate performance.鈥
As an incentive, Singapore awards performance bonuses to teachers.
Some observers also note that informal accountability, where teachers feel a professional responsibility to one another, plays a powerful role in countries such as Singapore and Japan.
Stepping back, many analysts caution against the temptation simply to cherry-pick isolated elements of another nation鈥檚 education system. There are important structural factors of the U.S. system to keep in mind, not to mention social and cultural differences, and political realities.
That said, a variety of observers say the United States may be reaching a pivotal point on educational accountability, especially with recent efforts, following previous false starts, to revise the NCLB law. With that in mind, this could be a time to test out some different approaches, such as school inspections, says Jerald.
鈥淎 certain number of states could try it out to get a sense of whether inspection can translate well in the United States,鈥 he says. 鈥淚t would be a very different approach.鈥
Jerald adds: 鈥淎fter 10 years of a very standardized approach to accountability that has had its advantages and disadvantages, it鈥檚 time to experiment a little bit.鈥