Susan E. Szachowicz still recalls the dismay she felt when the school where she is now principal got word of its first results on Massachusetts鈥� new statewide tests more than a decade ago.
Three-quarters of the 10th graders at Brockton High School failed the mathematics exam that year, 1998. Nearly half didn鈥檛 pass the English/language arts test.
鈥淚t kind of slaps you across the face,鈥� says Szachowicz, who at the time was a history teacher and the head of the social science department at Brockton High, an urban campus of nearly 4,300 students serving a diverse and largely low-income population in this city some 30 miles south of Boston. 鈥淓ven if people are critical of too much emphasis on the test, ... you can鈥檛 blame a test for that kind of failure.鈥�
Szachowicz says the poor results spurred her school to action. After all, starting with the class of 2003, students across the state would have to pass the English and math tests to graduate.
Much has changed at Brockton High since then, not the least of which are its test scores, which have soared, attracting widespread recognition. The school鈥檚 shift has included a thorough overhaul of its academic program.
Szachowicz says Brockton High, the largest high school in the state, has taken great pains to see that instruction across all core subjects is more rigorous and is closely aligned with the Massachusetts state standards, which are widely seen as among the best and most demanding in the nation.
The high-stakes exit exams have been a central part of the state鈥檚 efforts to ensure that the standards don鈥檛 simply collect dust. After all, it鈥檚 one thing to set high standards; it鈥檚 another to influence what goes on in thousands of classrooms statewide.
鈥淭he best standards in the world are meaningless if they don鈥檛 change the way teachers teach,鈥� says Craig D. Jerald, a Washington-based education consultant. (Jerald was a technical adviser for this year鈥檚 Quality Counts and was the project director for the report鈥檚 1997 to 2000 editions.)
It鈥檚 hard to say for sure the extent to which the Massachusetts standards鈥攐r any state鈥檚, for that matter鈥攈ave penetrated into schools and classrooms, though a variety of education leaders and analysts suggest the Bay State has made important inroads.
鈥淲e think they鈥檝e had a powerful impact,鈥� says S. Paul Reville, the state鈥檚 secretary of education, pointing to the testing program, the Massachusetts Comprehensive Assessment System, or MCAS, as a key driver. 鈥淭he MCAS is the main instrument through which the standards reach schools. And the schools are now highly focused on their MCAS performance.鈥�
Many states look to their neighbors to inform the writing and rewriting of their own academic-content standards. In fact, 30 states were cited as influencing the way in which their peers defined expectations for student learning and performance in either English/language arts or mathematics. The standards of California, Indiana, and Massachusetts were most frequently mentioned as models, with each cited at least 10 times by other states.
SOURCE: EPE Research Center, 2010
The state has made notable gains on the MCAS in math and English/language arts over the past decade at most grade levels, with some of the strongest improvements among 10th graders. It has also posted increases over time on the National Assessment of Educational Progress, often known as 鈥渢he nation鈥檚 report card,鈥� and has some of the highest average NAEP scores of any state.
A 2008 survey of some 40,000 Massachusetts educators found that more than nine in 10 teachers and administrators agreed either 鈥渟trongly鈥� or 鈥渟omewhat鈥� that the curriculum in their schools was aligned to the state standards.
And yet, by the Pioneer Institute for Public Policy Research, a think tank in Boston, suggested many school districts still weren鈥檛 entirely on board.
Drawing on state audits of 76 of Massachusetts鈥� nearly 400 districts, the study found that 58 percent of those districts reviewed between 2003 and 2005 were deemed 鈥渂elow satisfactory鈥� for curriculum alignment to the state standards and implementation. (The independent state agency that conducted those audits has since been effectively disbanded.)
William H. Guenther, the president of the Mass Insight Education & Research Institute in Boston, says that while he believes the state has made big strides since the standards were first developed in the mid-1990s, he still finds an uneven embrace across schools.
鈥淓ven in the best of states like Massachusetts, where we鈥檝e got leading standards and a first-rate, aligned test, there are schools and districts that haven鈥檛 yet gotten the message,鈥� says Guenther, whose research and advocacy organization has worked closely with a network of districts to help implement the standards.
Alignment Challenge
Still, Massachusetts may have a leg up on other states in driving its standards into the classroom, because of what experts describe as the strong alignment between its standards and the MCAS. After all, if state assessments don鈥檛 test students on the standards, it鈥檚 far less likely that those standards will affect instruction.
鈥淭he degree of alignment between a state鈥檚 test and standards varies quite a bit from state to state, but it鈥檚 a lot lower than you might expect,鈥� says Andrew J. Porter, the dean of the graduate school of education at the University of Pennsylvania, and the co-author of an upcoming study that examines several aspects of state assessments, including such alignment. 鈥淚n fact, a state鈥檚 test is typically no more aligned to its own standards than it is to another state鈥檚 standards,鈥� says Porter, who was a technical adviser for Quality Counts 2010.
Meanwhile, by the RAND Corp. on the school-level impact of standards-based reforms offers some insights, based on surveys of educators in California, Georgia, and Pennsylvania.
鈥淟arge majorities of teachers said they did in fact try to align their instruction with the standards,鈥� says Laura Hamilton, a senior social scientist at RAND, a research group based in Santa Monica, Calif. 鈥淏ut they also pointed out some of the ways in which this is challenging. A lot of them said there鈥檚 too much material in the standards, or the standards aren鈥檛 very clear.鈥�
Enlisting Teachers
Massachusetts was one of the earliest entrants into the era of so-called standards-based reform through the Massachusetts Education Reform Act, enacted in 1993, which dramatically stepped up the state鈥檚 role in K-12 schooling.
The wide-ranging package included provisions to increase state funding for education and help equalize spending across districts. At the same time, it called for the development of academic standards鈥攃alled curriculum frameworks鈥攁cross core disciplines and for them to be aligned with assessments. Accountability measures included a requirement that all students pass high school exit exams to graduate.
Observers say the state frameworks were crafted to be rigorous, clear, and easy to use, with K-12 educators invited to assist in drafting them. Szachowicz, the principal at Brockton High, for instance, helped write the history standards when she was still a teacher.
鈥淚t helps a lot to have high-quality standards that teachers might actually want to use, so that they sell themselves,鈥� says Guenther, from Mass Insight.
A variety of teachers at Brockton High say they generally like the standards.
鈥淭he standards are ... user-friendly,鈥� says Jodie Nelson-Holzman, who teaches English/language arts. 鈥淭hey鈥檙e posted on my wall in my classroom, and my students refer to them constantly.鈥�
In addition to setting accessible standards and seeking to tightly align assessments to them, Massachusetts supplies schools with detailed reports on how individual students perform on each test item, with corresponding links to the state curriculum frameworks.
The state also took steps to embed the standards into teacher tests and revisions to teacher-certification requirements, said Sandra Stotsky, a former senior official in the state education department who led that effort and now serves on the state board of education.
In general, Massachusetts students must pass the exams in English/language arts, math, and, starting with the class of 2010, science and technology/engineering, to earn a high school diploma. They may take exams multiple times if needed. Last year, however, the state postponed a high-stakes history and social studies test for at least two years, citing budgetary concerns.
David P. Driscoll, who stepped down in 2007 as the Massachusetts commissioner of education after serving for nearly a decade, suggests the high-stakes testing has been the primary driver for getting the standards into classrooms.
鈥淚t counts,鈥� he says. 鈥淪tudents have to pass the 10th grade tests in order to get a diploma.鈥�
Says Szachowicz from Brockton High: 鈥淟et me just tell you, kids pay attention.鈥�
鈥楾oo Much Testing鈥�?
The use of the MCAS tests for accountability purposes has faced plenty of criticism.
鈥淔or a decade-plus now, people have used test scores to punish and blame schools and teachers,鈥� says Paul Toner, the vice president of the Massachusetts Teachers Association, an affiliate of the National Education Association. 鈥淭eachers think there鈥檚 too much testing, too much emphasis on test results.鈥�
He suggests that most teachers think tying the high school tests to graduation is a mistake.
But many teachers at Brockton High don鈥檛 seem to share that view.
Mary C. Collins, who teaches history and sociology, was opposed to the exit exams when she first started teaching, but not anymore.
鈥淣ow that we all know how to actually get the kids to be successful [on the MCAS], it鈥檚 the exact same thing as how we would make them successful to achieve all their graduation requirements anyway,鈥� she says. 鈥淣one of our kids who are on track to graduate are going to fail this test.鈥�
鈥淵ou realize that without high stakes, we probably wouldn鈥檛 have pushed the students as hard, because we didn鈥檛 need to,鈥� adds Michele M. Finnegan, who teaches history and heads the school鈥檚 social science department.
Another criticism of the Massachusetts standards effort is that the state has failed to do enough to help districts meet the standards, from aligning their curricula to improving their instruction and academic performance.
Secretary Reville, who served on the state board of education when the 1993 education law was passed, doesn鈥檛 dispute that.
鈥淎s a state overall in the 16 years of education reform since 1993, we鈥檝e underemphasized building the capacity of districts to deliver high-quality curriculum and instruction,鈥� he says. 鈥淯ntil we work harder at building capacity, ... we鈥檙e not going to attain our standards.鈥�
A Schoolwide Approach
The state standards and the MCAS have heavily influenced Brockton High鈥檚 approach to curriculum and instruction, says Szachowicz, though she emphasizes that the standards have not led to narrow 鈥渢eaching to the test鈥� just to push up student scores.
Close scrutiny of the annual test data has helped the school figure out areas that need extra focus, she says. Such analysis led the school early in the 2000s to develop a schoolwide literacy initiative that focuses on reading, writing, speaking, and reasoning.
鈥淭he content standards lay out what we have to teach, but the literacy initiative says, 鈥楬ere鈥檚 how kids need to be able to demonstrate it,鈥� 鈥� Szachowicz says.
Schoolwide means literacy skills are taught in math class, art and cooking courses, and even gym class. Likewise, the school has taken steps more recently to foster key math skills, such as making graphs, in other disciplines.
鈥淲e鈥檝e asked art teachers, we鈥檝e asked gym teachers to do graphs,鈥� says Nelson-Holzman, the English/language arts teacher.
Szachowicz says the schoolwide approach reinforces the lessons for students in various contexts while enabling the school to offer a diverse menu of course options.
鈥淚n some schools, they鈥檝e taken away electives, having double math, double English鈥� in response to the MCAS, she says. 鈥淭he route we went is, 鈥楲et鈥檚 take the skills kids need and infuse them into all subject areas.鈥� 鈥�
State Recognition
The school鈥檚 efforts appear to be showing results: To recognize Brockton High鈥檚 progress, Mitchell D. Chester, the state commissioner of elementary and secondary education, visited the school in September to publicly announce the latest statewide MCAS results.
Overall, 94 percent of Brockton High 10th graders passed the English exam from last spring, with 78 percent achieving a rating of 鈥減roficient鈥� or 鈥渁dvanced.鈥� In math, 85 percent passed, with 60 percent proficient or advanced. Although the percentage reaching proficiency or higher in math was well below the statewide figure of 75 percent, the results were a far cry from the 7 percent who scored at those levels back in 1998, and reflect steady improvement over time.
In addition, the school met state performance targets last year for all subgroups of students required under the federal No Child Left Behind Act, such as groupings by race and socioeconomic status. The state education agency said that Brockton High鈥檚 MCAS performance was among the strongest in the state for a school with its low-income demographic.
Stepping back, Szachowicz says that while many factors have contributed to the school鈥檚 gains over time鈥攁nd several outside observers, including Secretary Reville, suggest her leadership has been critical鈥攖he principal believes the heart of the matter is 鈥済reat instruction鈥� tied to high standards.
鈥淚t鈥檚 about what happens in the classroom between the students and the teachers,鈥� she says. 鈥淭he teachers know clearly what they have to teach, and they teach it well.鈥�
