The interviewers pepper the teachers with questions: To what do they attribute their school鈥檚 level of success? How do teachers know exactly what is to be learned in their grades and subjects? What鈥檚 their involvement in curriculum development? How does the school provide instructional support for teachers?
Like sleuths searching for clues, the interviewers are trying to ferret out why the two junior high schools鈥擟entral and West鈥攈ere in this city of some 42,000 people outperform others with similar student populations across Illinois, and how those practices might be spread.
Over the past decade, an explosion of data on student performance has generated increasing attempts to identify what have been dubbed high-flying schools and learn from them. Just this spring, a free Web site, launched by the New York City-based Standard & Poor鈥檚, began providing a tool that enables users to identify schools that do better than others with similar demographics. (鈥淥nline Tools for Sizing Up Schools Debut,鈥� March 30, 2005.)
But the investigations here in Illinois, and in other states affiliated with the Austin, Texas-based National Center for Educational Accountability鈥檚 best-practices studies, stand out on several fronts.
See the accompanying items:
Rather than drawing on the experiences of a handful of high performers, by the end of this year, the NCEA and its state affiliates will have conducted such case studies in more than 400 schools in 17 states, supported in part by a $1.2 million grant from the Los Angeles-based Broad Foundation. The group also has devised a rigorous methodology for identifying such schools and a detailed protocol for studying them that helps unearth patterns of behavior.
鈥淲e try to be very careful not to draw conclusions from any one school,鈥� said Jean Rutherford, the director of educational initiatives for the nonprofit center. 鈥淲e say, 鈥榃e鈥檝e been in 300 schools, and here鈥檚 what they all say.鈥� 鈥�
High performers, in her view, 鈥渟ound, walk, and talk alike, not in a negative way, but in an enthusiasm, a positive sense of efficacy.鈥�
Identifying Schools
Studying high-performing schools and figuring out what makes them tick dates back at least to the 鈥渆ffective schools鈥� movement launched by the late researcher Ronald Edmonds in the 1970s. But a resurgence of such work has occurred in the past few years from both ends of the political spectrum, as educators struggle to bring all students to higher levels of achievement.
In 2000, for example, the conservative Heritage Foundation, a Washington think tank, published No Excuses: Lessons From 21 High-Performing, High-Poverty Schools. And in 2002, the liberal-leaning Education Trust, a research and advocacy group also in Washington, published a list of 1,320 鈥渉igh-flying schools鈥� nationwide that had both strong test scores and student enrollments that were at least half poor and half made up of minority children.
A year later, the trust launched a searchable computer database, the High Performing Schools and Districts initiative, designed to identify high-poverty schools of high academic caliber and learn from them.
Many of those studies have been criticized, though, for focusing on just one year鈥檚 worth of test data, including schools with selective enrollments, or looking at results in just one grade or subject.
In contrast, the NCEA identifies high performers based on state test results over three years and in multiple grades and subjects.
A Common Framework
To probe what sets high-performing schools apart from others, the NCEA has designed a best-practices framework that forms the basis for structured interviews with district administrators, principals, and teachers.
Underlying the framework, said Ms. Rutherford, are clear and specific academic goals for students, rooted in state content standards. 鈥淭hat clearly has emerged,鈥� she said, 鈥渁s the bedrock foundation: this penetrating, deep understanding of what it is children are to know and be able to do and how to connect it across grades.鈥�
The site investigations, which involve a team of two to four researchers working over one or two days, do not include classroom observations, in part because of the concentrated nature of the visits.
The protocol stems from work that started in 1999, when Just for the Kids, the Austin-based predecessor to the NCEA, began investigating the practices of consistently high-performing elementary schools in Texas. The center was founded in 2001 by Just for the Kids, the Denver-based Education Commission of the States, and the University of Texas at Austin to promote higher student achievement by improving state data collection and identifying practices that distinguish consistently high-performing schools from others and disseminating those findings. The center receives funds from foundations, corporations, individuals, and the U.S. Department of Education. Today, it works with affiliates in nearly half the states.
Those affiliates receive training in how to conduct the interviews and collect supporting documents, such as curriculum frameworks, that detail each school鈥檚 practices. Each state can choose to supplement the NCEA materials and to adapt the framework to reflect its own context. The Illinois affiliate, for instance, has added questions about school climate and about how schools replicate good ideas.
鈥淲hat we鈥檙e interested in a lot is the transferability of the information,鈥� said Lynne Curry, a research associate in the college of education at Illinois State University, in Normal, which is leading her state鈥檚 investigations. The Illinois Business Roundtable serves as the primary affiliate organization. 鈥淲e鈥檙e also interested in the attitudinal, affective side of all this,鈥� Ms. Curry said.
Having a common framework and set of questions, said the NCEA鈥檚 Ms. Rutherford, has made it possible to talk about improvement practices across sites. 鈥淓ven high-performing schools can鈥檛 always articulate the reasons for high performance,鈥� she said. 鈥淭here鈥檚 just not that much reflection time to sit down and know what it is that鈥檚 leading to your high performance.鈥�
All state study results are published on . In addition to detailed test data and descriptive information about each practice from the field investigations, the Web site includes actual examples of tools and documents used by schools and districts.
鈥淲e can learn by watching successful districts,鈥� said James T. Rosborg, the superintendent of the Belleville school system. 鈥淲e don鈥檛 do enough of that.鈥�
鈥榃hatever It Takes鈥�
Belleville School District No. 118, located on high ground just east of the Mississippi River, in southwest Illinois about 17 miles from St. Louis, shares many of the features of other high-performing sites.
鈥淥ur concept has always been: Show us the kids, and we鈥檒l teach them,鈥� said one 8th grade science teacher at West Junior High School here. 鈥淚 think that attitude of whatever it takes, that鈥檚 what happens.鈥�
Clear expectations for what students should know and be able to do are communicated through a grade-by-grade skills continuum that the district updates regularly. District exit tests, given at the end of each year and crafted and refined by committees of classroom teachers, measure whether students are learning those objectives. Any changes in the curriculum flow through a district curriculum committee, which meets monthly and includes representatives from every grade and school.
New instructional strategies, such as the Reading Recovery program or math problem-solving, are first piloted in a handful of schools or classrooms, and then refined to make sure they really work, before being copied districtwide. In the summer and early fall, teachers and principals pore over test results to identify targets for the coming year and how they will address them.
The two junior high schools also have designed a number of ways to help struggling students, such as individual improvement plans signed by the students鈥� parents and teachers. Those strategies also include a 7th grade and an 8th grade classroom that are limited to 20 students who take all the core subjects with one teacher and cover the same material on a more individual timetable.
Belleville educators also point to other factors contributing to their success: the high level of trust and collaboration in the district and its attention to fostering a strong, positive relationship with every student. With just eight elementary schools, two junior highs, and some 3,700 students, Belleville School District No. 118 is small enough to have developed a strong, cohesive sense of community. Most of its principals are hired from within, for example, and many teachers started out student-teaching here.
鈥淚 think we鈥檙e all allowed to breathe, to be creative, to make mistakes,鈥� said Pam Knobeloch, the principal of West Junior High. 鈥淚t鈥檚 an attitude; it鈥檚 a philosophy; it鈥檚 a way of treating people.鈥�
鈥淭hey make it real easy for us to confer, to collaborate,鈥� agreed Bill Miller, a 7th grade social studies teacher at Central Junior High School, who says that teachers know the administration is on the same page. 鈥淭here鈥檚 mutual respect,鈥� he said. 鈥淭he bottom line is the kids. We鈥檙e all here working for them. I think that鈥檚 what unites this district.鈥�
Translating Into Action
Honoring the context of each district鈥攁nd school鈥攚hile identifying the commonalities across sites is part of the challenge in doing such qualitative studies.
The work across states presents benefits along with the challenges. When the Washington state affiliate could not identify any high-performing schools with large percentages of Hispanic students, for example, it sent teams to Texas to study high performers in the Rio Grande Valley and report back.
But every state is also different, ranging from the types of tests it administers to its timeline for releasing results.
Ideally, for example, the NCEA considers test-participation rates and the skills of incoming 7th graders when gauging a junior high school鈥檚 performance, but Illinois lacks a longitudinal database that would enable it to include such information. The state also did not have information on which schools had made adequate yearly progress for 2003-04 in time to identify schools for the best-practices study, so high performers were picked based on 2002-03 test data. As it turned out, West Junior High did not make AYP last school year, although state test data consistently rank the school far above others with similar percentages of low-income and English-language-learners across three years and multiple grades and subjects.
鈥淓very state has its own witches鈥� brew of small- to medium-sized data problems,鈥� said Chrys Dougherty, the director of research for the NCEA. 鈥淲e鈥檙e trying to get policymakers to understand that even though data sounds like the most boring thing in the world, if you鈥檙e going to improve schools, you鈥檝e got to improve the information that schools have to work with.鈥�
In some states, which identify their own lists of high performers based on different criteria, questions also arise about exactly what it means to be a high-performing school.
But perhaps the biggest challenge is how to take the NCEA鈥檚 growing trove of information and translate that into action in low- and average-performing schools.
鈥淭o me, that is the central issue that we face now,鈥� said Mike Hudson, the organization鈥檚 president. 鈥淗ow do you effectively and efficiently transfer what we know is working out there to help those in need of assistance?鈥�
The organization has devised self-audits for schools, based on the best-practices framework, that allow educators to benchmark their practices against those of higher performers, to help decide where to begin their work.
By the fall, the NCEA plans to pilot a School Improvement Services kit that would put educators at average- and low-performing schools in touch with a network of high-performing mentors who could walk them through the improvement process.
鈥楽omething to Nurture鈥�
Although most education analysts agree that it鈥檚 important to identify and learn from high-performing schools, others caution against concluding that schools alone can close achievement gaps between students of different racial and social backgrounds.
鈥淪ome schools do a much better job with disadvantaged children than other schools,鈥� said Richard Rothstein, the author of Class and Schools: Using Social, Economic, and Educational Reform to Close the Black-White Achievement Gap. 鈥淚 think we know a little bit about what their best practices are, and those should be duplicated and imitated.鈥�
Still, he added, 鈥渢oo many people are quick to conclude that because some schools do better than others, therefore, schools can close the achievement gap on their own. There鈥檚 no evidence for that.鈥�
鈥淣obody is sitting around saying that poverty or social conditions don鈥檛 matter,鈥� said Mr. Dougherty of the NCEA. 鈥淲e鈥檙e trying to say that schools are important, and social conditions are important.鈥�
Nonetheless, he said, 鈥淓ducators have to work with what they have. So the ones who are best at working with what they have are the ones we want to highlight, because they鈥檙e the ones from whom educators can learn.鈥�
Such work is important, said Doug Carnine, a professor of education at the University of Oregon in Eugene and the director of the National Center to Improve the Tools of Education, in part because few controlled experiments are available in education to identify what works. While the NCEA is still refining its methodology, he said, the organization 鈥渋s making concerted efforts to do it well.鈥�
鈥淎nd because of their penetration,鈥� he said, 鈥渋t really deserves attention and support. A framework for a national dialogue around the elements of effective schooling that鈥檚 not so fragmented is really something to nurture.鈥�
