For the past five years, the federal No Child Left Behind Act has increased demands on school technology officials to put in place new and better systems to collect and analyze data.
Now that Congress is working to renew the law, educators鈥 hunger for data probably will grow, as will the demand for technology leaders to deliver the information to teachers, administrators, and policymakers in ways that they can use it to improve student achievement. Supporters of the law are floating ideas that would evaluate teachers on the test scores of their students, for example. Members of Congress also are proposing to help schools create a series of tests that track students鈥 learning in preparation for end-of-year assessments.
And most of all, principals and teachers will want numbers to give them clues about how to meet the law鈥檚 ambitious goal of ensuring all students are meeting 鈥減roficient鈥 standards in reading and mathematics by the end of the 2013-14 school year.
Read related story,
鈥淓veryone wants to be [looking at data] because there鈥檚 No Child Left Behind,鈥 says Maria Tukeva, the principal of Bell Multicultural High School in Washington. 鈥淲hat鈥檚 your choice?鈥
Regardless of whether the law is reauthorized this year on schedule, the appetite for data will continue to grow, observers say.
鈥淚 don鈥檛 think this is going to go away, with or without No Child Left Behind,鈥 says Julie A. Marsh, a policy researcher at the ., a Santa Monica, Calif.-based think tank. 鈥淚 think it鈥檚 here to stay.鈥
Right now, the law鈥檚 goal of proficiency for all has educators at Bell High School and schools throughout the country checking all kinds of test scores to track how well students are moving toward that goal.
That鈥檚 going to continue, experts predict, because President Bush and leading Democrats have vowed to keep the proficiency goal in the next version of the law.
To make matters even more challenging, the next version of the law may add new data initiatives.
A blue-ribbon panel convened by the , a nonpartisan Washington think tank, has laid out a plan that would evaluate teachers based on their students鈥 scores on state tests. Each state would rate its teachers according to the progress their students made over the course of an academic year.
Teachers who ranked below the 25th percentile would receive intensive professional development. Teachers who continued to be in the bottom quartile would be prohibited from teaching in schools receiving aid under Title I鈥攖he $12.7 billion federal program for disadvantaged students that is part of the NCLB law.
While the Aspen plan is just one proposal, it is a sign that policy experts are looking to data analysis to answer a pressing question: How do schools identify effective and ineffective teachers?
No 鈥楰iller鈥 System
To meet the demand for such information, school districts will have to overhaul their instructional materials and their data systems to ensure that they are useful to teachers, helping them track students鈥 academic progress and identify the interventions necessary to keep them on course.
At the same time, principals and other administrators will rely on data to evaluate instructional interventions and perhaps their teachers鈥 effectiveness.
To build those capabilities, technology officers probably won鈥檛 need to start from scratch, Marsh of the RAND Corp. and other experts say.
District technology officials should consider building so-called data warehouses instead. Those 鈥渨arehouses鈥 are capable of linking the student and teacher data that most districts now collect in several different databases.
鈥淓ducation data systems are characterized by silos,鈥 says Jeffrey C. Wayman, an assistant professor of educational administration at the University of Texas at Austin who has studied data-driven decisionmaking. 鈥淭hese systems need to be able to talk to each other.鈥
Because existing data systems were designed to meet specific purposes, such as reporting attendance rates to state officials or registering students for high school courses, they can鈥檛 create comprehensive reports on specific students or of groups of them.
In a data-driven world, however, those systems need to be able to deliver numbers that teachers can use in real time.
Because of the time and expense, school technology officials should resist the temptation to completely rebuild their data systems, Wayman advises. Instead, he says, they should look for products that will store various forms of data and provide tools to analyze them no matter what form they鈥檙e in.
Many districts are building their own such tools, he says, while others rely on vendors that specialize in the products.
鈥淭here鈥檚 no 鈥榢iller鈥 system,鈥 Wayman says. 鈥淭hose don鈥檛 exist and probably never will.鈥
Real-Time Data
Right now, many teachers don鈥檛 see much value in the student scores they receive from state tests, according to a by the , a New York City-based coalition of districts and nonprofits that provides professional development for teachers. Forty-two percent of teachers responding said that standardized-test results didn鈥檛 help them at all, and only 37 percent considered the results 鈥渟omewhat useful.鈥
Although the survey participants were self-selected, the 5,600 respondents suggest that teachers aren鈥檛 getting much help from current test results.
鈥淲e should be looking at multiple assessments,鈥 says Ellen Meyers, a vice president of the Teachers Network.
End-of-year tests are not 鈥渋n real time,鈥 she points out, because results often arrive after students have moved to the next grade鈥攖oo late for their teachers to act on the insights their scores might provide.
In the 58,000-student District of Columbia system, for example, schools give an interim assessment in February, just two months before students are scheduled to take citywide tests that are used to determine adequate yearly progress under the No Child Left Behind law.
Just one snapshot so late in the school year isn鈥檛 enough, says Tukeva of Washington鈥檚 Bell High School. Teachers should be able to give such tests regularly and get results almost immediately, she says. Without that capability, teachers aren鈥檛 able to track whether students are making the progress they need to meet end-of-year goals.
鈥淵ou should really give [tests] every five weeks, starting at the beginning of the year,鈥 Tukeva says. 鈥淭hat way, you can adapt right away, instead of saying at the end of the year: 鈥極h, I鈥檓 sorry you didn鈥檛 make proficient.鈥 鈥