California鈥檚 Sanger Unified School District was collecting vast amounts of data on students for years, from absences to test scores and grades. But that information was stored in a variety of systems, teachers couldn鈥檛 access it in a timely manner, and educators didn鈥檛 have the digital tools they needed to help them use the data to improve instruction.
Now, the bulk of student data is housed in a consolidated student-information system that teachers can use to create assessments, score them, and get the results analyzed immediately, giving them the power to adjust their teaching based on what they鈥檙e seeing and analyzing in real time. Gone are the days of waiting weeks, or even months, to get data about student academic performance.
鈥淚t鈥檚 had a huge impact,鈥 said Dan Grossnicklaus, the student-information-systems manager for the 11,000-student district. 鈥淚n the past, the results were more like an autopsy鈥攏ot much you can do after the fact. Now there can be an intervention before a student leaves the class.鈥
Districts are taking a hard look at the data they have, adding to the information and presenting it to educators in user-friendly ways. Those facts and figures are informing decisions about the deployment of valuable school resources and, in some places, are being shared in a transparent way.
In the Sanger schools, for example, the district deliberately opens up data at all levels. Teachers regularly share student-performance results with their teams to identify areas where instruction wasn鈥檛 successful. Data may show one teacher had good results with a concept, while students of another teacher struggled. Data from classrooms, departments, and schools are also shared regularly at higher levels at an annual principals鈥 summit, Mr. Grossnicklaus said. Principals present data that they鈥檝e analyzed on the performance of their schools, down to the classroom level, to the district administration.
鈥淭he principals analyze the data and highlight where the holes are and where they鈥檙e going to make the changes needed,鈥 Mr. Grossnicklaus said. 鈥淚t鈥檚 a pretty high-stakes presentation.鈥
With all this focus on hard numbers, there鈥檚 no hiding flaws, he said. The process requires trust that there won鈥檛 be a focus on failings, but on how to improve. The district had to negotiate with the local teachers鈥 union to be able to share such data, Mr. Grossnicklaus said.
Thinking Strategically
Like the Sanger schools, many other districts are already collecting statistics on students. The problem is they haven鈥檛 figured out how to use the information strategically to improve student achievement, said Vera Turner of , who is the group鈥檚 project manager for the . Along with the , or COSN, AASA created the initiative to provide districts with free resources to help them choose a learning management system or a student-information system, and to help train educators in how to organize a data initiative and share best practices around data use.
鈥淚n this current environment, there鈥檚 a growing need for accountability and educational data,鈥 Ms. Turner said. 鈥淭his project came about because of a lack of resources to help educators use data more effectively.鈥
That鈥檚 what the 184,000-student Fairfax County, Va., district is doing with its , or eCART, system, said Aron M. Sterling, the eCART manager for the district, which is working with the Closing the Gap project. The system is a central repository for teachers to find and share content, lessons, documents, and other learning resources. Teachers collaborate using eCART to build assessments, and the system analyzes data not only from a particular student, class, school, or school cluster, but also longitudinally, a feature added this year, Mr. Sterling said.
Development of eCART has evolved over the past decade, and it continues to change, he said.
The data system for the Fairfax County, Va., school district has evolved over the last decade. Now, the 184,000-student system uses an Electronic Curriculum Assessment Resource Tool, better known as eCART.
The beginning: eCART began as a simple learning management system run by an external vendor. In its next version, eCART became a district-built system that focused on assessment and curriculum with minimal data analysis.
eCART now: The system houses assessments, lessons, documents, and other learning resources available to teachers. It analyzes student data at the student, class, school, and school-cluster levels. The data can also be analyzed longitudinally. Teachers can collaborate on assessments and other documents.
What鈥檚 new: This school year, the district launched a user-friendly search engine that mimics a shopping experience on Amazon. It uses filters for more targeted results, and teachers can post reviews of different resources.
In the future: Teachers will soon be able to add their own finds to the mix of learning resources available on eCART. The district is working on a data portal to allow parents to access the system and see data analysis about their children. The district hopes to ultimately have the eCART system interact with other district data-collection points, such as attendance or student goals, and find a way for it to factor in such learning opportunities as digital portfolios or other types of open-ended evaluations.
SOURCE: Fairfax County Public Schools
鈥淧art of this is the understanding of the importance of data and where data lies,鈥 he said. 鈥淲e talk about what type of data should be collected and how much is too much. It鈥檚 a real, ongoing conversation.鈥
This school year, the Fairfax County district rolled out a more user-friendly search engine for the system around curriculum resources. It now resembles a shopping search through Amazon rather than a more generalized Google search, Mr. Sterling said.
鈥淭eachers wanted an easy way to filter results. They wanted to know which resources are vetted, which are in-house or which are external,鈥 he said. The district is also adding another way of collecting data: teacher feedback and ratings on those resources.
Adam Schechter, an 8th grade civics teacher at Mark Twain Middle School in the Fairfax County district, said the eCART system helps his team of civics teachers drill down to evaluate where students have struggled on a particular question or standard. If it appears one teacher had difficulty getting that concept across, another teacher who had success can provide strategies for improvement.
鈥淲e鈥檙e not judging one teacher against another. It鈥檚 a more collaborative effort,鈥 Mr. Schechter said. 鈥淲e encourage teachers to get past the idea that they鈥檙e on their own little island.鈥
Empowering Students
In Gwinnett County, Ga., district officials said a new feature of their data system will allow teachers to note, at a glance, whether students are struggling or at risk, said Steven W. Flynt, the chief strategy and performance officer for the 168,000-student school system. Dubbed ABC reports鈥攆or a focus on attendance, behavior, and course completion鈥攖he data system shows each student鈥檚 name in red for struggling, yellow for at risk, or green for doing well based on data in those three areas. The system can vary the data to allow teachers to look at subgroups or across classes.
In the future, Mr. Flynt said, the district plans to improve the system so that it begins making recommendations to teachers for interventions based on the academic difficulties the data reflect.
In Henry County, Ga., leaders of the 40,000-student district are putting data into the hands of students as well as educators. The district is in its second year using a new learning management system, Edgenuity, for classes that blend online and face-to-face learning, and Schoolnet for more traditional classes. Through both systems, students take quizzes and tests鈥攁ll tied to state standards鈥攁nd can later view not only their overall results, but also their performance on a particular standard or question. Students monitor their own progress toward mastering standards.
In addition, the district is piloting a program in the blended learning portion of its Locust Grove Middle School this school year that goes one step further. Students there spend two hours a day working independently on their courses through the learning management system, said Aaryn Schmuhl, the assistant superintendent for learning and leadership services. Using the data collected on their progress, students themselves decide what seminar classes to attend later in the day. Students can also measure their own progress toward course completion, Mr. Schmuhl said.
The district hopes to expand the pilot project to other schools in the future.
鈥淭he students describe it as getting to own their own education,鈥 Mr. Schmuhl said. 鈥淭hey can see the goals and where they need to get to, and they control how to get there.鈥
Aside from getting the data to students and teachers to change instruction, other data initiatives are aimed at the district level.
The Harvard Graduate School of Education鈥檚 Strategic Data Project, launched in 2008, focuses on delving into numbers related to teacher hiring, deployment, and retention, as well as college readiness. The project sends Harvard fellows to work with districts, drill down into their data, and use what they glean to change decisionmaking, said Thomas J. Kane, a professor of education and economics at the graduate school and the faculty director for the , which oversees the project.
Often the problem is not that the information has not been collected, he said. 鈥淭hese questions are answerable questions, but nobody is asking them, and nobody has organized the data to answer them,鈥 Mr. Kane said.
In the 95,000-student Fulton County, Ga., district, which worked with the Strategic Data Project several years ago, the information uncovered by data analysis showed that although many of the district鈥檚 students at the end of senior year said they planned to go to college, not as many as expected actually enrolled after the summer, said Christopher Matthews, the district鈥檚 executive director of counseling, psychological, and social work services.
District officials found that if they hired additional counselors鈥攁nd called, emailed, and texted students with support and reminders about preparing for college over the summer鈥攎ore students actually went to college that first year. After looking at the data collected about that effort, the district refined its efforts, targeting low-income students, because data showed the program had the greatest impact with that group, Mr. Matthews said.
鈥淭his showcased the power of what can happen when you have really good data and you鈥檙e partnering with decisionmakers,鈥 he said.
In the 21,000-student Syracuse city school system in New York, which was recently accepted into the for this school year, administrators hope to use data uncovered by Harvard researchers to gather information on key performance indicators.
Every department鈥攆rom transportation and purchasing to curriculum鈥攚ill examine how its operations affect student achievement, said Brandan Keaveny, the chief accountability officer. The district will try to link, for example, how late buses or a delay in technology purchasing might have fallout for achievement.
鈥淲e can begin to data-mine for relations we didn鈥檛 even think were out there,鈥 Mr. Keaveny said. 鈥淐urrently, the gap between the freshness of data from the operational side to when program and policy decisions are being made is too big.鈥