A portion of the Every Student Succeeds Act that requires states to incorporate nonacademic factors into their accountability systems could help promote a broader vision of school success that extends beyond traditional measures, such as standardized-test scores, educators and policy watchers say.
The newest version of the Elementary and Secondary Education Act, signed into law last month, requires states to use at least one such indicator鈥攍ike measures of student engagement or access to advanced coursework鈥攊n tracking schools鈥� success.
If states select the right indicators and the right methods of measuring and tracking them, the changes could provide schools with a more nuanced view of student success and equity, supporters said.
鈥淪ince we know that what gets measured gets delivered, 鈥� if we broaden accountability systems beyond test scores and schools are required to look at these other things, then the public and parents will start looking at them, and there鈥檚 a better chance that schools will start providing these kinds of things,鈥� said Megan Wolfe, advocacy manager for ASCD, an organization that has pushed for so-called 鈥渕ultimetric accountability.鈥�
But as states put a largely untested policy idea into practice on such a large scale, implementation is everything. If states select indicators that can鈥檛 be accurately measured or influenced by schools, or if they fail to provide schools with the resources they need to carry out new mandates, the indicator requirement could lead to unintended consequences or pushback from educators, K-12 groups and researchers have warned.
And educator groups said there鈥檚 a potential land rush building behind the scenes among advocacy groups that are eager to help reshape educational accountability in their image.
鈥楳eaningful Differentiation鈥�
Specifically, the new law requires states to use at least one 鈥渋ndicator of school quality or student success鈥� that 鈥渁llows for meaningful differentiation in school performance鈥� and 鈥渋s valid, reliable, comparable, and statewide,鈥� alongside academic data in their accountability systems. Schools must also be able to disaggregate data related to that indicator to show how it affects students in different subpopulations: those from all racial and ethnic groups, students with disabilities, children from low-income families, and English-language learners.
The law lists a few examples of possible indicators that states may consider鈥攕tudent engagement, educator engagement, student access to and completion of advanced coursework, postsecondary readiness, and school climate and safety鈥攂ut it also leaves the door open to other indicators of each state鈥檚 choice.
Some states and districts already track those sorts of nonacademic factors on 鈥渄ata dashboards鈥� used to improve school quality, but they are rarely tied to accountability systems that could potentially penalize schools that don鈥檛 perform well.
That鈥檚 in part because many of those factors are difficult to measure in a reliable and objective manner.
For example, teachers and administrators may disagree on what factors schools should consider when gauging postsecondary readiness. It may be difficult to disaggregate some factors, like school safety and teacher engagement, by student subpopulation. And surveys that measure such factors as student engagement could be 鈥渇aked鈥� if teachers coach students on their responses, researchers warn, adding that attaching such measures to high-stakes accountability only increases the likelihood of manipulation.
鈥淭he basic principle is that the minute an indicator has a stake applied to it, it becomes a problematic indicator,鈥� said David Osher, a vice president of the American Institutes for Research, who studies social-emotional learning and school climate issues.
Quality of Measurement
Concerns about quality of measurement are particularly relevant if states consider incorporating factors like students鈥� noncognitive traits and social-emotional skills into their school quality scales. Researchers like Angela Duckworth, a University of Pennsylvania psychology professor who popularized the idea of 鈥済rit,鈥� have warned that existing measures of such factors are prone to flaws and biases and that they should not be used for high-stakes accountability.
Osher said he鈥檚 more confident in measures of factors like school climate because, when asking students whether they feel safe, supported, and challenged at school, their perception is reality. In social-emotional learning, on the other hand, student surveys may be less reliable because students may have inaccurate perceptions about their own skills, he said.
Osher helped districts including Chicago, then under the direction of former U.S. Education Secretary Arne Duncan, and Cleveland develop 鈥渃onditions for learning鈥� surveys that track those conditions in schools, though the districts haven鈥檛 used them for accountability.
Whatever measures states use, they should be mindful that it takes time for schools to change learning environments and to devise strategies to nurture students鈥� relational and personal skills, Osher said. Accountability systems that are too punitive will encourage a condition of 鈥渃hurn,鈥� in which schools quickly abandon strategies and programs before they have the chance to take root, he said.
鈥淚 think the important thing is: How do we help people do this well in a way that produces the types of experiences for students in classrooms and in schools that enhances their learning and development?鈥� Osher said.
Even those who are enthusiastic about the new law acknowledge that some possible 鈥渙ther indicators鈥� are easier to measure accurately than others.
Members of AASA, the School Superintendents Association, are interested in many of the factors tracked by California鈥檚 CORE districts, a group of districts that developed a multimetric accountability system that includes discipline data, social-emotional surveys, and school climate measures, said Noelle Ellerson, the AASA鈥檚 associate executive director.
But not all indicators are created equal, and the success of states鈥� new accountability systems will depend on what they choose, Ellerson said in a forum at the Thomas B. Fordham Institute last month.
Avoiding Unintended Consequences
State school chiefs are in the initial phases of reviewing the nonacademic data they already collect and monitoring how the U.S. Department of Education drafts regulations under the new law as they determine how to broaden their accountability systems, said Kirsten Taylor Carr, the program director for accountability at the Council of Chief State School Officers. Then they will likely explore a number of indicators, deciding which can provide a better view of how different student groups are faring in their schools, she said.
鈥淭he underlying goal is ensuring equity,鈥� Carr said. 鈥淣o matter what the measure is, we鈥檒l always be thinking about does this help us achieve that goal of equity.鈥�
ASCD has stopped short of saying which nonacademic indicators it recommends. It has convened an advisory group of assessment and accountability experts, state decisionmakers, local practitioners, and national organizations to make recommendations, David Griffith, the senior director of government relations, said.
Frustrations with the way the No Child Left Behind law, the previous version of the Elementary and Secondary Education Act, measured school success are 鈥渧ery instructive here,鈥� Griffith said.
鈥淲e are even more so, very on guard as to creating unintended consequences,鈥� he said. 鈥淎nd there鈥檚 good data being collected, but when you start to attach consequences to it, that can change the reporting of it.鈥�
For example, schools could skew data on attendance by tracking it at days and times when more students are typically in school, or they could make it look as if they鈥檝e lowered discipline rates by replacing formal suspensions with more informal classroom removals that wouldn鈥檛 be tracked.
Still others have worried that attaching stakes to high suspension rates will cause some schools to ignore poor behavior they would otherwise discipline, creating a distraction-filled learning environment for other students.
But that cautious tone hasn鈥檛 dampened the enthusiasm of 鈥渨hole child鈥� advocates who鈥檝e been pushing for more expansive data collection and tracking for years.
Hours after the Every Student Succeeds Act was signed into law, the Dignity in Schools Campaign, a coalition of civil rights and student groups, issued a press release urging states to select school climate and safety as their 鈥渙ther indicator鈥� under the law.
