Dozens of states are falling short in giving the public a clear window into the school data they鈥檙e required to collect and report under the , an advocacy group says, including a breakout of test score data, achievement, and discipline disparities among vulnerable groups of students, and teacher quality information.
That verdict comes in a issued April 3 by the Data Quality Campaign, which pushes for more transparent use of school and student data, and which looked at state school report cards for the 2017-18 school year, the most recent available.
鈥淎n alarmingly high number of parents have never looked at [states鈥� school] report cards, and it鈥檚 not because they don鈥檛 want that information,鈥� said Paige Kowalski, the vice president of policy and advocacy for the organization. 鈥淚t鈥檚 because they don鈥檛 know how to get it, and they鈥檙e not able to read it.鈥�
The architects of ESSA sought to provide the public a much more comprehensive understanding of how America鈥檚 public schools perform by requiring states to include in their annual school report cards both inputs鈥攕uch as how much states and districts spend on individual schools鈥攁nd outputs like achievement gaps among a multitude of student subgroups.
That approach is a sharp break from the days of the No Child Left Behind Act, when states were only required to annually report disaggregated test scores and graduation rates.
But, the DQC鈥檚 鈥淪how Me The Data鈥� report says many states still aren鈥檛 complying with large swaths of ESSA鈥檚 reporting requirements. Beyond that, the report says, many report cards are especially hard to navigate and understand.
Among the report鈥檚 findings, as of the 2017-18 school year report cards:
- Forty-two states failed to disaggregate achievement data for at least one federally required subgroup, such as racial groups, English-learners, those with disabilities, or military-connected students, which is required on the report cards.
- Half of states don鈥檛 include suspension and expulsion data, even though the law requires them to post that information.
- All but four states don鈥檛 include how many effective teachers work in schools, data they must collect but don鈥檛 have to post on their report cards.
- Ten states that hold schools accountable for student test score growth don鈥檛 include that data on their report card, a federal requirement.
- Only five states fully complied with a new requirement to break out school-by-school spending.
But the Council of Chief State School Officers said several conclusions in the report were outdated, inaccurate, and misleading.
鈥淭his year鈥檚 report, we don鈥檛 think, accurately captures what鈥檚 happening in states and with their report cards,鈥� said Melissa McGrath, CCSSO鈥檚 chief of staff. 鈥淚t鈥檚 a snapshot in time.鈥�
Serving Parents
State education departments have said retrieving so much data and displaying it in a way that鈥檚 鈥渆asily accessible and user-friendly鈥濃�攁s the law requires鈥攊s expensive, technically complicated, and politically delicate.
In addition, emaciated state departments have had to navigate a slew of data-privacy laws that can curtail what states are allowed to display on their report cards.
Many state officials say they are gathering feedback and working to improve their report cards for the next rollout this fall.
鈥淎 lot of things that we had to punt [weren鈥檛] just because it鈥檚 hard and we don鈥檛 want to do it, but because it takes time and resources,鈥� said John Kraman, chief information officer for Mississippi鈥檚 department of education.
Because ESSA鈥檚 regulations were scrapped in 2017 by the Trump administration, states are not beholden to a deadline for when to comply with the report card portion of the law. The DQC also points out that several states have placed some data points on a separate report card used mostly by researchers and practitioners rather than the public, though that defeats the purpose of the law, they said.
The group is urging state lawmakers to set aside more funding for states to collect better data and redesign their school report cards.
Using the Information
School report cards are heavily relied upon by the real estate sales industry to set housing prices, politicians to determine policy initiatives, and parents to figure out which school to send their child to. There remains a large gap between the public鈥檚 perception of how America鈥檚 public schools perform and how they actually perform, according to several surveys and many advocates attribute that to the quality of states鈥� report cards.
In its first 鈥淪how Me the Data鈥� report in 2016, which looked at state report cards when NCLB was in place, DQC found that more than a third of state departments buried their report cards in hard-to-find corners of their websites, that 10 states hadn鈥檛 for years updated test scores and graduation rates, and that only four states actually met No Child Left Behind reporting requirements, even though the law was passed 15 years prior.
ESSA, for advocates, practitioners, and state department officials alike, was seen as a reboot. The latest report looked at one elementary school and one high school in every state鈥檚 2017-18 ESSA report card to evaluate how states stacked up on a set of self-selected metrics such as how user-friendly report cards are and how closely they align with ESSA鈥檚 requirements.
The DQC found that more than 31 states now have mobile-friendly report cards, 35 states offer downloadable data, and 42 states鈥� report cards now show up within the first three results in internet searches.
Kowalski said that states got especially creative with ways to display data.
Rhode Island鈥檚 department of education, for example, allows principals to highlight in a 350-word essay on school report cards what makes their school unique and share pictures of the school. Users can then use separate tabs to compile different data points about school climate and test scores.
鈥淲hat I charged my team with is to make it super clean, think about voice and audience, and also make it [customizable] like Build-a-Bear,鈥� said Ken Wagner, the commissioner of Rhode Island鈥檚 department of education.
The state also charts the schools that have mostly poor students but academically perform exceptionally well.
鈥淲e wanted to show that there are real, academically successful high-poverty schools with real principals,鈥� Wagner said. 鈥淎nyone who tells you poverty is destiny is lying.鈥�
Soft Spots
But DQC staff members were alarmed at how few data points states displayed on those user-friendly report cards, including for vulnerable groups of students, discipline data, student growth, and teacher effectiveness.
鈥淭his is information that communities are really hungry for, and we found it wasn鈥檛 published anywhere on the report card,鈥� Kowalski said.
California in 2017 released a report card that got so much political backlash for being confusing and incomplete that Gov. Jerry Brown in his last budget proposal set aside more than $300,000 for the state鈥檚 education department to redesign it. The state got rid of its pie charts, included better explainers of how to navigate the report card, and ditched more than 80 percent of the pages that users have to click through to get to some data points.
鈥淭he dashboard is intended to be a tool that parents, teachers, and school leaders can use to begin conversation that we know is important: to improve all of our schools in California,鈥� said Sara Pietrowski, a policy consultant for the department.
State departments have said that redesigning report cards was especially difficult. State lawmakers often wanted different data points highlighted than district officials and teacher groups did, and those requests sometimes conflicted with what parents groups wanted.
In some instances, such as with absenteeism rates and school spending amounts, states had to craft new definitions and then train district staff members on how to insert the data into sometimes-outdated data systems.
States have also struggled to compile data points from several different databases.
The office for civil rights at the U.S. Department of Education, which compiles and reports a large portion of the data ESSA now requires states to report, released its data significantly late last year. States said much of that federal data was inaccurate and so they left it off their report cards.
CCSSO officials said the DQC marked states down for not reporting some things, such as teacher effectiveness, even though ESSA doesn鈥檛 require states to post that data on their report cards.
鈥淚 think all states are striving to make sure that they meet the requirements in the law and respond to the feedback they鈥檙e hearing from parents,鈥� McGrath said. 鈥淪ome states are going to take longer than other states.鈥�
Mississippi鈥檚 department of education said that because of the delay of OCR data and challenges in compiling other data, it decided to come out with several versions of a redesigned report card. With every version, officials have been bombarded with feedback from parents, teachers, administrators, and lawmakers.
鈥淲e鈥檙e over-the-moon excited about how much feedback we鈥檙e getting from the field,鈥� said Kraman, from the Mississippi education department. 鈥淲e鈥檙e continuously driving to meet a variety of needs across the state. We want to meet them where they are.鈥�
