澳门跑狗论坛

Assessment

Teachers Say Those Ubiquitous, Every-Few-Months Tests Don鈥檛 Always Capture What鈥檚 Taught

By Sarah Schwartz 鈥 August 23, 2023 5 min read
Student in classroom taking test.
  • Save to favorites
  • Print
Email Copy URL

At some point during the year, most students in U.S. schools will take a benchmark test.

These tests, also called interim assessments, are designed to measure students鈥 progress toward instructional goals and are given every few months. Districts can purchase off the shelf versions鈥擬AP, i-Ready, and Star are common tools, for example鈥攐r create their own tests.

But even though the vast majority of schools use these assessments, teachers and principals have different perceptions of their effectiveness.

More than 80 percent of principals say that, for the most part, the tests they use align to state standards and the end-of-year state-administered tests used for school accountability.

But about a third of teachers say that these interim tests don鈥檛 align with the curriculum and don鈥檛 accurately measure what students have learned. And teachers who report this mismatch are more likely to say that it鈥檚 difficult for them to figure out how the tests should inform their instruction.

These are the findings in a , which analyzed nationally representative survey data from about 1,500 principals and over 6,000 math and English/language arts teachers.

鈥淲e know that many education leaders and school systems are working really hard to help kids recover from the effects of the pandemic,鈥 said Ashley Woo, an assistant policy researcher at RAND and the lead author on the paper. 鈥淧art of that work entails knowing where students are and how to adjust learning to meet students鈥 needs.鈥

The findings underscore an important feature of interim tests: Different assessments are designed to serve different purposes. While some are meant to measure how well students will do on a state summative test, others claim to show whether students have mastered skills and knowledge taught in the curriculum.

Understanding each test鈥檚 intended purpose is crucial to using the data it produces well, assessment experts have stressed. That鈥檚 challenging because the commercial marketplace for these tests is a bit of a black box: Not much is known about the technical properties or assumptions that undergird most of the popular off-the-shelf exams.

While this RAND survey measures educators鈥 perceptions of interim assessments, other recent initiatives have tried to offer external evaluations.

Last year, the nonprofit curriculum reviewer EdReports announced that it planned to release reviews of commercially available interim tests, evaluating them for technical quality and alignment to commonly used curricula.

But in May, the group said that the plan had been paused after several providers of the tests wouldn鈥檛 commit to participation.

How schools use interim assessments

An overwhelming majority of schools鈥99 percent鈥攗se some sort of interim assessment, the researchers found.

Most principals report using both commercially available tests and ones that are locally created鈥攄eveloped by states, districts, or schools. But elementary and middle schools are slightly more likely to use purchased assessments, while high schools are slightly more likely to use those that were locally created.

Using multiple types of tests was common, according to the principal survey. On average, schools administered three different benchmark assessments in both ELA and math鈥攖hough the report notes that not all tests would necessarily be given to all students.

This could be because different types of tests are better suited to different purposes, Woo said.

鈥淔or instance, you might have something like an i-Ready or an NWEA MAP test, which is more standardized and allows you to compare student progress across different schools and districts because lots of different schools and districts are using these assessments,鈥 she said.

Others might measure whether students have learned the skills and knowledge teachers cover in class鈥攖hink unit tests, term papers, or other major assignments. 鈥淭hose kinds of assessments that are specifically designed to align with curriculum are the kinds of assessments that are giving teachers more real-time data,鈥 Woo said.

The report also tracked test use over time, including during the pandemic. The researchers found small but steady growth in schools鈥 use of commercial assessments between the 2018-19 and 2021-22 school years.

Use of the locally created assessments fluctuated, declining during the 2020-21 school year, and then jumped back up during 2021-22. Some of this change could stem from pandemic-related shifts in instruction and assessment, Woo said.

The overall trend in locally created test use during the period of the study is positive, though.

Where principals鈥 and teachers鈥 perspectives on interim tests differ

Principals generally thought that interim assessments could gauge whether students were meeting broad instructional goals. More than 80 percent of principals said that the interim tests they used aligned to state standards and end-of-year summative assessments.

The surveys asked teachers about a different metric: curriculum alignment. A majority, 64 percent, said that interim assessments did align with their curriculum. Still, though, about a third of teachers said they only partially aligned with the curriculum, or didn鈥檛 align at all.

These numbers varied slightly across different groups. For example, ELA teachers were less likely than math teachers to say that their assessments were aligned. Teachers who created their own interim assessments, and teachers who spent more time in professional development analyzing test data, were both more likely to report curriculum alignment.

In general, it seems somewhat difficult for teachers to figure out how interim test data should inform their instruction. Only 37 percent said that was easy to do; another 37 percent said it was difficult, and about a quarter said it was neither.

It was especially difficult for teachers who felt that the interim assessments weren鈥檛 well-aligned with their curriculum: Among those teachers, just 14 percent said it was easy to address student needs identified by their benchmark tests.

In interviews that the researchers conducted with 45 teachers, several mentioned unclear messaging from leadership about how to use the data that these tests provided.

鈥淭his is probably the biggest, most frustrating thing of our district,鈥 said one elementary ELA teacher. 鈥淭hey have adopted so many different ways to benchmark our kids, different formats and different resources. 鈥 And all of these different tests are all different standards, and they don鈥檛 align to our curriculum necessarily. 鈥 Looking at the data, it鈥檚 sometimes hard for us as teachers to know which data [are] important, which do I need to use to show that my children are progressing.鈥

Guidance from district and school leaders is necessary, Woo said. Leaders should know whether benchmark tests align to standards, year-end state tests, curriculum, or some combination鈥攁nd then use that information to convey messages to teachers about how to use them, she said.

鈥淲e think it鈥檚 important for state and local leaders to consider the slate of assessments 鈥 and the role that they expect each assessment to fulfill,鈥 said Woo.

Events

Artificial Intelligence K-12 Essentials Forum Big AI Questions for Schools. How They Should Respond鈥
Join this free virtual event to unpack some of the big questions around the use of AI in K-12 education.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of 澳门跑狗论坛's editorial staff.
Sponsor
School & District Management Webinar
Harnessing AI to Address Chronic Absenteeism in Schools
Learn how AI can help your district improve student attendance and boost academic outcomes.
Content provided by 
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of 澳门跑狗论坛's editorial staff.
Sponsor
Science Webinar
Spark Minds, Reignite Students & Teachers: STEM鈥檚 Role in Supporting Presence and Engagement
Is your district struggling with chronic absenteeism? Discover how STEM can reignite students' and teachers' passion for learning.
Content provided by 

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide 鈥 elementary, middle, high school and more.
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.

Read Next

Assessment Massachusetts Voters Poised to Ditch High School Exit Exam
The support for nixing the testing requirement could foreshadow public opinion on state standardized testing in general.
3 min read
Tight cropped photograph of a bubble sheet test with  a pencil.
E+
Assessment This School Didn't Like Traditional Grades. So It Created Its Own System
Principals at this middle school said the transition to the new system took patience and time.
6 min read
Close-up of a teacher's hands grading papers in the classroom.
E+/Getty
Assessment Opinion 'Academic Rigor Is in Decline.' A College Professor Reflects on AP Scores
The College Board鈥檚 new tack on AP scoring means fewer students are prepared for college.
4 min read
The United States Capitol building as a bookcase filled with red, white, and blue policy books in a Washington DC landscape.
Luca D'Urbino for 澳门跑狗论坛
Assessment Opinion Students Shouldn't Have to Pass a State Test to Graduate High School
There are better ways than high-stakes tests to think about whether students are prepared for their next step, writes a former high school teacher.
Alex Green
4 min read
Reaching hands from The Creation of Adam of Michelangelo illustration representing the creation or origins of of high stakes testing.
Frances Coch/iStock + 澳门跑狗论坛