澳门跑狗论坛

Assessment

What Happens When States Un-Standardize Tests?

By Alyson Klein 鈥 October 11, 2018 | Updated: October 19, 2018 8 min read
BRIC ARCHIVE
  • Save to favorites
  • Print
Email Copy URL

Few educators are fans of fill-in-the-bubble standardized tests that don鈥檛 yield results until after students leave the classroom.

But when states had a chance to try out richer forms of assessment under , all but two demurred, in part because the pilot comes with tough technical requirements and no extra federal funding.

That doesn鈥檛 mean, though, that states are planning to stick with the Scantron sheets over the long haul.

In fact, several are looking to experiment with new performance assessments that ask students to complete some sort of hands-on task to show what they know or are able to do. Others are moving to use shorter tests throughout the year, instead of one big exam at the end, or redesigning tests to better reflect material students see in the classroom.

鈥淲e鈥檙e seeing a lot of momentum in states across the country around this idea of creating assessments that address student learning in more meaningful ways,鈥 said Lillian Pace, the senior director of national policy at KnowledgeWorks, which supports state and federal policymakers interested in personalized-learning systems. 鈥淣obody right now has the answer, but there is a lot of energy to try to figure out what we could do better.鈥

Equity Implications

Some states, like Georgia, are planning to apply to the Innovative Assessment pilot to support this work, now that the U.S. Department of Education has opened a new window for applications. Three other states鈥擧awaii, Kansas, and South Carolina鈥攈ave also formally signaled interest in the pilot.

But others鈥攊ncluding Kentucky鈥攁re keeping their plans separate from the federal flexibility, at least for now.

One big knock on new forms of assessments is that they aren鈥檛 helpful for equity. It can be hard to compare the results from one district to the next or measure the performance of particular populations of students, like English-language learners and students in special education.

Natasha Ushomirsky, the director of P-12 policy development at the Education Trust, a research and advocacy organization in Washington, is uneasy about the potential downside of the changes for vulnerable children. These students are often given lower-level classroom work than their more-advantaged peers.

鈥淪tatewide annual assessments are a check on those differences in expectation,鈥 Ushomirsky said. 鈥淭hey give parents an objective picture of where their students are in relation to grade-level standards, with the knowledge that that bar is the same across all students, across all schools within the state.鈥

New Wrinkles in Testing: Some Key Terms

States are beginning to embrace new forms of testing, with or without the help of new federal flexibility in the Every Student Succeeds Act. Here are some key terms to know:

Innovative Assessment Pilot: This federal pilot program, created under ESSA, allows up to seven states to try out new forms of testing in a select number of districts, with the goal of eventually taking them statewide.

Performance Assessment: Evaluates students on tasks they perform, or projects they do, rather than on their answers to a multiple-choice test.

Formative Assessment: Instructional techniques that provide teachers with a picture of what students are learning in real time. They鈥檙e typically used to shape instruction.

Summative Assessment: an end-of-year test that gauges student learning over the course of a year or more. Often used for federal or state accountability.

Source: 澳门跑狗论坛

States that want to shift away from that model need to think carefully about how they will continue that comparability and objectivity, she said.

But fans of the new approaches鈥攊ncluding some top state officials鈥攕ay that over the long haul they might actually end up providing a better gauge of whether vulnerable students are learning, and where their trouble spots are.

鈥淭he same kids who have been behind for the last 30 years are still behind,鈥 said Scott Marion, the executive director of the Center for Assessment, a nonprofit that works with states on testing. 鈥淭he big advantage of using these richer types of assessments is that it will hopefully reveal to people what do these kids need to do next.鈥

Lindsay Jones, a vice president and the chief policy and advocacy officer at the National Center for Learning Disabilities, is proceeding carefully.

The current system has helped shine a light on the performance of students in special education, she said.

鈥淲e are not willing to reverse the progress that has been made. So we鈥檙e cautious about any new approach,鈥 she said. At the same, 鈥淚 don鈥檛 think the assessments, the current assessments, do a good job of really showing what students with disabilities, or frankly any other student, really know.鈥

Classroom Exposure

Some states that are moving forward on new testing regimes say they place equity concerns at the center of their approach.

currently part of the federal pilot. (New Hampshire, , is the other).

The Pelican State is planning to combine literacy and social studies tests, using passages from books that students have already been exposed to in class, as opposed to something that鈥檚 brand new and just for the test. Students will take the tests a few times a year, instead of as a traditional end-of-the-year exam.

The new regime could end up being a better gauge of what vulnerable children know, said John White, the state commissioner of education.

Right now, standardized tests such as the ACT college assessment strive to be accessible to students from all backgrounds because they typically measure skills like reading comprehension using passages from books no student has seen before, he said.

But those tests may be more biased than educators think, White added. For instance, if a supposedly 鈥渃ontent-agnostic鈥 test includes a passage on France, a student who has been to that country will likely do better than ones who have no prior knowledge, even if their reading skills are at the same level, White said.

鈥淚t may be that actually pretending that you can have a knowledge-agnostic assessment is the less-equitable thing to do, and instead what is more equitable is actually to be transparent as to what content will be on the assessment and to give everybody an equal opportunity to access that knowledge, prior to the assessment,鈥 he said.

Measuring 鈥楽oft鈥 Skills

Can tests measure tough-to-quantify skills like collaboration alongside math and science? Kentucky officials are hoping so.

The state is in the early stages of getting started on what David Cook, the state鈥檚 director of innovation, hopes will eventually be a widely used, competency-based learning system, complete with assessments that measure so-called 鈥渟ofter鈥 skills鈥攍ike communication鈥攁longside the traditional reading, math, and social studies.

The state is starting small. Two districts have agreed to try out to find ways to gauge a student鈥檚 ability to be a critical thinker, empowered learner, collaborator, engaged citizen, and communicator. Eventually, academic subjects will be incorporated into the mix, and more districts will be part of the project.

The districts want to move to 鈥渟omething other than just a paper and standardized bubble-in test, they want something more than that,鈥 Cook said.

For now, at least, those districts will have to test students using both the performance tasks and the traditional state test, because of federal and state accountability rules.

But they are OK with that, Cook said.

鈥淭hey鈥檝e committed to say we鈥檙e willing to serve two masters for as long as it takes,鈥 Cook said.

The parallel testing systems might not go on forever. Kentucky may decide to apply for the federal pilot if the state believes that every district would eventually be ready to embrace competency-based learning and performance assessment, Cook said.

Cook thinks that, eventually, the performance-based assessments will capture what vulnerable groups of students know and are able to do better than traditional tests, which expect every student to be in the same place, on the same day.

A competency-based system would allow students to master skills on their own timetable, within reason, he said.

鈥淚 get that there鈥檚 a lot of concern about performance tasks not being equitable, but if you think about them right they can be more equitable. Way too many kids who don鈥檛 do well in the current environment,鈥 Cook said.

Formative Assessments

Georgia is : formative assessments.

The Peach State ran its own miniature innovative assessment competition, and ended up giving three consortia of districts the green light to work on assessments that help teachers gauge where students are and adjust instruction. The formative assessments would be rolled into a 鈥渟ummative鈥 score for the year.

The overall goal is to give teachers a better picture of how their students are doing in real time. The state is hoping these locally created assessments will be a better fit for districts than the state test, called Georgia Milestones.

Eventually, state officials are hoping that all Georgia districts will have a choice of any of the three formative assessment systems.

Matt Jones, the chief of staff for the Georgia Department of Education, said he thinks the more frequent tests will help better capture what vulnerable students know.

鈥淭he more instances you have to measure a learner, the bigger picture you鈥檙e going to have of learning. The formative piece is going to paint a fuller picture,鈥 he said.

Meanwhile, Michigan is just beginning to contemplate new kinds of tests that would be tied into the 鈥渃ompetency-based鈥 instruction that seven of its districts have been experimenting with for the past couple of years, said Andrew J. Middlestead, the state鈥檚 director of the office of educational assessment and accountability.

The state may apply for the innovative assessment pilot down the road鈥攂ut not in time for the December 2018 deadline set by the federal Education Department for the next round.

If it applies for the pilot, the state will need to carefully think through how its plans for a new kind of test will impact vulnerable groups of students, Middlestead said. The state wants to make sure that it can create 鈥渟omething that is approachable for all kids,鈥 before moving forward, he explained.

Districts in Virginia are working on 鈥渟tudent led鈥 assessments, which ask children to demonstrate their learning and knowledge in a meaningful way and to reflect on their own performance.

And some districts in Colorado are developing portfolios, capstone presentations, and other outside-the-box demonstrations to show students are ready for the workforce or postsecondary education鈥攁 graduation requirement for the class of 2021 and beyond. Districts can also use standardized tests, like Advanced Placement or the SAT, or industry certification to demonstrate that their students are prepared for what comes after high school.

Elliott Asp, a senior partner at the Colorado Education Initiative, and his colleagues are working with more than a dozen districts and schools that want to go the performance task or presentation route. In his mind, they can be just as rigorous as the nationally recognized tests.

鈥淚t鈥檚 not an easy way out for kids,鈥 Asp said. 鈥淲e鈥檙e trying to raise the bar for every kid through this process.鈥

A version of this article appeared in the October 24, 2018 edition of 澳门跑狗论坛 as States 鈥楿n-Standardize鈥 Their Tests, But Give ESSA Pilot a Pass

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of 澳门跑狗论坛's editorial staff.
Sponsor
Reading & Literacy Webinar
Literacy Success: How Districts Are Closing Reading Gaps Fast
67% of 4th graders read below grade level. Learn how high-dosage virtual tutoring is closing the reading gap in schools across the country.
Content provided by 
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of 澳门跑狗论坛's editorial staff.
Sponsor
Artificial Intelligence Webinar
AI and Educational Leadership: Driving Innovation and Equity
Discover how to leverage AI to transform teaching, leadership, and administration. Network with experts and learn practical strategies.
Content provided by 
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of 澳门跑狗论坛's editorial staff.
Sponsor
School Climate & Safety Webinar
Investing in Success: Leading a Culture of Safety and Support
Content provided by 

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide 鈥 elementary, middle, high school and more.
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.

Read Next

Assessment Opinion 'Academic Rigor Is in Decline.' A College Professor Reflects on AP Scores
The College Board鈥檚 new tack on AP scoring means fewer students are prepared for college.
4 min read
The United States Capitol building as a bookcase filled with red, white, and blue policy books in a Washington DC landscape.
Luca D'Urbino for 澳门跑狗论坛
Assessment Opinion Students Shouldn't Have to Pass a State Test to Graduate High School
There are better ways than high-stakes tests to think about whether students are prepared for their next step, writes a former high school teacher.
Alex Green
4 min read
Reaching hands from The Creation of Adam of Michelangelo illustration representing the creation or origins of of high stakes testing.
Frances Coch/iStock + 澳门跑狗论坛
Assessment Opinion Why Are Advanced Placement Scores Suddenly So High?
In 2024, nearly three-quarters of students passed the AP U.S. History exam, compared with less than half in 2022.
10 min read
Image shows a multi-tailed arrow hitting the bullseye of a target.
DigitalVision Vectors/Getty
Assessment Grades and Standardized Test Scores Aren't Matching Up. Here's Why
Researchers have found discrepancies between student grades and their scores on standardized tests such as the SAT and ACT.
5 min read
Student writing at a desk balancing on a scale. Weighing test scores against grades.
Vanessa Solis/澳门跑狗论坛 + Getty Images