A new study raises questions about a major shift in testing: substituting the SAT or ACT for states鈥� required high school assessments.
The study, by the Assessment Solutions Group, focuses on one slice of the testing question: whether it鈥檚 a good idea to let some Florida districts substitute college-entrance exams for state tests.
But the research also echoes broader questions about states鈥� decisions to use college-entrance tests, statewide, to measure student achievement.
The report concludes that letting Florida districts use the SAT or ACT instead of the state鈥檚 own required Algebra 1 and 10th grade English/language arts tests wouldn鈥檛 be a good idea for a variety of reasons, including:
鈥� Neither college-entrance exam covered all of Florida鈥檚 academic standards. The report鈥檚 authors noted that districts could supplement the ACT or SAT, adding additional questions so all the standards are covered, as other states have done when they use the SAT or ACT. But that choice adds cost and complexity to using a college-entrance exam, the study said.
鈥� The college-entrance exams produce different results than Florida鈥檚 own tests, which 鈥渃asts serious doubt on the interchangeability of the three tests, and the soundness of making accountability decisions based on them.鈥�
鈥� 鈥淟ack of transparency鈥� about the ACT鈥檚 and the College Board鈥檚 accommodations policies leaves an open question about whether all students who need accommodations on the test can obtain scores they can use in college applications.
鈥� Florida might not be able to back up a decision to let some districts use the SAT or ACT with the levels of evidence needed for approval by federal reviewers. (The U.S. Department of Education鈥檚 鈥減eer review鈥� process evaluates, among other things, evidence that a state鈥檚 chosen tests are 鈥渁ligned鈥� to its academic standards.)
ESSA as Catalyst
Florida requested the ASG study because it has been exploring a new kind of testing flexibility offered by the federal Every Student Succeeds Act.
One provision of that law says states may decide to allow school districts to skip their state accountability tests for high school and use a 鈥渘ationally recognized high school assessment"鈥攊n other words, the SAT or ACT鈥攖o measure student achievement.
Only a handful of states are considering granting this kind of flexibility to districts, in part because it complicates the task of getting comparable test reports across districts.
The study raises questions that are larger than what happens if a state lets some districts substitute the SAT or ACT for its own tests. It revisits a question that has been hovering over an accelerating trend: More and more states have been dumping their high school tests and using college-entrance exams instead as their official high school achievement tests.
The question that has troubled testing experts is the one about 鈥渁lignment"鈥�can a college-entrance exam accurately measure whether students have mastered the skills and knowledge in their states鈥� standards?
鈥淚 had exactly that thought as I was working on the report,鈥� said Edward D. Roeber, the lead author of the ASG study. He oversaw assessment in Michigan, a state that uses a college-entrance exam for accountability, and he has consulted on the development of other large-scale tests.
鈥淪tates seem to have this belief that, well, we can just drop our current high school exam, whether it鈥檚 PARCC, Smarter Balanced, or a custom-developed test, and we can get a two-fer by using one of these college-entrance tests. But I鈥檓 not sure they鈥檝e studied it carefully enough,鈥� Roeber said.
It鈥檚 not that it鈥檚 impossible to use the SAT or ACT to measure mastery of state content standards, Roeber said. It鈥檚 possible. But states shouldn鈥檛 assume the switch will work for them. They must conduct diligent alignment studies that will identify how well a college-entrance exam covers their academic standards. Since standards differ from state to state, each state must conduct its own alignment study, or it can鈥檛 claim that the SAT or ACT is fully 鈥渁ligned鈥� to its standards, Roeber said.
As of a year ago, a dozen states were using the SAT or ACT as their official high school achievement test for accountability purposes. Since the SAT has been redesigned, states that use it have not yet gone through the federal peer-review process. But at least a couple of states that use the ACT got letters from the U.S. Department of Education last year asking for more evidence of alignment to state standards and/or a deeper dive into accommodations policies.
Questions about using college-entrance exams instead of standards-based tests all boil down to a choice, said Scott Marion, the executive director of the Center for Assessment, which helps states with large-scale assessment.
鈥淓verything in assessment is a choice,鈥� Marion said. 鈥淒o you use a test like the SAT or ACT, and focus on predicting whether students will be successful in college? Or do you use a test designed to cover academic standards? Which one are you trying to measure?鈥�
Muddling the Message?
Using a college-entrance exam without verifying that it does a good job covering a state鈥檚 standards risks sending confusing messages to schools, Marion said. Teachers will wonder whether they should be teaching the content of the standards their state adopted, or the material covered in a college-entrance exam, he said.
ACT spokesman Ed Colby said that the company supported the study by offering information for analysis, but added that alignment results differ based on the methodology used. ACT backs 鈥渁 more holistic method of alignment,鈥� he said in an email. The ACT believes that its college-entrance exam is 鈥渁 valid measure of college and career readiness and well-aligned to state college and career readiness standards,鈥� he said.
The College Board defended the use of the SAT as a measure of high school achievement. Company spokesman Zach Goldberg said in an email that using the test for accountability saves testing time and 鈥渕easures students on what they鈥檙e already learning in the classroom.鈥� He said that the SAT 鈥渕eets or exceeds every one of the standards for statewide assessments鈥� in the Every Student Succeeds Act, including alignment to state academic standards.
鈥淭he College Board has conducted studies demonstrating the alignment of the new SAT with the current standards in all 50 states,鈥� Goldberg said. 鈥淭he SAT strongly aligns with Florida鈥檚 own standards. We stand ready to support states who want to use the SAT for accountability.鈥�
