Corrected: An earlier version of this story mischaracterized the leadership and focus of the 鈥渂alanced assessment鈥 consortium.
Includes updates and/or revisions.
Competition opened yesterday for $350 million in federal money to design new ways of assessing what students learn. Rules for the contest make clear that the government wants to leave behind multiple-choice testing more often in favor of essays, multidisciplinary projects, and other more nuanced measures of achievement.
In the for the competition, the U.S. Department of Education says it seeks assessments that 鈥渕ore validly measure鈥 students鈥 knowledge and skills than those that have come to dominate state testing in recent years. It wants tests that show not only what students have learned, but also how that achievement has grown over time and whether they are on track to do well in college. And all that, the regulations say, requires assessments that elicit 鈥渃omplex student demonstrations or applications鈥 of what they鈥檝e learned.
The money for the assessment competition is a slice of the contest, which is financed with money from the economic-stimulus law passed last year.
Of the $350 million set aside for new tests, the Education Department plans to award one or two grants of up to $160 million each for 鈥渃omprehensive assessment systems,鈥 and one $30 million grant that is only for development of end-of-course tests at the high school level. All grants will run for four years. Applications are due June 23, and money will be awarded in September. The department is hosting a meeting in Minneapolis April 22 to offer help to potential applicants.
States must band together in groups, or 鈥渃onsortia,鈥 of 15 or more to apply for the comprehensive-testing grant, with five states designated as 鈥済overning,鈥 or leading, partners. Grant applicants for the high school testing program must also have five states designated as 鈥済overning,鈥 but face no other minimum group-size requirement.
The comprehensive assessment systems developed with the federal money must be able to yield data that can be used to gauge how well teachers and principals are doing their jobs, how instruction and school programs can be improved, and how schools can be judged for federal accountability purposes, according to the 85-page set of regulations.
Tests must be able to measure if students are mastering a 鈥渃ommon set of college- and career-ready鈥 academic standards, and those standards must be adopted by the end of 2011. The and the , with the support of 48 states, have led a move to write , which are undergoing final revision. Federal officials have used states鈥 commitment to those standards as incentives in other programs, such as the main Race to the Top competition. (鈥溾楻ace to Top鈥 Standards Link Questioned,鈥 Dec. 9, 2009.)
In the assessment competition, states would have to put all the tests designed under that program into practice by the 2014-15 school year and figure out by then how well students would have to perform on them to be considered ready, at the high school level, for college or good jobs, or, in the earlier years, on track to be ready for those challenges.
Jack Jennings, whose Washington-based Center on Education Policy has studied the state testing required under the No Child Left Behind Act, said it鈥檚 important to get assessment right because so much rides on it.
鈥淲e鈥檙e relying to a great degree on tests to bring about improvements in schools, but we鈥檝e come to understand that many of these tests are not the best,鈥 he said. 鈥淚f we are going to put this much weight on assessment, we really have to get much better tests, ones that measure higher-order skills and are more useful to teachers. Unless we get better tests, we should question the basic premise of standards-based reform, which is that you can adequately measure the attainment of standards.鈥
Nel Noddings, a professor emeritus of education at Stanford University, said she wondered whether the federal effort to improve testing wouldn鈥檛 be better spent helping teachers do what tests cannot.
鈥淵ou just don鈥檛 need this sophisticated assessment stuff,鈥 said Ms. Noddings, a former math teacher. 鈥淲hat you need is excellent teachers who stay in contact with their kids and work with them day after day. We鈥檝e just gone test crazy.鈥
Not Identical
The high school testing grant differs in some ways from the comprehensive-test program. Assessments designed under the comprehensive-test program, for instance, must yield data that can be used to judge schools鈥 effectiveness. They are also intended for use in federal accountability. Neither expectation applies to assessments designed as part of the high school test program.
Joanne Weiss, the director of the Race to the Top program, said that the high school test competition was designed differently so it can act as a 鈥渓ever for high school improvement,鈥 encouraging states to build more rigor into their secondary school courses without the added pressure of accountability. She added, however, that high school tests designed as part of the comprehensive-test grant program would be subject to that program鈥檚 rules.
Each grant program includes incentives for states to coordinate K-12 and higher education in developing tests, something that is rarely done currently and which some advocates believe would allow schools to better line up their demands with college expectations.
Applicants for the comprehensive-testing grant program get extra points if they can show they have enlisted their four-year college or university systems to help design the tests and to agree to let entering students skip remedial work and enroll in credit-bearing courses if they score at a certain level on those tests. State consortia applying for the high school program get priority if they show their colleges or universities will help design tests that measure achievement in coursework in career and technical education, or in science, technology, engineering, and mathematics.
David T. Conley, a University of Oregon professor whose work focuses on college readiness, commended the incentives for higher education involvement.
鈥淭o use that level of common sense in designing an assessment system is unprecedented,鈥 he said. 鈥淲e tell students in high school that one of the main purposes of their education is to go on and learn beyond high school, but we never sit down together at the table, high school and college instructors, to decide what we expect and how to coordinate and align those expectations.鈥
But Mr. Conley warned that judging college readiness by a test score cutoff鈥攅ven on a vastly improved test鈥攔isks blowing a key opportunity to improve the way schools gauge students鈥 needs as they enter college. What鈥檚 necessary, he said, is a test that can show a broad range of unmet needs, from help with entry-level mathematics to support with study skills. That information can鈥檛 come from a test with a set cutoff point, but from a variety of measurements, he said.
鈥淲e have to get a more robust definition of what it means to be entirely college-ready,鈥 he said. 鈥淭his is an opportunity to do that. But we can鈥檛 limit ourselves to current methods of testing.鈥
Sharing Content
In response to experts鈥 suggestions that the department use the test competition to spur and spread innovation, it is requiring states that compete for the testing money to commit to making test content developed with that money 鈥渇reely available,鈥 including to states not in the consortia and to commercial organizations.
Consortia鈥檚 applications will be evaluated by panels of experts assembled by the Department of Education. They will be scored on a 200-point scale , with the largest portion of points for test design and development and their plans for how research will be conducted to evaluate the tests鈥 validity. But they will also be judged on their plans for how their consortia will operate and how the project itself will be managed. Experts at a series of public meetings held by the department to help shape the application cautioned officials that consortia鈥攅specially larger teams鈥攃an easily stumble on the massive management challenges.
Six potential assessment consortia took shape late in the winter, as states readied themselves to vie for the federal money. Those six have now merged into three, although more could emerge before the June application deadline. (鈥淪tates Rush to Join Testing Consortia,鈥 Feb. 3, 2010.)
Leaders of the groups told 澳门跑狗论坛 that Achieve, a Washington-based organization that works with states to craft standards and accountability systems, is talking with about 30 states, led by Florida, Massachusetts, and Louisiana, about devising a system of summative assessments that would include performance tasks.
The so-called MOSAIC consortium of states, which is focusing on formative assessments, is now working with what鈥檚 being called the SMARTER group, which focuses on computer-adaptive testing, and the 鈥渂alanced assessment鈥 consortium, which is working on a system that will include curriculum-embedded performance tasks scored by teachers. That larger, merged group is being advised by Stanford University professor Linda Darling-Hammond, among others, and led by state chiefs and assessment directors from the states, including Maine, West Virginia, and Oregon. The group currently includes about 40 states, according to Ms. Darling-Hammond. Consortia memberships overlap and are in flux.
Another consortium, including about eight states and headed by the National Center on Education and the Economy, aims to design high school tests modeled on the British 鈥渂oard exams.鈥