The states that made the first cut to qualify for a new pilot program that would let them use so-called growth models to judge whether schools and districts meet their performance targets under the federal No Child Left Behind Act are using a variety of approaches to tackle the task.
The Department of Education announced March 31 that it had selected growth-model proposals from eight states鈥擜laska, Arkansas, Arizona, Delaware, Florida, North Carolina, Oregon, and Tennessee鈥攖o move to the next round of reviews for the pilot.
Read more on the Education Department鈥檚 March 31 announcement of . See also the department鈥檚 related to the growth-model program.
The program, which Secretary of Education Margaret Spellings unveiled in November, is designed to test whether an accountability system based on the academic growth students show from year to year would be as fair and reliable as the current system.
To make adequate progress, or AYP, schools and districts currently must meet annual targets for the percent of students who score at least at the proficient level on state tests, both for the student population as a whole and for subgroups of students who are poor, speak limited English, have disabilities, or come from racial or ethnic minorities. With growth models, schools could get credit for students who make progress over the course of the year, but who have not yet reached the proficient level.
The results of the experimental program are expected to figure prominently in the reauthorization of the No Child Left Behind Act, the centerpiece of President Bush鈥檚 education program. The law is due for renewal next year.
Ms. Spellings had initially indicated she would approve as many as 10 state plans for the new program. Twenty states met the Feb. 17 deadline to apply, but only 13 put forward plans to apply growth-model calculations to student-testing data collected from the 2005-06 academic year. The rest were automatically deferred because they were planning to begin their test runs next school year. (鈥淪tates Vie to Be Part of NCLB 鈥楪rowth鈥� Pilot,鈥� Feb. 1, 2006.)
Details Differ
Most of the states that passed the first round of review plan to use the growth-model calculations in conjunction with the current systems and the federal law鈥檚 鈥渟afe harbor鈥� provisions, which are designed to give a second look to schools that don鈥檛 make AYP initially. Under the setup proposed by those states, the growth models would provide a third way that schools could meet achievement targets.
Federal officials are sending proposals from eight states on to the next round of screening for a new pilot program allowing states to consider students鈥� academic growth in measuring whether schools and districts meet performance targets under the No Child Left Behind Act.
*Click image to see the full chart.
SOURCE: U.S. Department of Education
Oregon, for example, proposes to plot out four-year growth trajectories that individual students have to meet, in stair-step fashion, to reach the proficient level by 2014鈥攖he goal for all students under the federal law. Unlike some other state proposals, though, the Oregon plan calls for setting growth targets for students who are already proficient, as well as for those who haven鈥檛 reached that benchmark.
鈥淔rom our point of view, growth cuts both ways,鈥� said Patrick Burk, the chief policy officer for the Oregon Department of Public Instruction. 鈥淯nder the current system, in theory, you could have schools where 51 percent of students are meeting the standard, and they鈥檝e been at that for three years.鈥�
鈥淎nother school, in a high-poverty, high-minority district, might鈥檝e started out at 30 percent [of students reaching proficiency], and then went to 49 percent,鈥� he added. 鈥淭hat鈥檚 19 [percentage points of] growth, but it鈥檚 still below 51 percent, so they鈥檙e identified as failing.鈥� Florida鈥檚 proposal, in comparison, calls for setting a slightly steeper improvement slope, requiring students to meet state standards in three years for schools to achieve AYP.
In its plan, Tennessee set aside its noted 鈥渧alue added鈥� model for measuring school improvement in favor of a system based on projections of student growth three years into the future. State officials would make their predictions by looking at the rate of growth that students are making and comparing it with how long students three years older took to reach proficiency.
鈥淲hat value-added does is it encourages schools and districts to make sure that they are, on average, giving students a year鈥檚 worth of academic growth each year,鈥� said Cory Curl, a senior policy analyst in the deputy commissioner鈥檚 office in the Tennessee Department of Education. 鈥淚t doesn鈥檛 really look at where individual students start out.鈥�
Some Plans Rejected
The federal department rejected plans from five states鈥擟olorado, Indiana, Iowa, South Carolina, and Utah鈥攆or failing to adhere to key criteria for participating in the pilot, according to letters that federal officials sent to those states this week.
Utah鈥檚 model was turned down, for example, because it would have required only 75 percent of students to meet the proficient level by 2014, rather than using the 100 percent target required by the federal law. The state鈥檚 plan also proposed combining student subgroups, such as all African-American, Hispanic, or low-income students at a school, into one large, school-level subgroup in its accountability calculations.
South Carolina鈥檚 proposal missed making the cut because it set higher thresholds for subgroup sizes for students with disabilities and students with limited English skills than it did for other subgroups in determining whether schools and districts met growth targets.
鈥淕enerally, the proposals that went on were serious proposals, and that鈥檚 somewhat encouraging,鈥� said Ross Wiener, the policy director for the Education Trust, a Washington-based research and advocacy group that favors strong enforcement of the law鈥檚 requirements. 鈥淏ut it also leaves some concerns on the table and raises new ones.鈥�
For instance, he said, some of the timelines in the proposals were too long.
鈥淚f you find out a kid鈥檚 behind in 3rd grade, it鈥檚 too long to not expect them to catch up for four more years,鈥� he added. Other state plans, he noted, would have allowed school officials to 鈥渞eset the clock鈥� when students transferred to another district. He also wondered whether some of the plans were, in effect, setting up moving targets by recalculating growth trajectories every year or two.
Another testing expert who scanned the successful proposals, Scott F. Marion, pointed out that plans also differ in the amount of attention they would give to including results from alternative assessments for students with the most serious cognitive disabilities in the state growth calculations. Some proposals would not count scores from those exams in their growth models, he said, while some would. Others failed to address the issue at all.
鈥淵ou would want to make sure that what to do with alternatively assessed kids is not an afterthought,鈥� said Mr. Marion, who is the vice president of the National Center for the Improvement of Educational Assessment. The nonprofit group, based in Dover, N.H., provides research and consulting services on assessment and accountability systems.
Overall, though, observers said this week that the variety in states鈥� plans to measure academic growth could offer useful lessons for evaluating the strengths and weaknesses of the different approaches. The eight successful first-round proposals will now go to a 10-member peer-review panel made up of testing experts, practitioners, state education leaders, civil rights advocates, and representatives of national education groups.
The panel鈥檚 recommendations for acceptance into the program are due to Secretary Spellings next month. A spokesman for the department said the secretary would unveil the final list of program participants later in May.
