The number of schools that have failed to make 鈥渁dequate yearly progress鈥� under the federal No Child Left Behind Act is proving to be a moving target, as states clean up erroneous data and grant appeals to schools that challenge the unwanted label.
In Texas, the number of campuses that met their annual improvement targets rose from 74 percent to 81 percent, following numerous appeals. The proportion of Mississippi schools that made adequate yearly progress jumped from about half to 75 percent after the state changed one of its criteria for rating schools. In Illinois, more than 300 schools may have been wrongly identified as not making adequate progress because of coding errors.
Many state officials describe the fluctuating numbers as a temporary problem that will abate as educators gain more experience with the legislation that President Bush signed into law two years ago this week. This school year marks the first time that schools have been identified as making or not making adequate yearly progress based on the complex formula in the federal law, a reauthorization of the Elementary and Secondary Education Act.
Schools receiving Title I money that consistently fail to meet their targets face increasingly severe sanctions, such as a requirement that their students be allowed to transfer. States also must design rewards and penalties for non-Title I schools. 鈥淚 think a large part of the problem is that this is a huge data-collection effort, and it鈥檚 a new process for states. It鈥檚 very complex,鈥� said James A. Watts, the vice president for state services for the Atlanta-based Southern Regional Education Board.
鈥淎s a result, in the first go-round, it鈥檚 been difficult for states to make certain this data is together enough in an appropriate and accurate fashion,鈥� he said. 鈥淭hat鈥檚 why there鈥檝e been revisions.鈥� States were supposed to identify the number of schools that failed to make adequate progress based on 2002-03 data before the start of the current school year, so that parents could avail themselves of choice or supplemental services. By Dec. 22, states had to provide the U.S. Department of Education with a list of Title I schools identified for improvement, corrective action, or restructuring under the law because they had failed to meet their targets for multiple years. Federal officials said late last month that the 鈥渙verwhelming majority鈥� of states had submitted those numbers on time, although they did not have a final count.
Participation Rates
Many of the appeals lodged by schools and districts with their states focus on the law鈥檚 requirement that schools test 95 percent of their students and 95 percent of those in each of several specific subgroups: racial and ethnic minorities, students from poor families, students with limited English, and those with disabilities.
Some states have given schools leeway in meeting the participation requirement as part of the appeals process, in part because the absence of just a few students can mean the difference in meeting, or not meeting, progress goals.
Texas, for example, decided to grant an automatic appeal to any school in which fewer than 10 students overall or in any subgroup failed to participate on test day鈥攅ven if the school missed the 95 percent mark.
Criss Cloudt, the associate commissioner for accountability and data quality in the Texas Education Agency, said the state decided to adopt a uniform rule to avoid making more subjective judgments about what qualified as a bona fide absence on a case-by-case basis.
鈥淲hat about the student who鈥檚 in a coma, home awaiting a liver transplant?鈥� she said. 鈥淲e had one school where a group of five or six students got into a fight and all the students were expelled鈥� and, therefore, didn鈥檛 take the tests.
Of the 507 appeals the state granted, Ms. Cloudt noted, 95 percent of the schools had test-participation rates of 90 percent or higher. The lowest participation rate was 82 percent. Schools were largely unaware of the participation requirement at the time of testing, she added, because federal officials had yet to approve the state鈥檚 accountability plan under the No Child Left Behind law.
Nevada officials have agreed with district decisions to grant appeals to schools that tested at least 90 percent of their students, in part because that鈥檚 what the state mandated in the past. The legislature raised the test-participation requirement to 95 percent last June to comply with the federal law, well after spring testing.
鈥淲e had originally requested from the federal government that we allow a 90 percent participation rate this first year,鈥� said Paul M. La Marca, the director of assessments, program accountability, and curriculum for the Nevada education department. 鈥淎lthough they were sensitive to our predicament, they said no. But we did indicate to them that, given the inconsistency in state and federal requirements, we expected it to be an appeals issue.鈥�
鈥淲e fully expect that this next year, 95 percent will be the target, and we won鈥檛 be granting those appeals,鈥� he added.
California officials have granted additional leeway on the test-participation rule to high schools and those with fewer than 100 students. Preliminary results showed that 65 percent of the state鈥檚 high schools had failed to make adequate progress solely because of the participation requirement, said William L. Padia, the director of the policy and evaluation division for the state education department.
The state decided to grant appeals to high schools that tested at least 90 percent of their students on the California High School Exit Examination鈥攖he test used to comply with the federal law鈥攁nd at least 95 percent on the California Standards tests in English and mathematics. Schools with fewer than 100 students won their appeals if five or fewer students failed to take part in state tests.
California has yet to release final figures on the number of schools granted appeals.
Federal Monitoring
Whether the U.S. Department of Education will permit such appeals is an open question. 鈥淲e鈥檙e currently in conversations with them about it,鈥� said Ms. Cloudt of Texas. 鈥淭here鈥檚 not a resolution, as far as I know.
鈥淲e thought it was pretty clear that the appeals process was in the purview of individual states,鈥� she added.
Similarly, Mr. Padia of California said: 鈥淥ur perspective is that we had the administrative authority to run the appeals process. As long as we weren鈥檛 flying in the face of the law, we were OK.鈥�
Ron Tomalis, the acting assistant secretary for the federal office of elementary and secondary education, said: 鈥淲e gave great flexibility to the states in putting an appeals process in place with the understanding, or the caveat, that it has to remain consistent with the law. You can鈥檛 rewrite the law through an appeals process.鈥�
He said the department would talk with states about the appeals process, as needed, as part of ongoing monitoring efforts.
In Mississippi, the proportion of schools making adequate progress jumped from about half to three-quarters, after the state switched the additional academic indicator it used to rate elementary and middle schools鈥攁 move it made with the federal government鈥檚 approval.
In addition to rating schools based on test-participation rates and the percent of students who score at or above the proficient level on state tests, states must choose at least one additional academic indicator鈥攇raduation rates at the high school level, and an indicator of their choosing for elementary and middle schools.
Originally, the state had planned to use a 鈥済rowth indicator鈥� that measured how much academic progress students made from year to year as the additional academic indicator. But Susan M. Rucker, an associate superintendent in the Mississippi Department of Education, said that measurement proved to be too complicated in the context of the federal law, so the state switched to attendance rates.
Coding Problems
A bigger problem in Minnesota and other states has been cleaning up coding problems and other data errors.
In Illinois, coding errors related to test-participation rates for student subgroups may have led to the mistaken identification of more than 300 schools as not having made adequate progress. For instance, some students who were identified as low-income on enrollment data may not have been identified as such on test forms.
The state board of education announced last month that the schools could recheck their data and have the results recalculated. The state received more than 200 phone calls and dozens of letters and e-mails from administrators questioning the AYP calculations. Illinois schools also threw out thousands of tests by students who enrolled after Sept. 30, a policy designed to avoid penalizing schools with high mobility. Some say the policy has led to inflated test scores at some schools.
While states had hoped to cross-check results in private, before the numbers were publicly released, 鈥渟unshine laws鈥� in some states made that impossible.
Minnesota gave schools 30 days to make changes to their data after the state education department drew up its preliminary list. The state even set up an online computer system to help work through those changes.
鈥淭here were 14,000 individual data changes made by schools during that 30 days,鈥� said Bill T. Walsh, the director of communications for the state agency.
As the deadline for releasing the data drew nearer, however, newspapers began asking to see the list. Mr. Walsh sought the opinion of the state attorney general鈥檚 office, which confirmed that even the preliminary data were public under state law.
鈥淚t was a little bit painful,鈥� Mr. Walsh said. 鈥淭he frustrating part, as a state agency, was a school might have been identified due to errors the school made in inputting the data. But it looked like the state put out a faulty list.鈥�
In the end, 93 Minnesota schools, after correcting their data, were removed from the list of those failing to make adequate progress. Based on that experience, the department and the governor鈥檚 office are seeking state legislation that would remove the preliminary AYP calculations from the state鈥檚 open-records laws.
First-Year Woes
State officials in Minnesota and elsewhere hope that the problems represent understandable first-year glitches.
鈥淚t certainly hurt the credibility of the law a little bit, but I think in Minnesota, it鈥檚 a one-year problem,鈥� Mr. Walsh said. 鈥淚n the past, there was not a lot of incentive for schools to be perfectly accurate with where Johnny and Julie took their tests, and whether they were limited-English-proficient or not. The stakes weren鈥檛 high on keeping very good numbers.鈥�
Now, that鈥檚 changing. 鈥淲hat鈥檚 happening is, since it鈥檚 so high-stakes for everybody, data that the schools normally wouldn鈥檛 correct, they鈥檙e going back through the test publisher and correcting鈥攁t substantial costs to them to do this,鈥� Mr. Padia of California said.
鈥淪o, until the system settles down, it鈥檚 going to be real tough at first, which is why we鈥檙e trying to be as generous as possible in the early couple of years,鈥� he added. 鈥淪chools are reeling from postings and appeals and all this stuff.鈥�
Staff Writer Joetta L. Sack contributed to this report.
