As the sky outside darkened in the face of a winter snowstorm, 3rd graders at Westridge Elementary School bent their heads over a paper-and-pencil test on electricity and magnetism. Then they walked into the hallway to take the test鈥檚 last part: connecting wires on an electromagnetic circuit board.
If students connected the wires correctly, a small motor on the board would turn on and a buzzer would sound. Their teacher watched from a few feet away as students, one by one, confidently took their places before the circuit board, their hands busily rearranging the wires. Every few minutes, the afternoon quiet was broken by a low but distinct buzz.
That kind of home-grown test of student performance鈥攄eveloped by educators here within the 4,200-student Elkhorn school district鈥攊s par for the course for Nebraska public schools. Not only do such assessments tell teachers what their students know, but they鈥檙e also integral to a learning-measurement system unique to the Cornhusker State.
Instead of relying on statewide standardized tests to comply with the accountability requirements of the federal No Child Left Behind Act鈥攁s is the case in the other 49 states鈥攄istricts in Nebraska use their own academic standards and assessment systems. That鈥檚 about 264 systems, give or take a few.
鈥淲e鈥檙e a local-control state. It鈥檚 about local leadership,鈥 said Doug Christensen, Nebraska鈥檚 plainspoken commissioner of education. 鈥淲e鈥檝e tried to preserve the integrity of what we have in this age of NCLB.鈥
Read the accompanying story,
The state鈥檚 localized assessment system is not universally admired. The state has struggled to get its system accepted by the U.S. Department of Education, for starters.
And late last month, the education committee chairman in Nebraska鈥檚 unicameral legislature introduced a bill that would replace the assessment system with statewide tests, mirroring what other states have done. A public hearing on the bill is scheduled for March 5.
Yet as more states experience battle fatigue amid struggles over accountability, some say Nebraska鈥檚 system鈥攁lthough challenging for educators to develop and implement鈥攈olds lessons for those looking for new options to measure K-12 performance.
The Elkhorn district was on the itinerary, for example, of a group of educators and leaders from education nonprofit groups from California, Hawaii, Minnesota, and Vermont who visited several Nebraska districts last month to pick up ideas for changing their own schools鈥 assessment systems. The Jan. 10-12 鈥渟tudy tour鈥 was sponsored by the Forum for Education and Democracy, an Athens, Ohio-based nonprofit organization.
Another sign of such interest: Testing experts and some state education leaders met this month in New Orleans at a conference of the Washington-based Council of Chief State School Officers to discuss how federal policy could make it easier for states to create their own localized assessment systems. The Forum for Education and Democracy, which is opposed to relying on one set of tests for making such high-stakes decisions as students鈥 grade promotion and graduation or schools鈥 performance status under NCLB, was part of that Feb. 3 meeting.
鈥淎ny state can do this,鈥 said George Wood, the director of the forum and the principal of Federal Hocking High School, in Stewart, Ohio. 鈥淚t鈥檚 just a matter of whether they have the courage.鈥
Not that building a system of local assessments was easy. The learning curve was steep: Local educators practically had to become de facto psychometricians鈥攅xperts in creating assessments and analyzing the resulting data.
鈥淲hat we embarked upon was a massive mind-set change,鈥 said Pat Roschewski, the director of assessment for the Nebraska education department.
Nebraska lawmakers set the wheels in motion in 2000, when they passed legislation requiring school districts to adopt academic standards in reading, writing, mathematics, science, and social studies. The standards had to be as hard as or harder than those the state had already adopted as a model.
Districts then had to create student assessments based on the local standards and report the results to the state. An exception exists for one subject: There is a statewide test for grades 4, 8, and 11 in writing, which state educators consider a cornerstone of learning.
At first, many teachers and administrators pushed back against the new system, called the School-based Teacher-led Assessment and Reporting System, or STARS. Some even wanted Nebraska to give a standardized test like those in other states, Ms. Roschewski recalled.
鈥淲e spent more time trust-building than anything else to convince teachers that this is important,鈥 she said. 鈥淚t was messy. Chaotic.鈥
Teachers felt overwhelmed, agreed Cherie Larson, the director of instructional services for the 1,800-student Plattsmouth community school system. But gradually, with lots of summer, in-school, and weekend training, teachers got on board. 鈥淐reating your own assessments is a big responsibility,鈥 Ms. Larson said. 鈥淏ut you can do it, and do it well.鈥
Seven years later, state education leaders say, teachers have been trained to analyze assessment data. Now they can do a more effective job at adjusting instruction to challenge students and collaborating to fine-tune their district assessments and standards.
鈥淚t鈥檚 not a test piled on top of your curriculum,鈥 said Renee Jacobson, Plattsmouth鈥檚 superintendent of schools. 鈥淸The system] is woven into your curriculum. It鈥檚 part of your culture.鈥
One major challenge, though, has been finding ways to give local educators the time and tools they need to build reliable assessments. Nebraska鈥檚 18 educational service units, or regional education agencies, provide the bulk of the training. ESU 4, for example, based in Auburn, some 68 miles southeast of Lincoln, trains 100 to 140 teachers at a time, said Mitzi Hoback, a co-director of the agency. Teachers gather in small groups for the weeklong summer sessions.
鈥淲hat does a good multiple-choice question look like? If you write an open-ended question, what does the rubric look like to [ensure] consistency in scoring?鈥 asked Ms. Hoback, describing the training.
Teachers are assigned different academic standards, and they collaborate to craft assessments measuring students鈥 mastery of them. Then they pilot the assessments in their classrooms, and meet again during the school year to talk about which ones worked and why.
At Papillion-La Vista South High School, for example, biology instructor Philip McBride pairs up students and gives each team note cards lettered A to D for pop quizzes that are part of the assessment system of the 9,000-student Papillion-La Vista district, outside Omaha. The teacher then asks questions on key biology concepts, and team members figure out the answers together and hold up the right card. After that, Mr. McBride calls on a team that answered correctly to explain its answer.
After initially rejecting Nebraska鈥檚 assessment system as out of compliance with the No Child Left Behind Act, the U.S. Department of Education is now requiring the state to take certain steps by this school year to pass muster with the federal law. To win full approval, the department says the state must:
鈥 Conduct peer reviews of each district鈥檚 standards and assessment system and determine which districts have not met NCLB requirements, in such areas as academic content and achievement standards, technical quality, and assessment and curricula alignment;
鈥 Describe the range of sanctions that the state will impose on districts that fail to meet standards for NCLB compliance; and
鈥 Give evidence of peer review and approval that the assessments for English-language learners meet NCLB requirements
SOURCE: U.S. Department of Education
鈥淚t helps when you hear [the answer] from your peers instead of your teacher,鈥 said 15-year-old Miles Kellett, one of Mr. McBride鈥檚 students.
Sometimes, assessments that work in theory fall apart in reality. In the Elkhorn district just northwest of Omaha, for example, 4th grade teachers Julie Sorensen and Troy Sidders taught their students the basic physics of sailing and then had them build a sail using six straws and a piece of paper to test their understanding of such concepts as velocity and lift. If built correctly, the sails would move forward at least one meter when students blew on them.
The problem, the teachers said, was that some students watched one classmate who quickly understood how to build an efficient sail. Then they just copied him.
鈥淚t would have been great if each kid was in a room with a closed door,鈥 said Mr. Sidders. Now he and Ms. Sorensen are reconsidering their use of the performance test and are devising other tests.
That kind of teacher teamwork and time can be hard to come by in an already crammed school day. Still, neither teachers nor districts are entirely on their own.
The state gives districts $3.5 million a year in STARS grants for staff development in assessment.
1: The assessments reflect the state or local standards.
2: Students have an opportunity to learn the content.
3: The assessments are free from bias or offensive language or situations.
4: The level is appropriate for students.
5: There is consistency in scoring.
6: Mastery levels are appropriate.
SOURCE: Nebraska Department of Education
In Plattsmouth, for example, the district has shaved five minutes off the end of the school day so that teachers have at least 30 minutes to meet at the end of every sixth day. Educators in the 1,360-student Nebraska City district, 48 miles east of Lincoln, meet in teams to review assessments, curriculum, and data throughout the year.
The state also sets guidelines for local assessment systems through criteria developed by the Buros Center for Testing, an independent test-evaluation, -research, and -consulting group at the University of Nebraska-Lincoln.
Districts must annually report to the state assessment data in reading and mathematics. Over the past six years, Nebraska鈥檚 annual report card shows gradual improvement in district-reported test data in reading, writing, and mathematics. Districts will begin reporting science data to the state in 2008, and social studies results in 2009. In addition, districts administer commercial nationally normed tests, such as the Stanford-10 achievement test and CTB/McGraw-Hill鈥檚 Terra Nova tests, as well as the federally sponsored National Assessment of Educational Progress.
Mr. Christensen, the Nebraska schools chief, said that while many states鈥 school systems are like pyramids, with teachers at the bottom and a few state administrators at the top, Nebraska鈥檚 is a series of concentric circles, with teachers in the center as 鈥渋nstructional leaders.鈥
鈥淥ur system is classroom-centered,鈥 he said. 鈥淚t鈥檚 got to come from the classroom up, not the capital down.鈥 That way, he added with a laugh, 鈥渨hen you have a leadership role at the local level, you don鈥檛 have to have as much leadership at the state level.鈥