澳门跑狗论坛

The debate about 鈥渧alue added鈥� measures of teaching may be the most divisive topic in teacher-quality policy today. It has generated sharp-tongued exchanges in public forums, in news stories, and on editorial pages. And it has produced enough policy briefs to fell whole forests.

But for most of the nation鈥檚 teachers, who do not teach subjects or grades in which value-added data are available, that debate is also largely irrelevant.

Now, teachers鈥� unions, content-area experts, and administrators in many states and communities are hard at work examining measures that could be used to weigh teachers鈥� contributions to learning in subjects ranging from career and technical education to art, music, and history鈥攖he subjects, in other words, that are far less frequently tested.

The work, which has taken place quietly, in contrast to the larger value-added conversation, is renewing interest in alternative sources of achievement information.

鈥淎 standardized test is very useful to take a snapshot of the inventory of knowledge and skills that a student has, but it鈥檚 not as useful to change teacher practice and improve strategies and determine what needs to happen next,鈥� said Laura Goe, a principal investigator for the federally financed National Comprehensive Center for Teacher Quality, who has worked with several states on teacher evaluations.

Such work is also giving way to questions about how to make sure that alternative measures鈥攕uch as projects, portfolios scored according to guidelines, and classroom-based assessments鈥攁re both rich sources of data and provide comparable information about teachers and their impact on student learning.

鈥淚 would say this has been a very challenging area because it鈥檚 so high-risk in a sense,鈥� said Lawrence T. Waite, the program manager of a teacher-evaluation initiative housed at the New York State United Teachers, or NYSUT. 鈥淯sing growth is new. Certainly, teachers look at student learning every day, but we鈥檙e now doing this to look at teachers鈥� impact on student learning, which raises the stakes on the use of that assessment instrument.鈥�

If the debate seems wonkish and academic, the consequences are anything but. In a wave of legislative action last year, nearly a dozen states took steps to require teacher-evaluation systems to consider evidence of students鈥� academic growth.

Value-added measures rely on state standardized tests to generate the individual teacher estimates and are typically available only in reading and mathematics in grades 4-8.

One widely cited statistic puts the proportion of those who teach in nontested grades and subjects at about 70 percent, but technical issues can push the figure much higher. Under the District of Columbia鈥檚 IMPACT teacher-evaluation system, just 15 percent of teachers have individual value-added data, according to school district officials.

And because legislation in several states, including New York, Rhode Island, and Tennessee, requires evaluations to weigh multiple measures of a teacher鈥檚 contribution to student learning, all teachers in those states will need more than just value-added statistics to show that they are effective.

Bringing Teams Together

In New York and Rhode Island, the American Federation of Teachers has played a role in helping shape all aspects of 10 districts鈥� teacher-evaluation frameworks.

Through a $5 million federal Investing in Innovation grant, as well as a cut of the AFT鈥檚 own , the union has brought together teams of education leaders from participating districts. Each team consisted of the superintendent, teachers鈥� union president, and other representatives, including classroom teachers.

鈥淥ur group was excited and exhilarated and scared to death, all at once,鈥� said Cathy Corbo, the president of the local teachers鈥� union in Albany, one of the districts participating in the work. 鈥淭he process has been pretty intense.鈥�

NYSUT, the state affiliate overseeing the grant, brought in 20 additional content-area teachers to help guide the work of developing measures for non-tested grades and subjects. The teachers discussed textbook units, teacher-made assessments, district exams, and New York state鈥檚 Regents exams, among other things.

In some subjects, tools now used for other purposes could potentially be adapted. History teachers, for instance, could gauge students鈥� progress at making connections between primary- and secondary-source documents, using Advancement Placement materials.

Officials have found that such examples often come with a catch. 鈥淲hat we found is that many of those assessments were measuring the endpoint and not the beginning point [of student learning],鈥� said Mr. Waite of NYSUT. 鈥淭hen the teachers had to grapple with, if the Regents exam is going to be the final test, what would be the pretest?鈥�

Devising Frameworks

Certain subjects, like physical education, writing, art, and career-tech fields are more performance-based and would likely require performance assessments to become part of the mix of measures.

In the Charlotte-Mecklenburg district in North Carolina, a performance-pay program in 20 schools helps teachers, in consultation with their principals, set a rigorous achievement goal for their students and select or craft a variety of assessments to determine if they鈥檝e met that goal, including performance measures.

At West Mecklenburg High School, for instance, Christine E. Kapakos, a teacher of culinary arts and family and consumer sciences, has developed a yardstick to gauge students鈥� knife skills. It measures aspects like knife safety, technique, and whether students can perform a variety of cuts from julienne to rondel with uniformity.

鈥淭hey are such an important part of what we do in culinary,鈥� Ms. Kapakos said. 鈥淚 feel I鈥檓 trying to train students to get a job, so what do employers look for? They look at how well they handle knives, at their speed.鈥�

Teachers in the district can use evidence of student progress on such measures to fulfill aspects of the state鈥檚 teacher evaluation, though there is as yet no formal link between the two.

Student learning objectives are among the more heavily studied options for measuring teacher impact on learning. a correlation between teachers鈥� crafting of rigorous learning objectives鈥攑ioneered as part of Denver鈥檚 ProComp system鈥攁nd higher performance by their students.

鈥淭hey鈥檙e a very precise process, intended to evoke critical and evidence-based thought about a teacher鈥檚 students and lead to objectives for student growth,鈥� said William J. Slotnik, the executive director of the Community Training and Assistance Center, which helped in the development of ProComp and the Charlotte-Mecklenburg pay plan. 鈥淚t鈥檚 trying to bring a higher level of science to a practice鈥攇oal-setting鈥攖hat鈥檚 existed in districts for a long time.鈥�

Rhode Island, which is adopting student-learning objectives as part of its teacher-evaluation system, will be among the first states to use them formally for teacher accountability.

Comparability at Issue

One of the thornier issues the states and districts are confronting has to do with vetting the measures for wide-scale use.

Rules in states like New York and guidelines for the federal Race to the Top competition, which is also helping to pay for much of the teacher-evaluation work around the nation, stress the comparability of measures across classrooms. That could be a harder goal to achieve with individually set student-learning objectives than measures that are adopted districtwide or statewide.

For New York districts involved in the AFT grant, the recommended measures will go through several more reviews by NYSUT teachers before they are made available to the districts to use in their teacher-evaluation systems, said Mr. Waite. Presumably, the agreed-upon measures will be identical for all teachers who share a course or grade.

State officials in Delaware have taken a similar approach to vetting measures. A work group of teachers there is evaluating and will make recommendations on measures to the state, which will approve a selection. Then, groups of teachers in the relevant subjects will take the lead in ensuring that the measures are implemented consistently across classrooms.

The importance of comparability from classroom to classroom is one of the reasons that leaders in the Hillsborough County, Fla., district are relying on end-of-course tests, first developed in the 1980s, to supply most of the teacher-growth information for use in the district鈥檚 teacher-evaluation system. The district recently added pre- and post-test measures to the courses to accord with a state performance-pay plan.

鈥淚t鈥檚 important to have that consistency,鈥� said MaryEllen Elia, the superintendent of the 191,000-student district, about the end-of-course tests. 鈥淚f we determine this is the level of excellence in our district, it鈥檚 important to know exactly where you are. It provides a context to see how you鈥檙e doing relative to others in similar classrooms.鈥�

Challenges Await

Some areas remain a challenge to address.

Ms. Corbo of Albany said that among her union鈥檚 members, finding appropriate techniques for assessing teachers of students with disabilities remains a key concern, as does ensuring teachers aren鈥檛 penalized for the demographic makeup of their classes.

Finally, the officials say that collecting information on the validity and reliability of the measures will be especially important, given that many of them haven鈥檛 been used for teacher evaluation.

鈥淵ou have to spend time looking at the properties of the measure,鈥� said Ms. Goe of the National Comprehensive Center for Teacher Quality. 鈥淚s it something that is going to give us useful information, or is it going to be another 鈥榳idget effect,鈥� where everyone comes out looking good?鈥�