澳门跑狗论坛

Includes updates and/or revisions.

An examination of how to size up the performance of principals has found that one evaluation method is best suited for judging the effectiveness of school leaders: the Vanderbilt Assessment of Leadership in Education.

Created in 2006 and just now widely available for districts to purchase, the assessment, called , is the newest of the principal instruments in the review conducted by Matthew Clifford and Christopher Condon, researchers with Learning Point Associates, a nonprofit educational consulting firm based in suburban Chicago. (鈥淎ssessment to Rate Principal Leadership to Be Field-Tested,鈥� Jan. 16, 2008.)

Mr. Clifford said the impetus for was the growing recognition that principals, second only to classroom teachers, affect student learning. Districts need as much information as possible to make high-stakes decisions about whom they hire as principals, how or whether they should invest in their improvement, and how to compensate them, he noted.

鈥淒istricts face critical choices at three points in the principal鈥檚 life with them: at hiring, at the point of evaluation, and at the point of deciding in some cases whether principals receive tenure or advanced certification,鈥� Mr. Clifford said. 鈥淭hey need the best information they can get for these purposes.鈥�

In reviewing eight principal-performance instruments being used by school districts, the researchers concluded that VAL-ED comes closest to measuring the leadership attributes and behaviors that research finds to be associated with how well students perform. VAL-ED also was rated the best among the instruments for validity and reliability, meaning that the assessment measures what it is supposed to measure and yields consistent results.

Only one other instrument the researchers reviewed was developed in this decade. The remaining six date back as far as 1985.

The researchers liked the 鈥�360-degree鈥� approach of VAL-ED, which gives principals feedback about their performance from all the teachers in their school and from the principals鈥� supervisors. Only one other instrument in the review used a similar approach for providing multiple sources of input into an evaluation.

鈥淲hat I think our findings suggest is that we need to invest more in ensuring that these assessments measure what is considered important for school leaders now,鈥� said Mr. Clifford, who is a senior research and policy associate at Learning Point. 鈥淭he demands of the job have changed a lot.鈥�

New Focus to Job

Joseph F. Murphy, a developer of VAL-ED and an education professor at Vanderbilt University in Nashville, Tenn., said the instrument was designed because no existing evaluation system was effectively measuring what had become the most important role for principals: instructional leadership.

鈥淭he profession for 150 years was grounded in management, organization, government, politics, and finance,鈥� Mr. Murphy said. 鈥淭hose things are important, but they are secondary to learning and teaching.鈥�

Even though the expectations for the job have shifted and broad agreement exists in the field on the principal鈥檚 most important role, most school leaders are still being evaluated on two things, Mr. Murphy said: controlling conflict and running smooth operations.

鈥淭hat鈥檚 the reality,鈥� he said. 鈥淯ntil principals know they are going to be evaluated on things like poking their nose into a teacher鈥檚 business, most of them aren鈥檛 going to do it. What we鈥檝e argued is that once a principal is on the job, the strongest leverage point you have to shape their behavior is in the evaluation.鈥�

VAL-ED is now a product sold by the Nashville-based company Discovery Education, a division of Discovery Communications. It became available for widespread commercial use for the current school year, Mr. Murphy said. He does not know how many districts have implemented the system so far, but said school districts in states such as Alabama, Louisiana, and Mississippi are adopting it on a fairly broad scale.

鈥淢ost districts are still using some sort of homegrown evaluation tool for principals,鈥� he said.

Indeed, there are probably hundreds, if not thousands, of evaluation approaches at work in schools, said Mr. Clifford. To decide which ones should be included, he and Mr. Condon limited their review to those instruments that were expressly intended for assessment purposes, were publicly available for purchase, and had been psychometrically tested for validity and reliability. The researchers did not collect data to determine how widespread the use of each instrument is.

The researchers found promising features in each of the eight approaches, Mr. Clifford said.

For example, the Performance Review Analysis and Improvement System for Education, or PRAISE, which dates to 1985, helps each leader 鈥済et a profile of himself or herself and helps chart the next steps in professional development,鈥� said Mr. Clifford. It鈥檚 also practical, in that it takes only 15 to 20 minutes to answer the 81-item assessment.

鈥淭he content could be dated at this point, but we think it has potential,鈥� he said.

Based on their findings, however, Mr. Clifford said VAL-ED is probably the best evaluation tool available. Still, he cautioned that the quality of an assessment on paper has little bearing on how effective it is in practice.

鈥淚f it鈥檚 a poorly administered assessment, then the data coming back won鈥檛 be good,鈥� he said. 鈥淭he practice of evaluation is as critical as the design.鈥�