Districts could boost their ability to hire teachers who help students learn more and who stay on the job longer by improving their screening techniques, a newly released working paper concludes.
Based on an analysis of teacher-hiring practices in the Spokane, Wash., school district, the research suggests that systematically culling candidates鈥� recommendations to get a better sense of their classroom-management techniques, ability to work with colleagues, and instructional skill can pay off in academic-achievement gains.
The 29,000-student district鈥檚 hiring process, developed in-house 10 years ago, is far from a silver bullet, but the results it鈥檚 been getting are significant. In math, the effect is potentially equivalent to selecting teachers whose performance mirrors that of a typical third-year teacher rather than a first-year teacher.
Only a few studies, including the recent paper out of the University of Washington, have sought to document the links between specific teacher-hiring practices and K-12 academic improvement.
鈥淭eacher Characteristics and Student Achievement: Evidence From Teach For America鈥�
Working paper (2009)
Will Dobbie, Harvard University
Findings: Teachers with high scores on some of Teach For America鈥檚 selection criteria, such as leadership ability, were linked with improved student achievement in mathematics and, less so, in English/language arts.
鈥淐an You Recognize an Effective Teacher When You Recruit One?鈥�
Published in Educational Finance and Policy (2011)
Jonah E. Rockoff, Columbia University; Brian A. Jacob, University of Michigan; Thomas J. Kane, Harvard University; Douglas O. Staiger, Dartmouth College
Findings: New York City teachers鈥� performance on a commercial screening instrument, and on a test of pedagogical-content knowledge in math, appeared to be modestly correlated with student outcomes. Teachers with a specific set of cognitive or noncognitive skills appeared to be somewhat more effective, on average, than their peers.
鈥淪creen Twice, Cut Once: Assessing the Predictive Validity of Teacher Selection Tools鈥�
Working paper (2014)
Dan Goldhaber, Cyrus Grout, Nick Huntington-Klein
Center for Education Data & Research, University of Washington Bothell
Findings: Teachers selected on the basis of a two-step process for screening r茅sum茅s and recommendations for such attributes as flexibility, experience, and instructional skills were associated with higher student test scores and better retention rates.
And given that attempts to dismiss teachers are time-intensive and costly, especially after they鈥檝e been given tenure, improvements in hiring show a lot of promise, said Dan Goldhaber, a research professor at the University of Washington Bothell and one of three scholars who conducted the study.
鈥淗iring by school systems in this country looks to be pretty ad hoc,鈥� Mr. Goldhaber said. 鈥淒espite a lot of rhetoric about the impending teacher shortage, districts have a lot of choice about who to hire, and it doesn鈥檛 look like there鈥檚 much evidence that they systematically make good choices.鈥�
Two-Tiered Screening
In the annals of education research, teacher-hiring systems remain relatively understudied, despite the huge attention paid to teacher quality in recent years. Only a few research studies have found links between teacher-hiring practices and student-achievement outcomes.
The Spokane district uses a two-tiered system for hiring candidates. First, its central human resources office scores applicants on a 21-point scale by examining their r茅sum茅s for experience and skills and reviewing recommendations from supervisors.
Next, principals request lists of candidates who have met a particular cutoff score, and then use a detailed, 60-point evaluation tool to look through those documents for evidence of such attributes as flexibility, experience, and instructional skills to select prospects to bring in for interviews.
For the study, the researchers looked at some 4,200 teacher applications in the district from 2009 to 2012. Where possible, the authors linked that information to teachers鈥� retention rates and their value-added results, which examine teachers鈥� impact on students鈥� test-score growth.
The researchers analyzed results for teachers who passed each step of the hiring process, and compared the results of teachers who were hired by Spokane with those of educators who were not but went on to teach in different Washington state districts.
Predictive Power
The researchers found that each of the two hiring stages had some predictive power in terms of student achievement.
Most of that effect seemed to have been driven by specific components. For the 21-point screening, the candidates鈥� recommendations showed a statistically significant correlation with teacher effectiveness in math. For the 60-point scale, points for classroom-management skills were correlated with effectiveness in both reading and math instruction; high rankings on flexibility and instructional skill were linked to increases in math.
Overall, an increase of one standard deviation on the 60-point screening was associated with 0.03 and 0.07 percent improvements in students鈥� test scores in reading and math, respectively. The figure for math is roughly equivalent to the difference in effectiveness between the average novice teacher and one with about three years鈥� experience, Mr. Goldhaber said.
In addition, the one-standard-deviation increase also predicted a decrease in teacher attrition of about 2.5 percentage points.
The screening results did not predict, though, whether the teachers hired were more likely or less likely to have absences from work.
Accelerating the Process
Tennille Jeffries-Simmons, the district鈥檚 chief human resources officer, said she鈥檚 pleased that the hiring system is helping identify effective teachers. Now she hopes to shorten the process from three to four weeks down to about a week.
鈥淥ur biggest interest is to speed up the time it takes to move through the process without losing any of the effectiveness that this study has shown that we have,鈥� Ms. Jeffries-Simmons said. 鈥淲e want to be as competitive as possible, and the speed with which we鈥檙e able to access talented candidates is a huge component of that.鈥�
Thomas J. Kane, a professor of education and economics at the Harvard Graduate School of Education, seconded the study鈥檚 overall conclusion that hiring processes deserve more attention. 鈥淎ny information that can help you identify effectiveness before a teacher is on the payroll is very valuable,鈥� he said.
Still, other innovations鈥�like asking prospective teachers to give demonstration lessons鈥攕hould also be considered and studied for their ties to achievement, he added.
The study cautions that districts that try to emulate Spokane鈥檚 system might not have the same results, because of variations in the highly localized teacher labor market. Districts with fewer applicants, or those that face more competition for teachers, might not have the ability to be as choosy as Spokane, it notes.
