鈥淲e鈥檝e got to stop using assessments as a hammer and begin to use them appropriately, as a diagnostic and learning tool,鈥� Kurt Landgraf, the president of the Educational Testing Service, said at the organization鈥檚 2005 Invitational Conference here last week.
The two-day event, Oct. 10-11, focused on ways to embed assessments directly into teaching and learning to help teachers adjust instruction as it鈥檚 occurring. In the United States, participants argued, far more attention has been paid to using tests as an accountability tool, and to sort and classify students, than to shape what actually happens in the classroom.
While teachers give tests or quizzes and assign papers all the time, they said, the quality of those tools is often lacking. What鈥檚 more, the purpose typically is to grade students rather than to modify instruction or provide students with detailed feedback.
Approaches suggested here for improving classroom assessments ranged from sharpening teachers鈥� questioning techniques to computer-based systems that allow continual tailoring of instruction to students鈥� responses.
鈥淚f assessment is going to be particularly powerful in achieving enhanced learning outcomes, then it鈥檚 at the classroom level that we need to focus our attention,鈥� said James W. Pellegrino, a professor of cognitive psychology and education at the University of Illinois at Chicago. 鈥淎s instruction is occurring, teachers need information to evaluate whether their teaching strategies are working.鈥�
Curriculum Tests
In particular, he pointed to a need for better 鈥渇ormative assessments鈥� that are given regularly in the classroom and provide quick information that lets teachers and students adjust what鈥檚 happening to promote learning. 鈥淭he catch here is that it isn鈥檛 easy to do this well,鈥� Mr. Pellegrino said. 鈥淚t doesn鈥檛 happen anywhere near the level we would like.鈥�
Mr. Pellegrino said little is known about the quality of assessments now included with commercial curriculum products. Working with the 427,000-student Chicago school system, he is examining the tests included in four popular math programs:Everyday Mathematics, Math Trailblazers, the Connected Mathematics Project, and Math Thematics.
The good news, he said, is that the curriculum assessments reflect both state and district-level academic-content standards and those from the National Council of Teachers of Mathematics.
They also include assessment resources that go well beyond testing students鈥� factual knowledge, he added. Examples include journal prompts, open- response problems, laboratory investigations, and long-term projects that require students to reason mathematically, apply their knowledge, use multiple solution approaches, and communicate about math either orally or in writing.
But it鈥檚 typically not made clear to teachers which standards are being assessed, the level of cognitive knowledge that鈥檚 being tapped, the range of expected student performance, or how to adjust instruction based on students鈥� responses, Mr. Pellegrino said.
Interviews with teachers, he said, suggest they don鈥檛 fully grasp the assessment components built into the curricula or how to use them during instruction.
M. Susanna Navarro, the director of the El Paso Collaborative for Academic Excellence, in El Paso, Texas, said that teachers often have trouble figuring out how to assess students at the highest levels of cognitive demand, and that most teacher education programs provide too little preparation in how to integrate high-quality testing with instruction.
鈥淔ormative assessment is still not seen as integral to lesson planning,鈥� she said.
Term Being Hijacked?
A focus on 鈥渁ssessment for learning鈥� can yield 鈥渞adical effects,鈥� said Dylan Wiliam, the senior research director of the Learning and Teaching Research Center at the Princeton, N.J.-based ETS. 鈥淚 think we鈥檝e got a quite clear view of what it is we want teachers to be doing,鈥� he said. 鈥淭he challenge is to get teachers doing this at scale.鈥�
Charlotte Danielson, an independent consultant based in Princeton, said engaging teachers in the design and use of assessments, particularly through the close examination of student work, gives teachers strong feedback about their own instructional practices and about common student misconceptions.
鈥淲hen this is done by teachers working together,鈥� she said, 鈥渢he entire intellectual capital of the school is enhanced.鈥�
Lorrie A. Shepard, the dean of the school of education at the University of Colorado at Boulder, said she worries that the term 鈥渇ormative assessment鈥� is being hijacked by commercial test publishers, which are marketing exams that could take time and resources away from instruction.
鈥淚f you thought the high-stakes test given once per year was distorting the curriculum,鈥� she said, 鈥渨ait till you give lots of examples all year long.鈥�
Ms. Shepard urged commercial publishers and states to focus on devising rich curriculum units with accompanying assessments that could provide models of good instructional and assessment practices for teachers.
Other participants at the New York City conference focused on computerized 鈥渋ntelligent tutoring systems,鈥� which can adjust computer-led instruction as it鈥檚 occurring, based on students鈥� responses to complex, multiple-step problems.
Edmund W. Gordon, a professor emeritus of psychology at Yale University, indicated that he foresaw a move away from using assessments chiefly as a tool for sorting, classifying, and rating schools and students. 鈥淚 predict that educational assessments in the future will be more and more concerned with the improvement of teaching and learning as its principal purpose,鈥� he said.
