Corrected: The legend in the map below has been corrected online.
Grace, a tiny 3rd grader with long black hair and wide-set eyes, peers over her teacher鈥檚 shoulder at the results of the oral-fluency test she鈥檚 just finished, which appear on the screen of a hand-held computer as a tiny green triangle up in the right-hand corner.
鈥淪o, you read 147 words,鈥� says teacher Laura Wallin of Mountainview Elementary School. She taps the screen and another graph pops up that plots Grace鈥檚 reading fluency over time. 鈥淎t the beginning of the year, you started out at 92 words per minute, then 105. What do you think is helping you the most?鈥�
- 鈥� Palm Readers:
Teachers in a rural New Mexico district use hand-held computers to assess students鈥� reading progress and target instruction accordingly. - 鈥� Critical Thinking:
Schools in Boston are gaining insight into their students鈥� thought processes through a locally developed reading-assessment system.
MAY 2
- 鈥� New Math:
Teachers in a Texas school have shelved some of their math textbooks and turned to an online curriculum and formative-assessment resource instead.
MAY 9
- 鈥� Teacher Training:
A California center is using formative assessment to help beginning teachers reflect on and improve their own work and that of their students.
MAY 16
鈥淲hen we practice reading to our partners, it helps me,鈥� Grace says, citing times when her partner told her not to skip words as she read out loud. 鈥淎nd it helps me when we have this time to go over it; it helps me know what to work on.鈥�
Similar encounters between teachers and students occur on a regular basis in the five elementary schools in this far-flung rural school system, which is about the size of Rhode Island and enrolls some 4,000 students in kindergarten through 12th grade. But that wasn鈥檛 always the case.
Before the school system began using the Dynamic Indicators of Basic Early Literacy Skills, or DIBELS, assessments, the district had no common reading program in the early grades and no way of regularly checking students鈥� progress, district officials say.
鈥淭here were as many different programs going on as there were teachers,鈥� recalled Joshua S. McCleave, the principal of the 330-student South Mountain Elementary School, another school in the Moriarty school district.
Three years ago, with the help of a federal Reading First grant, the district began using the DIBELS assessments across its elementary schools along with the mCLASS: DIBELS assessment and reporting system. The district鈥檚 experience helps illustrate the ways educators can use one popular assessment tool to better inform and shape classroom teaching and learning鈥攁 concept often labeled 鈥渇ormative assessment.鈥�
The assessments, developed by researchers at the University of Oregon, include thrice-yearly benchmark tests to help screen and group students, as well as more-frequent, one-minute 鈥減rogress monitoring鈥� measures. Those measures track youngsters鈥� responses to instruction on a particular literacy skill, such as initial sound fluency, phoneme segmentation, reading of nonsense words, or oral-reading fluency. As early as kindergarten, the probes identify children considered at risk for not learning to read.
Using the mCLASS: DIBELS assessment system, developed by Wireless Generation, a for-profit company based in New York City, teachers are able to give and record DIBELS results on hand-held computers and get instant feedback. Teachers can then upload the results to the Wireless Generation Web site to track class, school, and district performance over time using online reports.
Naomi Hupert, a senior research associate with the Boston-based Education Development Center, which is evaluating New Mexico鈥檚 Reading First program, said the approach lets teachers collect and instantly access their own data without feeling they are just 鈥渁dministering something that was supposed to be sent off to the state or the district.鈥�
鈥淭he greatest advantage we see,鈥� Ms. Hupert said, 鈥渋s that teachers, for the first time, felt like the data was for their own purpose.鈥�
Flexible Reading Groups
Nationally, about 100,000 teachers in 49 states now use Wireless Generation鈥檚 software to conduct and analyze DIBELS assessments with some 2.3 million students.
Before adopting the program, every K-3 teacher in the participating Moriarty schools agreed to a list of 鈥渘on-negotiables.鈥�
The list includes an uninterrupted 90-minute reading block for students using the Harcourt Trophies reading program. During that time, students are flexibly grouped based on their needs, with the groups shifting regularly, depending on test results.
Schools also carve out additional intervention time outside the reading block: 30 minutes for all students and 60 minutes for those who need the most intensive help. In the three elementary schools receiving Reading First grants, the latter may include individual or small-group instruction from a reading coach or specialist.
When the Moriarty district first introduced computer-based reading tests, 29 percent of kindergartners scored at the lowest, or 鈥渋ntensive鈥� level. That figure fell to 2 percent this year, while students testing at the top level, 鈥渂enchmark,鈥� rose from 28 percent to 93 percent.
鈥淲e were truly asking teachers to make paradigm shifts, and in asking them to do that, we were asking some of them to change the way they had been teaching for 20 years,鈥� said Laura E. Moffitt, the coordinator of federal programs for the school district and the driving force behind its reading efforts.
Teachers at every school meet at least once a month, by grade level, to analyze DIBELS and other data, adjust instructional groupings, and decide what to do next to support individual children. Teachers monitor children鈥檚 progress using DIBELS subtests as often as once a week, or at least once every six weeks, depending on whether youngsters perform at the 鈥渋ntensive鈥� (high risk), 鈥渟trategic鈥� (some risk), or 鈥渂enchmark鈥� (low risk) level on the assessments.
鈥淚f we notice a child has fallen below their target score, we talk about it then,鈥� explained Tonya S. Newton, the reading coach at Mountainview Elementary School. 鈥淲hat I鈥檓 trying to do is get the teachers to come up with the interventions during the meeting, because if you wait three weeks for a child, that鈥檚 a lot of time lost.鈥�
Moriarty schools also share the information generated by the assessments with parents during back-to-school nights and parent-teacher conferences. And they provide homework packets and suggestions for parents to work with their youngsters on specific skills.
鈥楽o Much More Information鈥�
A recent analysis by Wireless Generation, based on results from roughly 200,000 students in nearly 1,300 schools in 31 states, found that frequent progress monitoring鈥攁bout once a week鈥攜ielded the greatest reading gains for students at all reading levels, as measured by changes on the benchmark exams.
The mCLASS: DIBELS system in use in Moriarty provides Web-based reports on individual students, such as the one below, and reports for whole schools and districts.
The chart below uses colored bars to show changes in students鈥� reading 鈥渞isk鈥� status over the course of a school year.
Ms. Newton, who鈥檚 been teaching for 17 years, is a passionate defender of the approach, based on her own experiences. 鈥淲hen I taught 6th grade, I always had that lower reading group, and it just tore me up,鈥� she said, 鈥渂ecause they couldn鈥檛 read the textbooks, and I didn鈥檛 know how to fix it.鈥�
鈥淚 think this,鈥� she added, pointing to the data-covered walls of her office, 鈥渨ill catch some of those kids.鈥�
At Moriarty Elementary School, for example, 2nd grade teachers began a grade-level meeting by looking at the performance of pupils who had recently moved from one reading group to another because of their DIBELS scores, to see if they were continuing to make progress. They also reviewed the work of two children who had temporarily been moved from the 鈥渟trategic鈥� to the 鈥渋ntensive鈥� group so they could get more help.
Each school decides how to organize the instructional groups during the morning reading block. But generally, the schools use a 鈥渨alk to read鈥� model, in which students leave their homeroom teachers to go to another classroom composed of students at a similar reading level. Because students change reading groups frequently, based on new data, all of the teachers get to know every child.
鈥楳akes You More Aware鈥�
During the meeting, teachers also pulled out detailed summaries for individual students to look at where they were struggling, and discussed what types of activities might address their needs.
鈥淚 think it makes you more aware of areas you need to delve into,鈥� said 2nd grade teacher Carlotta Ballard. 鈥淪ometimes, you鈥檙e so used to looking at the big picture.鈥�
鈥淧lus, we all have different expertise,鈥� added teacher Rebecca Cavasos, 鈥渁nd so we鈥檙e able to go to one another.鈥�
Typically, teachers will look for trends across at least three different progress-monitoring reports before deciding to move a child鈥檚 reading group. They鈥檒l also look at class work, homework, and results from other assessments, such as the Teacher Primary Reading Inventory and the tests that accompany the Harcourt Trophies series. Sometimes, teachers will call an emergency meeting if they feel they need to make a decision about a child right away.
Although teachers initially gave DIBELS as a paper-and-pencil assessment, many say it was too cumbersome to use regularly. Now, said 1st grade teacher Jaree Whitworth of the 410-student Edgewood Elementary School, 鈥淚 just feel like I get so much more information.鈥�
The Web-based graphics help. Colors鈥攔ed, yellow, and green鈥攈ighlight whether students鈥� performance on any particular subtest is at the 鈥渋ntensive,鈥� 鈥渟trategic,鈥� or 鈥渂enchmark鈥� level. A little running man across the bottom of some screens shows students where they are in relation to end-of-year goals. And scatter plots highlight whether each progress-monitoring result puts a youngster at, above, or below his or her target performance.
Larry Berger, the founder and chief executive officer of Wireless Generation, said use of the hand-held devices saves teachers the equivalent of four or five instructional days per year. 鈥淚t鈥檚 pretty rare in education that anybody automates something that teachers actually do all day and thereby saves them some time,鈥� he said.
Sustainability an Issue
In Tammy Satterfield鈥檚 鈥渟trategic鈥� reading group at Mountainview Elementary, about a dozen 1st graders do jumping jacks as they recite the vowel sounds that they鈥檝e been working on from the day鈥檚 word chart. Once they鈥檙e seated, Ms. Satterfield points to the word wall and says: 鈥淲e have some new words. Raise your hand if you can tell me some of our new words.鈥�
Soon, the class moves on to breaking up words into their sounds and then sliding them back together to form whole words. 鈥淲hy do I do this every day?鈥� asks Ms. Satterfield. 鈥淏ecause it helps you read your words,鈥� the pupils chant back. 鈥淚s it our only strategy?鈥� the teacher asks. 鈥淣o,鈥� they chorus.
Later, the teacher acknowledged that she鈥檚 putting in more hours planning instruction, but says it鈥檚 worth it. 鈥淏efore, you just hoped you were getting to everyone,鈥� she said, 鈥渂ut with the progress monitoring and DIBELS, it鈥檚 less likely that children will fall behind because you鈥檙e in contact with them all the time. It鈥檚 such an interactive program.鈥�
When 1st grade teachers discovered, for example, that most children were having trouble with oral fluency on the midyear assessments, they added a program during the afternoon intervention time called 鈥淩eading Naturally鈥� that focuses on fluency. They also began frequent monitoring of 1st graders鈥� oral fluency earlier in the year.
In the fall of 2004, when the program began, 29 percent of kindergartners in the district were reading at the intensive level and 28 percent at the benchmark level on the DIBELS benchmark assessments. By this winter, only 2 percent of kindergartners performed at the intensive level, while 93 percent read at the benchmark level.
About 70 percent of 1st and 2nd graders now read at the benchmark level on the assessments. And special education referrals in the Moriarty district have dropped as regular education teachers have felt more comfortable addressing individual youngsters鈥� needs. Both the special and bilingual education teachers take part in grade-level meetings at each school.
But the biggest change, according to teachers and principals, may be the responsibility that educators now feel for students other than their own. 鈥淚t becomes a way of creating a community,鈥� observed Ms. Hupert of the Education Development Center, 鈥渨here there鈥檚 a sense that every student鈥檚 reading development is the responsibility of every teacher.鈥�
Yet Moriarty educators admit that challenges remain, particularly in figuring out specific strategies or activities based on the data.
鈥淒IBELS is a screen,鈥� Ms. Moffitt noted. 鈥淚t doesn鈥檛 tell you how to change your instructional strategies. Pushing that is where we are now.鈥�
District officials also worry about how to sustain the program once federal Reading First money goes away. The district has put together a working group to look at the issue of sustainability and make recommendations.
For many educators here, though, there鈥檚 no going back.
鈥淲e used to say, 鈥極h, that child is a late bloomer or developmentally not ready,鈥� 鈥� said Principal Julie C. Roark of Edgewood Elementary School. 鈥淣ow, it鈥檚 more about what else can we do, what else can we try? You don鈥檛 accept that children are just not going to get it.鈥�
