Pennsylvania officials were expected this week to unveil the designs for new reports on student and school test performance that are customized to meet the needs of parents, teachers, and school leaders, as well as provide a direct link to instruction.
The reports, produced under a four-year, $9.98 million contract with the Grow Network, a New York City-based company, reflect a growing recognition that how school data are reported shouldn鈥檛 be an afterthought. Rather, test results provide a crucial opportunity to communicate with parents, teachers, and others about student achievement and how it can be improved.
Pennsylvania has taken that message to heart by separating the contract for test-score reporting from the contract for test development and administration.
鈥淲e鈥檝e been working to improve our assessment system, and we wanted to link that improved system more directly to curriculum and instruction,鈥� said state Secretary of Education Vicki L. Phillips.
鈥淲e actually wanted [the reports] to be a useful tool,鈥� she continued, 鈥渁nd felt that breaking it out and contracting with a group who sees that as their core mission would be one way to accomplish that.鈥�
In addition to the print component of the Grow reports, an interactive Web site enables teachers to group students by sets of skills and to access instructional materials linked to state standards. Principals can use the Web site to monitor school and classroom performance. Parents can find suggested reading lists and other tools for helping their children.
The company鈥檚 first contract, in 2001, was to produce reports for grades 3- 8 for teachers, parents, and administrators in the New York City public schools. It also generates such reports for the Chicago schools and, starting this school year, for parents and teachers in California. And it has won contracts with Nevada, New Mexico, and New Jersey.
Addressing a Need
David Coleman, the company鈥檚 34-year-old chief executive officer, conceived the idea for the Grow Network while a senior project manager at the New York City McKinsey consulting firm. During his five years there, he did pro bono work for school districts.
鈥淚 found, despite widespread discussion of using data to guide instruction, it was very hard to do so with the tools that principals, teachers, and parents had available,鈥� Mr. Coleman said.
So he gathered an eclectic team of educators, business people, and technology specialists to build software that turns the results of standardized tests into a user-friendly, simple-to-read format.
The company, which was founded in 2000, today employs about 70 people and expects to have revenues of $15 million to $20 million this year. Depending on the scope of the work, most of its contracts run between $1 million and $3 million annually.
鈥淭he thing I say all the time about Grow is that it鈥檚 the first thing that teachers cheered,鈥� said David B. Sherman, a vice president for the United Federation of Teachers in New York City.
鈥淲hat the Grow Network did was they translated the data into instructional terms and into practical terms in a very smart way, so it is as teacher-friendly and as student-friendly as anything of this type can be,鈥� he said.
鈥淭he materials from the Grow Network are the first ones鈥攁nd, frankly, the only ones to date鈥攖hat teachers have not only received warmly, but have found to be very, very valuable,鈥� said Mr. Sherman, whose organization is an American Federation of Teachers affiliate.
| As seen in this sample, the Grow Network report uses traffic-light colors to show a student鈥檚 achievement level. The student, school, and data in this model are solely for illustration purposes. |
In Pennsylvania, for example, the parent reports include suggestions for reading and mathematics activities that parents can do at home with their child, based on his or her test results. They also include useful suggestions for talking with the child鈥檚 teacher and information about Pennsylvania鈥檚 public libraries and other resources.
The reports, for grades 3, 5, 8, and 11, use a traffic- light device to signal quickly to parents how their children are doing academically. 鈥淏elow basic鈥� is colored red, 鈥渂asic鈥� is yellow, and 鈥渁dvanced鈥� and 鈥減roficient鈥� are green. An arrow points to where the child鈥檚 score falls, with the specific score listed below the graphic.
Inside the reports, each child鈥檚 reading and math scores are broken out by topic, pegged to Pennsylvania鈥檚 academic standards鈥攕uch as learning to read independently or being able to do computations without a calculator.
Teachers will receive test results for their incoming classes of students in the summer, based on tests given the previous spring. Those reports highlight where a class is likely to need help with fundamentals, extra instruction and practice, or advanced work.
Each teacher also has an account on Grow Network鈥檚 interactive Web site. With a click, teachers can group pupils based on their performance on specific topics or other criteria. Another click permits them to link a student鈥檚 needs with a set of instructional materials and strategies that are themselves linked to state or district standards. In addition, teachers can pull up a detailed academic profile for each student.
Pennsylvania also will produce school assessment reports and reports that help educators and the public understand whether schools have made 鈥渁dequate yearly progress鈥� under the federal No Child Left Behind Act.
鈥淭esting companies don鈥檛 focus on the instructional side,鈥� said Carina Wong, the director of assessment and accountability for the Pennsylvania education department. 鈥淲e saw this as an opportunity to use the reporting to support instruction.鈥�
鈥業ncredibly Useful鈥�
The idea, according to Mr. Coleman, is to make the print materials and the Web site as easy to use as an automatic teller machine.
鈥淢any states and districts ask us, 鈥榃ill you provide training on how to read the reports?鈥� 鈥� he said. 鈥淥ur reply is, 鈥業f the reports require training to read, they should be redesigned.鈥� 鈥�
A two- year, $400,000 study, financed by the Carnegie Corporation of New York and conducted by the Education Development Center, suggests teachers and principals in the Big Apple are using the reports. While the nonprofit research center has not finished analyzing all the data, said Margaret Honey, a vice president at the Newton, Mass.-based EDC who directed the study, 鈥渢here was just absolutely no doubt that the format of the Grow reports was incredibly useful to everyone.鈥�
Based on interviews with teachers and principals in 15 New York City elementary and middle schools and surveys sent to more than 700 educators, researchers found that teachers used the reports in three ways: to help with planning, including setting class priorities and doing weekly or monthly lesson planning; to differentiate instruction; and to converse with parents and others.
Some teachers, for example, printed out all the teaching materials on the Grow Network鈥檚 Web site and then set up a file folder for each child that contained the student鈥檚 Grow report and practice activities targeted for him or her.
Brian D. Schultz, a 5th grade teacher at the 400-student Richard E. Byrd Community Academy in Chicago, said he does not support standardized testing, but he鈥檚 found that 鈥淕row provides an avenue to really help students.鈥�
Mr. Schultz, who was previously a performance manager in the corporate world, uses the Grow information to make individual learning workbooks for his students. Although he doesn鈥檛 attribute the results to the Grow tools alone, he notes that at the beginning of the last school year, none of his students tested at or above the national norms on the Iowa Tests of Basic Skills, administered in the Chicago district. After using the customized learning books based on Grow鈥檚 information, 47 percent of his students tested at or above the national norm in mathematics.
Investment Questioned
A study conducted by the Consortium on Chicago School Research provides a more mixed review. 鈥淥verall, teachers felt moderately positive about their experiences with the Grow Network during its first year of implementation,鈥� says the report issued in January by John Q. Easton and Stuart Luppescu.
The study found that a majority of teachers in grades 4-8 used the Grow resources, and slightly more than half of respondents found the various components beneficial. Compared with teachers, elementary principals in Chicago were 鈥渙verwhelmingly positive about Grow,鈥� according to the report.
鈥淢ost teachers we talk to really like the way the data are presented,鈥� said Dan Bugler, who oversees accountability, research, and evaluation for the more than 435,000-student Chicago district. 鈥淚f there鈥檚 a criticism, it鈥檚 that they get the data at the beginning of the year, but we don鈥檛 really have a lot of benchmark assessments, so they don鈥檛 have any data at the midyear point. So that鈥檚 what we鈥檙e looking at.鈥�
But not everybody thinks the investment in Grow is worthwhile. State Rep. Christine R. Giunchigliani of Nevada, a Democrat, said she opposed the $2.8 million contract that her state has signed with the company.
鈥淚 don鈥檛 think we need to waste $2.8 million to develop a brochure to tell people what the test scores are,鈥� she argued, noting that most large school districts have their own internal media departments that could furnish such information.
