澳门跑狗论坛

Special Report
Classroom Technology

Testing Digital Tools to Improve Formative Assessments

By Benjamin Herold 鈥 March 10, 2014 10 min read
Patrick Kilty, a Summit High history teacher, is integrating new digital tools into lessons to develop better ways to generate ongoing feedback about individual student performance.
  • Save to favorites
  • Print
Email Copy URL

The digital learning tools flooding schools come with a tantalizing promise: real-time feedback on what children know, combined with fingertip access to a dizzying array of tailored instructional materials, resulting in more customized instruction from teachers and a more personalized learning experience for each student.

It鈥檚 a technology-enhanced version of the feedback loop that educators call formative assessment. But even in the most tech-savvy public schools, the digital overhaul of this vital classroom practice is just beginning, and skeptics worry that many of the new products being touted by ed-tech companies will serve primarily to enable more efficient use of poor formative-assessment techniques.

鈥淚 think the potential of technology to improve formative assessment is significant, but I can鈥檛 say I鈥檝e really seen it in action yet,鈥 said Margaret Heritage, the assistant director for professional development at the National Center for Research on Evaluation, Standards & Student Testing, or CRESST, at the University of California, Los Angeles. 鈥淚t鈥檚 not about giving teachers digital tools. It鈥檚 about helping them embrace a different way of teaching.鈥

Since well before the ed-tech revolution began, experts like Ms. Heritage have contended that effective classroom formative assessment is patchy at best. They鈥檝e pointed to a lack of time, training, and resources for busy classroom teachers and an overemphasis on high-stakes standardized testing as barriers to improvement.

Sensing a need, vendors large and small have pounced. Publishers and giant education service companies are rolling out comprehensive digital platforms and curricula in the hopes that districts will embrace all-in-one solutions. Startups and app makers, meanwhile, are offering a growing menu of smaller-scale tools aimed at improving specific components of the classroom-feedback loop.

鈥楬ybrid鈥 Teaching

Both approaches are on display here at Summit High School, located in the foothills of the Cascade mountains in an upscale part of this ski town in central Oregon. Some teachers are using a new digital platform known as PEAK12 (short for Personalize, Engage, and Achieve with K12), the latest product from the Herndon, Va.-based K12 Inc., the country鈥檚 largest private provider of online educational services to precollegiate schools. Others have embraced an 脿 la carte approach, mixing and matching classroom tools such as Socrative, a free app for quickly scanning dozens of student responses with the swipe of a finger.

The early returns are uneven, but encouraging.

Almost overnight, Summit teachers have begun using the new technologies to track the time students spend on reading assignments, take quick snapshots of how well whole classrooms understand new mathematics concepts, and examine the complexities of teenagers鈥 relationship to writing.

Summit Principal Alice DeWittie has encouraged the experimentation.

鈥淭he core principle is looking at student work, and based on that, changing what comes next in your instruction,鈥 Ms. DeWittie said. 鈥淭echnology just enhances it and makes it easier.鈥

Even in a tech-savvy environment such as Summit High School in Bend, Ore., the transition to tech-enabled formative assessment has been challenging.

Summit, a high-performing school with a student body that is 89 percent white, is one of five high schools in Oregon鈥檚 16,000-student Bend-La Pine district.

On a recent frigid morning, juniors carrying iPads and wearing sweatshirts emblazoned with snowboard-company logos filed into Patrick Kilty鈥檚 third-period U.S. history class, now being taught in a 鈥渉ybrid鈥 manner that involves both face-to-face and online learning.

So far, the 43-year-old Mr. Kilty has been the Summit teacher to make the heaviest use of the new ed-tech tools from K12 Inc., which recently rebranded the division of the company providing services to schools and districts under the moniker Fuel Education LLC. PEAK12 is intended as a one-stop shop that integrates digital content, assessments, and data dashboards from the company, third-party vendors, and teachers themselves.

The digital curriculum used by Mr. Kilty, which includes readings and regular quizzes, is hosted on PEAK12. He manages the class through Blackboard, a third-party learning-management system that can sit on the PEAK12 platform. And through PEAK12, Mr. Kilty accesses regular reports on students鈥 quiz performance and time spent online reviewing class materials.

K12, much like other large education services companies, is betting that districts will turn to such comprehensive systems as a means of bringing online offerings that previously stood alone into brick-and-mortar schools鈥攁 push being driven in part by the desire to improve classroom-feedback loops.

On this day, Mr. Kilty鈥檚 class is beginning a unit on the reconstruction of the American South following the Civil War. The digital curriculum from K12, which students are expected to read on their own time, consists of a cursory written overview of the era鈥檚 major events and ideas, interspersed with maps and graphs. Embedded within the curriculum is a formative assessment in the form of a quiz, which students are expected to take online at their own discretion, that includes 10 multiple-choice items covering basic facts and vocabulary.

Eventually, Mr. Kilty will use the resulting digital data to make a basic instructional adjustment: sorting his students into groups. As part of the new hybrid model, most students are required to attend the face-to-face portion of his class just three days a week. But those who are 鈥渞ed-flagged鈥 in the PEAK12 reports for not spending enough time reading online or for poor quiz performance are required to attend every day.

Ms. Heritage of CRESST questioned the educational value of that approach as it was described to her. Too often, she and other experts maintain, formative assessment is seen as little more than pop quizzes and 鈥渕ini-summative assessments,鈥 neither of which provide high-quality data on what students are thinking, learning, and doing. The quiz items from the Reconstruction unit of the K12 curriculum, Ms. Heritage said, 鈥渄on鈥檛 tap into deeper learning and don鈥檛 tell what a child has or hasn鈥檛 learned or is on the cusp of achieving.鈥

Summit High Principal Alice DeWittie and science teacher Jason Colquhoun conduct walk-throughs of classrooms to evaluate how teachers and students are using technology, and then they discuss their observations outside the classrooms.

鈥淭his seems to be an example of using digital technology for its own sake and actually taking away from the richness of the classroom,鈥 she concluded.

Depth vs. Breadth

Mr. Kilty doesn鈥檛 entirely disagree, saying the digital curricula from K12 is only 鈥渁n inch deep鈥 and acknowledging that the formative-assessment data he receives in the form of usage statistics and quiz grades provide only broad strokes of information about his students.

But for real teachers faced with real classroom constraints, Mr. Kilty said, that information is quite useful, especially because of the fast and user-friendly way in which the PEAK12 system makes it available. Now, he said, he can determine before class even starts if struggling students have fallen behind because of a lack of effort or a lack of comprehension. That allows him to tailor his interventions for those students without losing precious face-to-face time with the rest of the class.

As a result, Mr. Kilty said, he can focus those sessions on what he believes really matters: the skills required of historians, such as analyzing primary-source documents, and the skills embodied in the new Common Core State Standards, such as constructing and writing persuasive arguments.

During the recent third-period lesson, Mr. Kilty quickly reminded students about the online readings and quizzes that were due later that week, offering encouragement to individual teenagers based on what the PEAK12 system has told him of their progress.

Students in Mr. Kilty鈥檚 U.S. History class, which combines online and face-to-face learning, use tablets to do work.

Then he quickly thrust the class into their task for the day.

鈥淵ou鈥檙e going to play the role of a lawyer,鈥 Mr. Kilty told his students. 鈥淔irst, you need to find constitutional evidence for why the legislative branch should be the one to control Reconstruction.鈥

As the students dove into the text of the document on their iPads, Mr. Kilty circulated around the room, engaging in animated conversations with students about their research鈥攁n old-school form of formative assessment.

The use of digital tools to gauge student understanding is a novel concept for a veteran teacher, said Mr. Kilty, and the K12 platform has allowed him to begin cautiously. Now that he has the basics under his belt, he said, the next challenge is to use the new tools to revamp how he assesses students鈥 critical-thinking skills.

Mixing and Matching Apps

Other Summit High teachers have taken a more modular approach, using a variety of new ed-tech tools to elicit evidence of student learning as their lessons take place, diagnose students鈥 misconceptions, and make informed decisions about where in the classroom to focus their attention鈥攁ll skills that experts describe as central to effective formative assessment.

During a recent lesson in Brandon Thompson鈥檚 geometry class, for example, students used four separate classroom apps to learn about finding the area of triangles that contain no 90-degree angles. Despite the variety of tools being used in the classroom, the lesson went off without a hitch, with both teacher and students switching seamlessly among tools even though they had only been introduced a few months earlier.

First, Mr. Thompson had the class download problems from iTunesU, a course-management tool from Apple Inc., and begin solving them in Notability, a digital note-taking app.

Shortly after the students began, Mr. Thompson asked them to use the Socrative app to submit their solutions directly from their iPads to his. As he walked around the room, Mr. Thompson scrolled through a single screen that contained each student鈥檚 name and response. One student appeared way off base; the teacher stopped by to work with him directly. Overall, the snapshot revealed that most students got the overall gist, although many made rounding mistakes and failed to properly notate the unit of analysis.

Based on the information from Socrative and conversations with students as he circulated the room, Mr. Thompson then identified two鈥攐ne of whose work illustrated the common misunderstandings and another whose work demonstrated a creative problem-solving approach鈥攁nd asked them to 鈥渂eam in.鈥 Using an app called Airplay, the students projected the screens of their iPads onto a wall at the front of the room.

鈥淐amille, would you talk us through what鈥檚 going on here?鈥 Mr. Thompson asked. A quick classwide discussion served to both illuminate the process by which the student solved the problem and highlight the procedural error made by much of the class. Murmurs of understanding rippled through the room. Mr. Thompson concluded that the class was ready to move on, so he repeated the process, but with a more difficult challenge: This time, students were asked to develop an original formula that would allow them to solve for the area of any non-right triangle.

鈥淭hat鈥檚 a good use of technology for formative assessment,鈥 Ms. Heritage of CRESST said when the lesson was described to her.

Finding the Right Fit

Ultimately, Ms. Heritage and other experts believe, the real potential of technology is less about making formative assessment easier and more about making it better. That could mean better ways of curating multiple sources of evidence about a child鈥檚 learning, improved use of multimedia tools to capture student work and thinking, and new tools that encourage and help students measure their own learning鈥攁 critical component of formative assessment that experts say is frequently overlooked.

See Also

Chat March 18, at 2 p.m. ET: Digital Advances Reshaping Formative Assessment

Assessment expert Margaret Heritage and high school principal Alice DeWittie discuss the promises and realities of technology-enabled formative assessment.
Sign up now for an e-mail reminder.

Officials from K12 Inc. believe that PEAK12 can be the foundation upon which such solutions are brought into classrooms; the key, they say, is a smart digital platform that is comprehensive enough to be the single point of entry to digital learning for an entire school or district, but flexible enough to allow teachers to bring in both third-party tools and their own content.

The market for educational apps and software, meanwhile, continues to grow and diversify.

Principal DeWittie said that context matters when deciding which approach to embrace. Her previous school, she said, was characterized by a high level of instability and tremendous variation in students鈥 academic abilities and teachers鈥 readiness to embrace new technology. There, a 鈥渨hole school鈥 approach might be the best fit, she maintained.

But at Summit鈥攈igh-performing, stable, and relatively homogenous, with a cadre of talented and ambitious teachers鈥攊t鈥檚 been about investing in people first, and tools second.

The result is a rapidly evolving鈥攁nd somewhat messy鈥攕chool culture when it comes to technology and formative assessment.

Mr. Thompson and another math teacher are already busy training other Summit staff members how to combine the apps that have been so effective in their classrooms.

And next school year, a total of five Summit courses will be taught in a hybrid manner with K12 tools, 脿 la Mr. Kilty鈥檚 class.

But the history teacher has already begun experimenting with other tools, such as Google Forms, a cloud-based tool through which he created his own assessments of students鈥 ability to identify point of view and bias in primary-source documents.

鈥淚t鈥檚 a new frontier for me,鈥 Mr. Kilty said. 鈥淚鈥檓 still learning.鈥

Events

Artificial Intelligence K-12 Essentials Forum Big AI Questions for Schools. How They Should Respond鈥
Join this free virtual event to unpack some of the big questions around the use of AI in K-12 education.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of 澳门跑狗论坛's editorial staff.
Sponsor
School & District Management Webinar
Harnessing AI to Address Chronic Absenteeism in Schools
Learn how AI can help your district improve student attendance and boost academic outcomes.
Content provided by 
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of 澳门跑狗论坛's editorial staff.
Sponsor
Science Webinar
Spark Minds, Reignite Students & Teachers: STEM鈥檚 Role in Supporting Presence and Engagement
Is your district struggling with chronic absenteeism? Discover how STEM can reignite students' and teachers' passion for learning.
Content provided by 

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide 鈥 elementary, middle, high school and more.
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.

Read Next

Classroom Technology How AI Is Changing Education: The Year's Top 5 Stories
Schools are tackling big questions about AI.
1 min read
Illustration with tech education background and the words AI Top Five.
澳门跑狗论坛 + Getty
Classroom Technology Spotlight Spotlight on EdTech
This Spotlight will help you learn how to teach digital literacy skills, evaluate edtech tools effectively, and more.
Classroom Technology Cellphones in the Classroom: The Year鈥檚 Top 5 Stories
The devices distract students from learning, disrupt sleep, and can harm mental health.
1 min read
A duotone photograph of a group of elementary students sitting together and looking at their cellphones
Canva
Classroom Technology What Does Watching All Those Videos Do to Kids鈥 Brains?
Video content is ubiquitous inside and outside classrooms. Educators should know how it affects students.
5 min read
Boy Watching Video On Tablet With Headphones.
Liz Yap/澳门跑狗论坛 and iStock/Getty