澳门跑狗论坛

Opinion
Standards & Accountability Opinion

The Fatal Flaw of Educational Assessment

By W. James Popham 鈥 March 22, 2016 3 min read
  • Save to favorites
  • Print
Email Copy URL

America鈥檚 students are not being educated as well these days as they should be. A key reason for this calamity is that we currently use the wrong tests to make our most important educational decisions. The effectiveness of both teachers and schools is now evaluated largely using students鈥 scores on annually administered standardized tests, but most of these tests are simply unsuitable for this intended purpose.

When we use the wrong tests to evaluate instructional quality, many strong teachers are regarded as ineffective and directed by administrators to abandon teaching procedures that actually work well. Conversely, the wrong test scores often fail to identify truly weak teachers鈥攖hose in serious need of instructional assistance who don鈥檛 receive help because they are thought to be teaching satisfactorily. In both these instances, it is the students who are shortchanged.

What鈥檚 most dismaying about this widespread misuse of educational tests is that many educators, most policymakers, and almost all parents of school-age children do not realize how these tests contribute to diminished educational quality.

BRIC ARCHIVE

Today鈥檚 educational tests are intended to satisfy three primary purposes, all of which can play a constructive role in students鈥 education: to compare, to instruct, and to evaluate.

Comparison-focused educational tests permit us to identify score-based differences among individual students or among groups of students. The resulting comparisons often lead to classifications of students鈥 scores on a student-by-student basis (such as by using percentiles) or on a group-by-group basis (such as by distinguishing between 鈥減roficient鈥 and 鈥渘onproficient鈥 students).

A second purpose of educational testing is instructional鈥攖hat is, to elicit ongoing evidence regarding students鈥 levels of achievement so that better decisions can be made about how to teach those students. Test-based evidence can also help students themselves decide whether to modify how they are trying to learn.

Tests built chiefly for comparisons are not suitable for purposes of instruction or evaluation of instructional quality.

A third purpose of educational testing is evaluation鈥攖hat is, determining the quality of a completed set of instructional activities provided by one or more teachers. These evaluations often focus on a lengthy segment of instruction, such as an entire school year.

All three of these purposes, if implemented by using appropriate tests, can benefit students. The trouble is that one of those purposes鈥攃omparison鈥攈as completely dominated America鈥檚 educational testing for almost a century.

Our preoccupation with comparative testing can be traced back to World War I when, in order to identify the best candidates for officer-training programs, a group-administered intelligence test called the Army Alpha was developed for more than . The test, whose comparative purpose was to spot the strongest officer candidates, worked well. As a consequence, for nearly 100 years, almost all our nation鈥檚 educational tests have been built and evaluated on the basis of a test鈥檚 comparative capabilities.

However, tests built chiefly for comparisons are not suitable for purposes of instruction or evaluation of instructional quality in education. These tests provide teachers with few instructional insights and typically lead to inaccurate evaluations of a teacher鈥檚 instructional quality.

In 2014, the three national associations most concerned with U.S. educational testing鈥攖he American Educational Research Association, the American Psychological Association, and the National Council on Measurement in Education鈥攑ublished a long-awaited for building and evaluating educational tests. The revised standards emphatically call for construction and evaluation of educational tests according to the specific purpose for which a test will be used. In a very direct manner, these revised standards advocate intentional educational testing, in which purpose-specific tactics dominate test development and purpose-specific evidence governs test evaluation.

The time has come for us to abandon the naive belief that an educational test created for Purpose X can be cavalierly used for Purpose Z. Too many children in our schools are harmed by these methods because educators are basing their decisions on inaccurate information supplied by the wrong tests. We must follow the up-to-date advice of the measurement community and demand the use of purposeful educational testing.

A version of this article appeared in the March 23, 2016 edition of 澳门跑狗论坛 as Purposeful Assessment Is an Antidote to Harmful School Testing

Events

Artificial Intelligence K-12 Essentials Forum Big AI Questions for Schools. How They Should Respond鈥
Join this free virtual event to unpack some of the big questions around the use of AI in K-12 education.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of 澳门跑狗论坛's editorial staff.
Sponsor
School & District Management Webinar
Harnessing AI to Address Chronic Absenteeism in Schools
Learn how AI can help your district improve student attendance and boost academic outcomes.
Content provided by 
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of 澳门跑狗论坛's editorial staff.
Sponsor
Science Webinar
Spark Minds, Reignite Students & Teachers: STEM鈥檚 Role in Supporting Presence and Engagement
Is your district struggling with chronic absenteeism? Discover how STEM can reignite students' and teachers' passion for learning.
Content provided by 

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide 鈥 elementary, middle, high school and more.
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.

Read Next

Standards & Accountability What the Research Says More than 1 in 4 Schools Targeted for Improvement, Survey Finds
The new federal findings show schools also continue to struggle with absenteeism.
2 min read
Vector illustration of diverse children, students climbing up on a top of a stack of staggered books.
iStock/Getty
Standards & Accountability Opinion What鈥檚 Wrong With Online Credit Recovery? This Teacher Will Tell You
The 鈥渨hatever it takes鈥 approach to increasing graduation rates ends up deflating the value of a diploma.
5 min read
Image shows a multi-tailed arrow hitting the bullseye of a target.
DigitalVision Vectors/Getty
Standards & Accountability Why a Judge Stopped Texas from Issuing A-F School Ratings
Districts argued the new metric would make it appear as if schools have worsened鈥攅ven though outcomes have actually improved in many cases.
2 min read
Laura Baker澳门跑狗论坛 via Canva  (1)
Canva
Standards & Accountability Why These Districts Are Suing to Stop Release of A-F School Ratings
A change in how schools will be graded has prompted legal action from about a dozen school districts in Texas.
4 min read
Handwritten red letter grades cover a blue illustration of a classic brick school building.
Laura Baker, Canva