澳门跑狗论坛

College & Workforce Readiness

Success of College-Readiness Intervention Hard to Gauge

By Catherine Gewertz 鈥 January 20, 2011 11 min read
  • Save to favorites
  • Print
Email Copy URL

Stubbornly high college remediation rates have revealed a painful equation: High school completion does not equal college readiness. That disconnection has prompted national leaders to focus like never before on figuring out how to ensure that high school graduates are truly ready to succeed in college. In that quest, a California program is often cited as a model.

The draws praise for doing something few thought possible: It brought together K-12 and higher education and got them to agree on the knowledge and skills that constitute college-level mastery. They created a test that sends rising high school seniors an early signal about their readiness in mathematics and literacy, and allows those who meet the mark to go right into credit-bearing coursework as college freshmen, skipping remedial classes. To complete the picture, they crafted a suite of courses to bring lagging 12th graders up to college-level snuff and added training for preservice and in-service teachers.

Fusing all those elements into one system was unheard of a decade ago, when the EAP took shape. The most striking element was that the test, coursework, and training were infused with college expectations, since they were written jointly by faculty members from K-12 schools and California State University, one of the state鈥檚 two public university systems.

Early Assessment Program Results

The number of students who take California鈥檚 voluntary test of college readiness has soared since 2004, when the test was first offered. The proportion of students who meet the 鈥渃ollege-ready鈥 cutoff score for mathematics or English is rising slowly, but the vast majority still fall short of the mark.

BRIC ARCHIVE

SOURCE: California State University

鈥淲e鈥檝e gone from a system [of state tests] that looks backward, asking how well we did, to one that looks ahead, asking if we have really gotten students ready for college,鈥 said Douglas McRae, who helped design the state鈥檚 tests in the 1990s. 鈥淭hat鈥檚 a big mindset shift.鈥

Even some of the program鈥檚 admirers, though, are frustrated by the lack of key data about its impact and worry that execution of the EAP might not fulfill its promise.

鈥淚t鈥檚 been ballyhooed for its design, which is deserved,鈥 said Michael W. Kirst, a professor emeritus of education at Stanford University who studies the system. 鈥淏ut there is scant information about its implementation on the ground.鈥

The accomplishments of California鈥檚 Early Assessment Program鈥攁s well as the unanswered questions about it鈥攁re particularly pertinent now, as educators and policymakers across the country try to define, build, and assess students鈥 readiness for college.

One part of that work is in carrying out new that were written to reflect college-level skills and have been adopted fully or provisionally by all but seven states. Another part lies with two big groups of states that are for those standards. Leaders of those efforts cite the EAP as a model as they endeavor to fold elements of it into work they hope will ultimately make college remediation unnecessary: aligning K-12 study and tests to college expectations, creating a feedback loop to inform learning, and providing supports to students and teachers.

鈥淲e look over at the EAP and ask, 鈥楬ow did they crack that nut?鈥 鈥 said Joe Willhoft, the executive director of the SMARTER Balanced consortium, one of the two assessment groups.

Measuring Impact

Few dispute the significance of the EAP鈥檚 pivotal victory: getting precollegiate and higher education to agree on what college-level mastery looks like. But gauging its impact has been trickier. Since the test was first given in 2004, the program has generated a confounding mix of results.

There are early signs that it reduces the need for college remediation: by Michal Kurlaender, a researcher at the University of California, Davis, found that students at one California State University campus who had taken the EAP鈥攔egardless of their scores鈥攚ere 4 percentage points to 6 percentage points less likely to require remediation than those who hadn鈥檛. The test likely prompts students to 鈥渂uckle down鈥 harder in 12th grade, Ms. Kurlaender said in an interview.

Early Assessment Program at a Glance

The Early Assessment Program consists of several parts designed to work together to measure and enhance California students鈥 college readiness. Students who score high enough are considered 鈥渃ollege ready鈥 at the state鈥檚 23 California State University campuses and 48 of the state鈥檚 community colleges. They can skip remedial classes and enroll in credit-bearing coursework.

The Test:

鈥 15 questions each in mathematics and English, and a 45-minute English essay, devised jointly by California State University and K-12 faculty members, are added to the 11th grade California Standards Test, or CST. The college-ready determination is based on a combination of those and 45 questions from the CST.

鈥 The augmented version of the test is optional; students may choose to take only the CST.

鈥 There are two math EAPs: one for students who have completed Algebra 2, and another for those who have completed more advanced math courses.

鈥 In English, there are two EAP results: ready for college, or not ready.

鈥 In math, there are three EAP results: ready for college, conditionally ready, or not ready.

The Early Warning:

鈥 Rising high school seniors receive a letter in August informing them of their EAP results.

Student Supports:

鈥 Students not yet college-ready in math can use a suite of online-learning tools or take courses at their schools. Use of the online modules does not offer an exemption; the tutorials are designed to boost students鈥 skills so they can pass CSU鈥檚 own placement tests. Conditionally ready students retain their EAP exemptions as long as they earn at least a C in a math course with a prerequisite of Algebra 2 or higher during the senior year.

鈥 Students not yet college-ready in English can use a suite of online-learning tools or take the Expository Reading and Writing Course, designed by precollegiate and CSU faculty members to reflect the skills needed in college-level English. Neither option leads to an exemption; both are aimed at increasing students鈥 chances of passing CSU placement tests.

Professional Development:

鈥 Two courses were created to strengthen high school English teachers鈥 literacy instruction: a 20-hour series designed to support the teaching of the Expository Reading and Writing Course and a broader 80-hour series; a Web-based tool helps teachers improve students鈥 essay-writing skills.

鈥 A redesigned course in math instruction is geared toward strategies that teach students how to solve complex problems.

鈥 The California State University system embeds the EAP鈥檚 expectations into preservice teacher training.

鈥 EAP coordinators at each CSU campus work with districts to help them understand their results, advise students, and strengthen teaching geared to the EAP.

SOURCE: 澳门跑狗论坛

The number of students opting to take the EAP has soared, and the proportion meeting its readiness cutoffs, while small, is growing.

Some speculate that the rising scores are the payoff for the investment in teacher training. CSU has embedded the EAP鈥檚 ideas into preservice teacher education and offers online supports for teachers, as well as in-person courses to bolster their instruction. More than 9,600 teachers鈥攏early 20 percent of the state鈥檚 high school English teachers鈥攈ave taken one or both of the literacy courses, and more than 2,000 have done so in math, according to CSU鈥檚 data.

CSU studies show that schools that fully implement the Expository Reading and Writing Course, which was designed to bolster instruction for students who fall short of the EAP鈥檚 English-readiness mark, improve on the state鈥檚 11th grade test twice as fast as schools that don鈥檛, and students who take it have a better chance of passing the university system鈥檚 own placement tests.

In CSU surveys, teachers rave about the course for its power to spark top-notch work from both students and teachers. Of California鈥檚 1,400 public high schools, 376 have fully implemented the course; others use some of its modules.

Some data on the EAP are less encouraging. Remediation rates at CSU remain largely unchanged in the past six years. Even though all first-time freshmen enter the system having completed the system鈥檚 required 鈥淎-G鈥 course sequence, and the average freshman carried a B average in high school, 49 percent must take remedial English, and 38 percent must take remedial math.

Too Little, Too Late?

Critics note that a crucial question about the EAP鈥攚hether it is a valid measure of college readiness鈥攈asn鈥檛 been fully answered. CSU has not yet completed its study of how students fare in credit-bearing work after EAP exemptions from remedial courses. One small study, from Santa Rosa Junior College, did find that students with EAP exemptions had higher grade point averages in their college coursework than those of the college鈥檚 general population.

William G. Tierney, a professor at the University of Southern California鈥檚 Rossier School of Education, urged policymakers in a 2008 paper to 鈥渟uspend the extensive accolades the EAP has gotten based on sketchy evidence鈥 of its success.

In an interview, he said the program is weak on helping students once they fall short of the readiness cutoff. The expository-writing course is not as widely available as it should be, he said, especially in low-performing schools where it鈥檚 needed most. And too often, he found in his research, students don鈥檛 understand the letter notifying them of their EAP results and are unaware of catch-up options.

鈥淎ssessment is important, absolutely,鈥 Mr. Tierney said. 鈥淏ut if students and parents don鈥檛 know what to do with the results, it鈥檚 useless.鈥

One small study, as yet unpublished, put a fine point on that problem. It found that four in 10 students didn鈥檛 remember taking the EAP. Of those who didn鈥檛 pass it, more than 75 percent opted to do nothing about it in 12th grade.

Even those who support the Early Assessment Program wonder if its early-warning function kicks in too late to be helpful. By the time students get the news that they are not college-ready鈥攚hen they鈥檙e rising seniors鈥攊t鈥檚 often too late to rearrange their class schedules. Many students, also, are too far short of the mark to catch up in just one year.

Signals sent by the state鈥檚 own testing system might contribute to the problem. A study by James S. Lanich, the director of CSU鈥檚 Center to Close the Achievement Gap, back-mapped the EAP鈥檚 cutoff score to 4th grade California Standards Tests. He found that a student who didn鈥檛 score 鈥減roficient鈥 or above on that test in 4th grade had only a 3 percent chance of meeting the EAP鈥檚 readiness mark seven years later. That suggests, he said, that the cutoffs on the state鈥檚 own tests aren鈥檛 progressively preparing students for college readiness.

California鈥檚 experience with the EAP has delivered abundant food for thought and revision.

Carolina C. Cardenas, the associate director of academic outreach and early assessment in the CSU chancellor鈥檚 office, said the system is getting better able to track EAP-exempt students鈥 performance in credit-bearing courses and is investigating ways to build early-warning indicators into middle grades. Even if the program hasn鈥檛 yet produced huge gains in college readiness, she said, it has been a potent force for improvement by clarifying and raising expectations for everyone in the school pipeline.

鈥淲hen counselors tell us, 鈥榊ou give us the [EAP] results too late; I can鈥檛 change their class schedule,鈥 I get it. I really do,鈥 Ms. Cardenas said. 鈥淏ut my feeling is, why wouldn鈥檛 the student already be signed up for a fourth year of college-prep English? And why wouldn鈥檛 you get more kids in a fourth year of math? These conversations lead us to move more in that direction.鈥

Moving in that direction, though, is chronically hobbled by a shortage of resources and multiple policy priorities, some longtime activists in the state say.

Scott Hill, who served as undersecretary of education under then-Gov. Arnold Schwarzenegger and now oversees education policy at the Rancho Cordova, Calif.-based consulting company School Innovations & Advocacy, said the EAP has done 鈥渁n awful lot to start the conversation鈥 about college preparedness. But he hasn鈥檛 seen as much of a 鈥渞esponse of curiosity鈥 from the K-12 system as he had hoped about what must be done to align it with higher education.

鈥淧eople aren鈥檛 being evil,鈥 Mr. Hill said. 鈥淚t鈥檚 a matter of conflicting pressures and policy priorities and how difficult it is to get change in California on almost anything.鈥

How much districts have 鈥渆mbraced鈥 the EAP as a way to improve college readiness varies greatly from place to place, said Joe Radding, who oversees college-preparation programs for the California education department. But he contended that while the program has sparked an important conversation, particularly about the state鈥檚 weakness in teaching writing and expository analysis, it can鈥檛 be expected to serve as the 鈥渕ajor driver鈥 in bolstering K-12 students鈥 college readiness.

鈥淐alifornia still has a lot of work to do on things like high school graduation requirements and accountability,鈥 he said. 鈥淲e can鈥檛 leave those out of the discussion.鈥

Community Colleges Join In

The EAP has expanded its reach; community colleges are now part of the program. A 2008 law allowed them to participate, and as of this academic year, 48 of California鈥檚 112 the EAP鈥檚 results in lieu of their own course-placement tests.

In an attempt to 鈥渕irror what the CSU is expecting鈥 of transfer students, the community colleges are using the same EAP cutoff score that the university system uses, said Sonia Ortiz-Mercado, the community college system鈥檚 dean for matriculation and early assessment. Most high school students don鈥檛 think they need to prepare well for community college, she said, so using the same readiness score as the university system sends 鈥渁 stronger signal that they do.鈥

Some educators are concerned that doing so could discourage high school students from enrolling in community colleges. But Ms. Ortiz-Mercado said the system has taken extra steps to clarify that while many students might not meet the EAP benchmark for credit-bearing courses, all students can still be admitted to the open-access institution.

Stanford鈥檚 Mr. Kirst, who is studying the inclusion of community colleges in the EAP and also serves on the state board of education, said that the program can鈥檛 easily be 鈥渞etrofitted鈥 for that population, since such students are traditionally less academically prepared than university-bound ones. It is especially important, he said, that earlier warning signals and better supports be built into the K-12 pipeline to help students who will ultimately attend community colleges.

Ms. Ortiz-Mercado said the community college system is weighing the possibility of using an additional 鈥渟econdary cut score鈥 that could provide more fine-tuned information to guide course-placement decisions, since there is wide variation in skill levels among the many students the EAP deems 鈥渘ot yet ready鈥 for college.

Meanwhile, the University of California system, which draws from the state鈥檚 highest-achieving group of graduating seniors, supports the Early Assessment Program in concept, but has not agreed to use its results for course-placement purposes.

鈥淣either test was at a level that gave us confidence we could use it to measure college readiness for our purposes,鈥 said Susan Wilbur, the UC system鈥檚 director of undergraduate admissions.

Key lessons from the EAP are informing college-readiness work around the country. Both common-assessment consortia, for example, have engaged the support of higher education to design tests that reflect their expectations. Though plans are still in the early stages, both groups envision testing systems that will deliver early and frequent signs of students鈥 progress and be paired with supports for students and teachers. Both plan research to validate their tests as true indicators of college readiness.

Designing all the moving parts of a system that builds college readiness is a massive undertaking, said David S. Spence, who was instrumental in the EAP鈥檚 early design when he served as executive vice chancellor and chief academic officer of the California State University system. Now president of the Southern Regional Education Board, Mr. Spence is working with six states as they adopt EAP-like approaches.

鈥淚 know the challenge of doing this,鈥 he said. 鈥淏ut somehow, we have got to find a way to do it.鈥

Special coverage of district and high school reform and its impact on student opportunities for success is supported in part by a grant from the Carnegie Corporation of New York.
A version of this article appeared in the January 26, 2011 edition of 澳门跑狗论坛 as College-Readiness Program Hard to Gauge

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of 澳门跑狗论坛's editorial staff.
Sponsor
Reading & Literacy Webinar
Literacy Success: How Districts Are Closing Reading Gaps Fast
67% of 4th graders read below grade level. Learn how high-dosage virtual tutoring is closing the reading gap in schools across the country.
Content provided by 
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of 澳门跑狗论坛's editorial staff.
Sponsor
Artificial Intelligence Webinar
AI and Educational Leadership: Driving Innovation and Equity
Discover how to leverage AI to transform teaching, leadership, and administration. Network with experts and learn practical strategies.
Content provided by 
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of 澳门跑狗论坛's editorial staff.
Sponsor
School Climate & Safety Webinar
Investing in Success: Leading a Culture of Safety and Support
Content provided by 

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide 鈥 elementary, middle, high school and more.
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.

Read Next

College & Workforce Readiness Can the AP Model Work for CTE? How the College Board Is Embracing Career Prep
The organization known for AP courses and the SAT is getting more involved in helping students explore potential careers.
5 min read
David Coleman, CEO of the College Board, speaks at the organization's annual conference in Austin, Texas, on Oct. 21, 2024.
David Coleman, CEO of the College Board, speaks at the organization's annual conference in Austin, Texas, on Oct. 21, 2024. Long an institution invested in preparing students for college, the College Board increasingly has an eye on illuminating career options.
Ileana Najarro/澳门跑狗论坛
College & Workforce Readiness The Way Schools Offer CTE Classes Is About to Change. Here's How
The revision could lead to significant shifts in the types of jobs schools highlight, and the courses students are able to take.
4 min read
Photo of student working with surveying equipment.
E+
College & Workforce Readiness Even in Academic Classes, Schools Focus on Building Students' Workforce Skills
Schools work on meeting academic standards. What happens when they focus on different sets of skills?
11 min read
Students participate in reflections after a day of learning in Julia Kromenacker鈥檚 3rd grade classroom at Old Mill Elementary School in Mt. Washington, Ky. on Wednesday, October 16, 2024.
Students participate in reflections after a day of learning in Julia Kromenacker鈥檚 3rd grade classroom at Old Mill Elementary School in Mt. Washington, Ky., on Wednesday, Oct. 16, 2024. The Bullitt County district that includes Old Mill Elementary has incorporated a focus on building more general life skills, like collaboration, problem-solving, and communication, that community members and employers consistently say they want from students coming out of high school.
Sam Mallon/澳门跑狗论坛
College & Workforce Readiness Preparing for the Workforce Can Start as Early as 1st Grade. What It Looks Like
Preparing students for college and career success starts well before high school鈥攁nd it doesn鈥檛 only involve occupation-specific training.
5 min read
Jenna Bray, a 1st grade teacher at Old Mill Elementary School in Mt. Washington, Ky., helps her student Lucas Joiner on an online learning assignment on Wednesday, October 16, 2024.
Jenna Bray, a 1st grade teacher at Old Mill Elementary School in Mt. Washington, Ky., helps student Lucas Joiner on an online learning assignment on Wednesday, Oct. 16, 2024. The Bullitt County district, which includes Old Mill Elementary, has incorporated a focus on equipping students with more general life skills鈥攍ike communication, critical thinking, and problem-solving鈥攖hat employers and community members consistently say they want from students coming out of high school.
Sam Mallon/澳门跑狗论坛