Ķvlog

Special Report
Education Funding

Tough Work Begins for Race to Top Assessment Winners

By Catherine Gewertz & Erik W. Robelen — September 14, 2010 7 min read
  • Save to favorites
  • Print
Email Copy URL

In a move that could reshape academic assessment in nearly every corner of the country, the U.S. Department of Education has awarded $330 million in grants to collaboratives of states to design better ways of measuring student learning.

The , awarded Sept. 2, went to two groups of states that sought the money under the federal Race to the Top program, spawned last year by the federal economic-stimulus law. Through the two consortia, 44 states and the District of Columbia are taking part in shaping the new assessments, which are scheduled to debut in the 2014-15 school year.

Dividing the money almost equally, the consortia must build testing systems that gauge how well students master a newly crafted set of common academic standards in mathematics and English/language arts that have been adopted so far—at least provisionally—by 36 states and the District of Columbia. Those testing systems also must be capable of producing rapid feedback for teachers on students’ learning and of measuring the effectiveness of teachers, schools, and school leaders.

A third group of 12 states applied for a separate $30 million pot for development of high school exams but did not get a grant.

Reshaping Assessment

Two consortia, or groups, of states have won Race to the Top grants to design new K-12 systems of assessment to be rolled out in the 2014-15 school year.

Partnership for the Assessment of Readiness for College and Careers Consortium

• MEMBERSHIP: 26 states

• AWARD: $170 million

• PROCURING STATE: Florida

• GOVERNING STATES: Arizona, the District of Columbia, Florida, Illinois, Indiana, Louisiana, Maryland, Massachusetts, New York, Rhode Island, Tennessee

• ADVISORY STATES: Alabama, Arkansas, California, Colorado, Delaware, Georgia, Kentucky, Mississippi, New Hampshire, New Jersey, North Dakota, Ohio, Oklahoma, Pennsylvania, South Carolina

SMARTER Balanced Assessment Consortium

• MEMBERSHIP: 31 states

• AWARD: $160 million

• PROCURING STATE: Washington

• GOVERNING STATES: Connecticut, Hawaii, Idaho, Kansas, Maine, Michigan, Missouri, Montana, Nevada, New Mexico, North Carolina, Oregon, Utah, Vermont, Washington, West Virginia, Wisconsin

• ADVISORY STATES: Alabama, Colorado, Delaware, Georgia, Iowa, Kentucky, New Hampshire, New Jersey, North Dakota, Ohio, Oklahoma, Pennsylvania, South Carolina, South Dakota

Note: PROCURING STATES are the fiscal agents. GOVERNING STATES shape test-design policy. ADVISORY STATES consult on test design, but have no decisionmaking authority.

SOURCE: Education Week, State Consortia

In a speech announcing the winners, Secretary of Education Arne Duncan lauded the competition for its potential to be a transformative force in education by giving teachers immediate, meaningful feedback on students’ understanding and leaving “bubble tests” behind to measure a more complex range of student skills. He also said the Obama administration hopes to see common tests of other subjects, such as science and history, created in the future.

“I am convinced that this new generation of state assessments will be an absolute game-changer in public education,” Mr. Duncan said at a meeting of education policymakers in Alexandria, Va.

Only two consortia competed for the bigger pot of funding. The , or PARCC, which consists of 26 states, won $170 million. The , or SBAC, which includes 31 states, won $160 million. A dozen states belong to both groups, but most were expected to choose one eventually.

Common Features

Analysts have noted that the two winning groups’ plans have much in common.

Both say they would combine the results from performance-based tasks administered throughout the academic year with a more traditional end-of-the-year measure for school accountability purposes. Both also plan to administer their year-end assessments via computer, but only the SMARTER Balanced group would use “computer adaptive” technology, which adjusts the difficulty of questions to students’ responses, as the basis of that year-end test.

Both seek to reflect not simply students’ skill at factual recall, but also their strength at analyzing material and applying their knowledge. But the SBAC group intends to focus more effort on devising interim and formative assessments to capture students’ progress as they learn. (“Three Groups Submit Applications for Race to Top Assessment Grants,” July 14, 2010.)

A panel of nine peer reviewers, convened by the Education Department, evaluated the applications. On scoring guides totaling 220 points, the panel awarded 164 points to the Partnership consortium and 151 points to the SMARTER Balanced group. PARCC won more money only because it requested more, not because it scored higher than its rival, according to department spokeswoman Sandra Abrevaya.

In evaluating the proposal for high-school-level tests, submitted by the State Consortium on Board Examination Systems, or SCOBES, the reviewers gave it 126 points out of 220. The proposal drew widely varying reactions from among the nine reviewers.

The SCOBES group had hoped to help states and districts offer “highly integrated” systems of instruction that included a core curriculum with course syllabuses, exams derived from those course outlines, and professional development. That idea was spearheaded by Marc. S. Tucker, the president of the Washington-based National Center on Education and the Economy. Noting that the project predated the Race to the Top, Mr. Tucker said the 12 states involved plan to seek other sources of funding and move ahead.

Ms. Abrevaya said the department would not repeat the high school exam competition. Mr. Duncan, in a conference call with reporters, noted that the winning proposals by the two larger consortia both include a high school component.

Building Consensus

Observers caution that many challenges remain as the winning consortia begin the complex work of turning ideas into new assessment systems.

In the last few months, both groups worked to refine their governance structures and their test-design ideas. But now they move into a more complicated phase of inviting and evaluating proposals, hiring additional staff members, and juggling the dozens of people involved in the effort, from state education department officials to project managers and vendors. Even scheduling meetings—whether actual or virtual—will take on new degrees of difficulty.

“It won’t be easy getting everyone into the big tent,” said Tony Alpert, who is a co-chairman of the SMARTER Balanced consortium’s executive committee. “To put together even one meeting, we have to work across five time zones.”

The consortia will need to build the right types of expertise into their work, said Michael Cohen, the president of Achieve, a Washington-based group that is the project-management partner for the PARCC consortium. His group, for instance, will need to build capacity in project management, quality assurance, assessment development, and engagement of precollegiate and college-level education systems, among other areas, he said.

Nurturing and maintaining consensus among consortium members will be a key challenge as well, assessment experts say.

Scott Marion, the associate director of the Dover, N.H.-based Center for Assessment, said there will be plenty of nitty-gritty issues to work through. Can states agree, for instance, on what the testing window will be for all the assessment pieces? Will they all agree to the same policies in making accommodations for students with disabilities or for English-language learners?

“There are all sorts of things like that, all these nagging details when you go from ideas to operation,” said Mr. Marion, whose group helped all three consortia as they shaped their proposals.

Mr. Cohen recalled an effort nine years ago to craft a common Algebra 1 test for a group of Southern states. It didn’t take long, he said, for state assessment directors to “agree that they couldn’t agree” on a host of issues, including when to administer the test.

Another unresolved question facing the consortia concerns the extent to which states can be granted freedom to vary their approaches to the common assessments.

“It’s hard to get 30 states to agree on anything,” said Gary W. Phillips, a vice president and chief scientist at the American Institutes of Research, based in Washington. “By the nature of the states and their natural independence, they will want to have a lot of flexibility, but you can’t have things that are common and also have a lot of flexibility.”

Multipurpose Measures

The consortia will grapple, too, with the tension inherent in trying to use one assessment for multiple purposes, observers say.

The Education Department’s invitation to applicants sought systems of assessments that would be used to take a snapshot of students’ achievement, measure their growth over time, gauge their college and career readiness, and evaluate the effectiveness of teachers, principals, and schools. The tests are supposed to produce summative information for accountability purposes, as well as feedback to help teachers adjust instruction in real time.

“The more additional purposes you add to an assessment system, the less likely you are to be able to fulfill those additional functions well,” said W. James Popham, a professor emeritus of education at the University of California, Los Angeles, who focuses on assessment.

He added that it is possible to design a system both to evaluate schools and to provide instructional feedback to teachers, but he ventured that it will be difficult in an assessment industry dominated by “traditionalists” accustomed to making tests that compare students with one another.

As the consortia design their assessments, it is expected that Congress will rewrite the Elementary and Secondary Education Act, which is already long overdue for reauthorization. That could put the assessment consortia in the position of having to adjust their work to make their products usable for federal accountability purposes, a number of experts noted.

That is one reason why the Race to the Top assessment grants are being handled as “cooperative agreements,” Education Department officials said. That arrangement allows the state consortia to make—or the federal government to demand—changes in the work agreement in response to changing circumstances, according to those in the department and the consortia.

Rather than simply supplying “deliverables” to fulfill a grant, consortium members will have a more interactive, involved relationship with Education Department officials as they complete the cooperative agreements, consortium insiders said.

A version of this article appeared in the September 15, 2010 edition of Education Week as U.S. Tests Awaiting Big Shifts

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Teaching Webinar
Maximize Your MTSS to Drive Literacy Success
Learn how districts are strengthening MTSS to accelerate literacy growth and help every student reach grade-level reading success.
Content provided by 
College & Workforce Readiness Webinar How High Schools Can Prepare Students for College and Career
Explore how schools are reimagining high school with hands-on learning that prepares students for both college and career success.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School Climate & Safety Webinar
GoGuardian and Google: Proactive AI Safety in Schools
Learn how to safely adopt innovative AI tools while maintaining support for student well-being. 
Content provided by 

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.

Read Next

Education Funding Trump Admin. Cancels Dozens More Grants, Hitting Civics, Arts, and Higher Ed.
The multi-year initiatives are abruptly losing funding midway through their grant periods.
10 min read
Students in a seventh grade civics class listen to teacher Ella Pillitteri at A.D. Henderson School in Boca Raton, Fla. on April 16, 2024.
Students in a 7th grade civics class listen to teacher Ella Pillitteri at A.D. Henderson School in Boca Raton, Fla. on April 16, 2024. The Trump administration's grant cancellations have hit ongoing programs that promote civics, arts, and literacy education, and more.
Rebecca Blackwell/AP
Education Funding How Efforts to Fund Schools More Equitably Actually Worsened Racial Inequality
Researchers examined three decades of school finance reforms in 40 states.
2 min read
Vector illustration of two hands pulling apart money and it tears in unequal parts.
iStock/Getty
Education Funding Your Guide to the Evolving Federal Budget and What It Means for Schools
Lawmakers have a few weeks to agree on a new budget and an approach to Trump's funding uncertainty.
9 min read
The Capitol Building in Washington on Sept. 1, 2025. Congress returned from August recess this week to tackle several high profile hearings and face a September 30 deadline to fund the federal government.
The Capitol Building in Washington on Sept. 1, 2025. Congress faces a deadline within weeks to fund the federal government for the fiscal year that starts Oct. 1. President Donald Trump has proposed big changes for school funding that lawmakers must decide whether to accept, reject, or modify.
Aaron Schwartz/SIPA USA via AP
Education Funding House Lawmakers Endorse Some—But Not All—of Trump's Education Cuts
House budget writers are proposing to cut Title I funding by nearly $4 billion.
5 min read
House Appropriations Committee Chairman Tom Cole, R-Okla., discusses the Republican-crafted plan as the House Rules Committee prepares a spending bill that would keep federal agencies funded through Sept. 30, at the Capitol, in Washington on March 10, 2025.
House Appropriations Committee Chairman Tom Cole, R-Okla., speaks in the Capitol in Washington on March 10, 2025. A House Appropriations subcommittee has put forward a budget that embraces many of President Donald Trump's proposed cuts to the federal education budget and rejects others.
J. Scott Applewhite/AP