Ķvlog

Federal

No School Improvement Models Get Top Rating From AIR

By Debra Viadero — October 10, 2006 3 min read
  • Save to favorites
  • Print
Email Copy URL

Only 10 of the 18 most widely used school improvement programs for middle and high schools have “mǻٱ” or “lٱ” evidence to show they work, and none deserves a top rating, a review by a Washington think tank concludes.

The review, released last week at a national conference in Houston, is the third in a series of consumer-style reports produced by the Comprehensive School Reform Quality Center at the American Institutes for Research. The federally financed reviews evaluate the research base for popular, prepackaged schoolwide-improvement designs and assign ratings based on their effectiveness and other characteristics.

is posted by the .

This time around, none of the models had a research track record robust enough to earn one of the nonprofit group’s two highest ratings—“very strong” or “strong.” Nonetheless, Steve Fleischman, the AIR vice president who oversees the project, characterized the results for secondary schools as encouraging.

“Part of this, I think, is that it’s really hard to do research at the high school or middle school level,” he said, “and some of the models are newer, so they haven’t had time to establish a research base.”

“But if we had done this a year and a half ago, there would have been even less evidence,” he added, describing 2005 as “a really good year for research.”

The four programs rated moderate for their effectiveness were: America’s Choice School Design, based in Washington; the School Development Program, the model developed by the Yale University psychologist James P. Comer; and Success for All—Middle Grades and Talent Development High School, both designed by researchers at Johns Hopkins University in Baltimore.

At the other end of the scale, no programs were found to lack any research evidence at all or to have a negative impact on student achievement. But the center’s analysts gave eight programs a rating of “zero,” meaning the studies found for those programs were not rigorous enough.

The center bases its standards on the federal government’s definition of “scientifically based research,” which tends to favor studies that use comparison and control groups.

Higher Standards

Among the zero-rated programs were well-established improvement models, such as High Schools That Work, of Atlanta; Accelerated Schools PLUS, of Storrs, Conn.; the Coalition of Essential Schools, based in Oakland, Calif.; and Modern Red Schoolhouse, of Nashville, Tenn.

How Effective Are They?

Four of 18 school improvement models the Comprehensive School Reform Quality Center evaluated were given a “mǻٱ” rating for their effectiveness in raising student achievement:

• America’s Choice School Design, Washington
• School Development Program, New Haven, Conn.
• Success for All—Middle Grades, Baltimore
• Talent Development High Schools, Baltimore

The center gave “lٱ” effectiveness ratings to six other programs:

• Expeditionary Learning, Garrison, N.Y.
• First Things First, Toms River, N.J.
• Knowledge Is Power Program (KIPP), San Francisco
• Middle Start, New York City
• More Effective Schools, Kinderhook, N.Y.
• Project GRAD, Houston

Source: American Institutes for Research

“We knew we did not have the kind of research where you have control groups. We’ve never had the resources to do that, but we’d welcome it,” said Gene Bottoms, the senior vice president of the Southern Regional Education Board, which founded High Schools That Work 20 years ago.

Used in 1,100 schools nationwide, that model got a stronger rating from the think tank seven years ago, when it undertook a similar review of improvement programs. But the research group’s research-quality standards for the current project are tougher. Of the 1,500 effectiveness studies the center reviewed for the secondary school report, only 41 made the cut.

The reviewers, who concentrated on programs used in at least 40 sites and three or more states, also rated programs on other characteristics besides effectiveness. Analysts looked, for example, to see whether the programs are particularly effective with diverse student populations, whether they lead more families to become involved in schooling, and whether they provide needed services and support for schools.

The ratings for secondary school programs were not as high as they were for elementary schools, which were the focus of the center’s first report in 2005. (“Report Critiques Evidence on School Improvement Models,” Dec. 7, 2005.) That review, which has since been downloaded from the center’s Web site more than 50,000 times, gave “moderately strong” effectiveness to two programs and moderate ratings to five others.

Nevertheless, Mr. Fleischman said the secondary school report and an updated version of the elementary school report due out later this fall may be the center’s last. Its three-year, $4 million grant to vet the research on comprehensive school reform models runs out next month, and the U.S. Department of Education’s office of elementary and secondary education has no plans to extend it.

Mr. Fleischman said the AIR would continue to make the center’s reports available on its Web site.

Related Tags:

A version of this article appeared in the October 11, 2006 edition of Education Week as No School Improvement Models Get Top Rating From AIR

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
College & Workforce Readiness Webinar
The Road to Opportunity: Making CTE Accessible for All
The most valuable CTE happens off campus. For too many students, transportation is the barrier that keeps opportunity out of reach.
Content provided by HopSkipDrive
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Recruitment & Retention Webinar
New Hire, No Laptop, No Login: Preventing Day-One Disruption
What happens before day one matters. Discover how districts are improving the new hire experience.
Content provided by 
Teaching Profession K-12 Essentials Forum Supporting the New K-12 Workforce: What Teachers Need to Stay at School
 Join this free virtual event to discover what teachers say they need to feel supported to stay in classrooms for the long haul.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.

Read Next

Federal Trump's Justice Dept. Investigates Dozens of Districts Over LGBTQ+ Curricula
The investigations target how schools discuss sexuality and gender identity and whether parents can opt their children out of lessons.
8 min read
The U.S. Department of Justice is investigating how 43 school districts in three states teach about sexuality and gender identity and whether they give parents the opportunity to opt their children out of lessons that conflict with their religious beliefs on June 16, 2026.PICTURED, Protesters gather outside the Glendale Unified School District headquarters in Glendale, California, on June 20, 2023. Over 300 people gathered outside the Glendale Unified School District headquarters, as protests continued over the issue of teaching children about same-sex parents and queer issues.
Protesters gather outside the Glendale school district in Glendale, California, on June 20, 2023 over the issue of teaching children about same-sex parents and queer issues. The U.S. Department of Justice is now investigating three other school districts over LGBTQ+ themes in sex ed. and beyond. (The Glendale district is not one of them.)
DAVID SWANSON / AFP via Getty Images
Federal Education Department Moves Special Ed. and Civil Rights to Other Agencies
Special education programs help schools serve more than seven million K-12 students with disabilities nationwide.
9 min read
A banner featuring a photo of President Donald Trump hangs outside the Department of Justice in Washington on Monday, June 15, 2026.
A banner featuring a photo of President Donald Trump hangs outside the Department of Justice in Washington on Monday, June 15, 2026. The U.S. Department of Education is moving its office for civil rights to the Justice Department as part of a fresh wave of outsourcing.
Bill Clark/CQ Roll Call via AP
Federal Trump's Ed. Dept. Backs Away From Addressing Civil Rights for Black Students
Civil rights attorneys describe the administration’s actions as an inversion of legal history.
6 min read
Thomas Chalmers Public School sign is seen outside of school in Chicago, Wednesday, July 13, 2022. America's big cities are seeing their schools shrink, with more and more of their schools serving small numbers of students. Those small schools are expensive to run and often still can't offer everything students need (now more than ever), like nurses and music programs. Chicago and New York City are among the places that have spent COVID relief money to keep schools open, prioritizing stability for students and families. But that has come with tradeoffs. And as federal funds dry up and enrollment falls, it may not be enough to prevent districts from closing schools.
Children are seen outside the Thomas Chalmers Public School in Chicago on July 13, 2022. Under the Trump administration, efforts to address deep-rooted inequities for students of color are being cast as discriminatory against white students. The administration withheld more than $20 million from Chicago schools when the district refused to end its Black Student Success Program.
Nam Y. Huh/AP
Federal Interactive Feds Issue a Slimmed-Down Data Release on U.S. Schools
The Condition of Education highlights school enrollment, finance, and graduation data.
Image of blurry data and a school building.
Laura Baker/Education Week + Canva