Better data are needed to answer critical and controversial questions about the nation鈥檚 experiment with charter schooling, researchers agreed at a forum here last week. But they didn鈥檛 see eye to eye on what studies have shown to date, or what are the most important topics that scholars should address in the future.
Defending her recent report on charter school students鈥� scores on the National Assessment of Educational Progress, a researcher from the American Federation of Teachers said the numbers showed that claims of 鈥渕iracles鈥� by charter supporters were off base.
The report, which ignited a late-summer skirmish between pro- and anti-charter forces, found that 4th and 8th graders in charter schools lagged behind their peers in regular public schools on the 2003 NAEP. (鈥淎FT Charter School Study Sparks Heated National Debate,鈥� Sept. 1, 2004.)
鈥淐harter schools are not the magic bullets that a lot of the zealots claimed,鈥� said Bella Rosenberg, a special assistant to the president of the AFT, which has called for a moratorium on charter schools.
Ms. Rosenberg and two others appeared on a panel convened by the Century Foundation, a New York City-based think tank formerly known as the Twentieth Century Fund that supports scholarship in a wide range of public-policy areas.
Another panelist noted that previous research he conducted had also found students in charter schools scoring lower on average on state tests. Tom Loveless, the director of the Brown Center on Education Policy at the Brookings Institution in Washington, cautioned against drawing broad conclusions from that disparity, though, in part because charter schools attract many children who have fared poorly in regular public schools.
鈥淲e can鈥檛 conclude that charter schools underperform public schools because somehow the charter schools are doing something wrong,鈥� Mr. Loveless said.
A third panelist, Amy Stuart Wells, said her reading of test-score data on charter schools was that it is 鈥渧ery inconclusive.鈥� But Ms. Wells, a professor of education and sociology at Teachers College, Columbia University, called it 鈥渟urprising鈥� that charter schools in the aggregate have not produced major gains in student achievement, 鈥済iven the claims around the charter school movement if we go back to the early 1990s.鈥�
鈥淐harter schools were not only supposed to improve achievement for the kids enrolled in them,鈥� Ms. Wells said, 鈥渂ut they were also supposed to improve achievement for kids in neighboring public schools, because they were infusing this competitive force into the system.鈥�
Unpacking the Box
Although she acknowledged that the NAEP numbers offered a 鈥渓imited鈥� look at charter school performance, Ms. Rosenberg said she viewed charter school students鈥� showing on the NAEP tests in reading and mathematics as 鈥渢roubling.鈥�
Of particular concern, she said, were findings that charter school students did worse even after researchers took into account their higher levels of family poverty and the fact that most charter schools are in inner cities. In a finding that she contended 鈥渙ur attackers like best,鈥� Ms. Rosenberg said the AFT analysis found that students in charter schools and regular public schools scored about the same after researchers controlled for differences in the racial makeups of the schools.
That critics of her study take comfort in that finding, she argued, suggests 鈥渢he soft bigotry of low expectations鈥� about minority students鈥� achievement: 鈥淪ocioeconomic status has a lot more to do with performance than race.鈥�
Mr. Loveless said that it was 鈥渉inted鈥� throughout the AFT report that the union 鈥渨ould like you to draw鈥� the conclusion that charter schools are 鈥渦nderperforming regular public schools simply because they鈥檙e not really very good schools.鈥�
鈥淗owever, it is equally plausible that charter schools are underperforming regular public schools because they are drawing initially, from the get-go, kids who are underperforming the average child in a regular public school,鈥� he said. 鈥淎nd if that鈥檚 true, charter schools could actually be doing a better job than regular public schools.鈥�
Mr. Loveless also pointed to studies, which he called 鈥渕ethodologically superior鈥� to the AFT analysis, that have found students in charter schools to be progressing faster on standardized tests than their counterparts in regular public schools.
During the forum鈥檚 question period, another researcher who has studied charter schools said 鈥渉elp is on the way鈥� for those trying to sort out how they are doing.
Mark Schneider, a professor of political science at the State University of New York at Stony Brook, said the U.S. Department of Education has earmarked $5 million for a randomized study of 50 charter schools and $10 million over five years for a new research center on school choice at Vanderbilt University in Nashville, Tenn. Results from those research efforts will take three to five years, he said, 鈥渂ut these are the best studies we could imagine.鈥�
鈥淲hat we really need to do is unpack the black box,鈥� Mr. Schneider said. 鈥淐harter schools are not homogeneous, and neither are traditional public schools. What we really should be doing is looking at and identifying the kinds of things that make for good education, whether they are found in charter schools or whether they鈥檙e found in traditional public schools.鈥�
