Concord Consortium Blog

Education Week of January 24, 2007 has two articles about the What Works Clearinghouse (www.whatworks.ed.gov). One of them notes that the WWC is costing the Department of Education $435 million over five years!!! This is a lot of money. The WWC does not conduct any original studies. Instead, it reviews existing studies of education “interventions” (such as elementary school math textbooks). Surprise, surprise … most of the “interventions” that it investigates don’t have much good evidence to support them.

Wouldn’t it be interesting to figure out how much money it would take to actually conduct good research about math and science education interventions: textbooks, computer software, supplementary materials, etc? Certainly hundreds of millions of dollars. Perhaps billions. Where is that money going to come from? Nowhere fast--at least not anytime soon.

And where is the money to develop and test new instructional materials? Especially significantly different, technology-based interventions.

This whole topic of “evidence-based practice” would require a book, or two or three. (And of course there are some that are at least related.) The No Child Left Behind Act actually defines “scientifically-based research,” which is a very strange idea. (Can you imagine the Congress defining medical research?). And the same Act also requires (strong language) that billions of dollars of federal monies be used only for proven ("scientifically-based") practices. Of course, that "requirement" is impossible to adhere to, partly because the evidence base is so weak. (Not to mention the Reading First scandal, in which it was discovered that the manager of the $1 billion federal Reading First program was biased for some programs and against others, independent of the research.)

Then there’s the whole question of appropriate outcome measures. Take the goal of teaching students to write well. There is now evidence (a) that if you teach students using a word processor (and other technology tools) they write better and (b) if you test students with paper and pencil those who have learned to write with a computer may be disadvantaged. Virtually all writing in the real world, especially of any length, is now done with computers. But very few students are tested that way--yet.

Contemplating the government’s decision to invest more than $400 million in the What Works Clearinghouse should give one pause. Is this a wise investment? What do you think?