Andrew Coulson graciously responds to the slings and arrows I hurled at think tanks. I understand that EPI wishes to respond as well, so things should get lively around here.
I love Cato. I love school choice. I read their stuff all the time, and I think a lot of it is great. I cite it and use it.
But any movement is prone to groupthink. Yea, whenever two or more libertarians are gathered together, you have at least three opinions. But those opinions almost never extend to "You know what America needs? A single-payer national healthcare system." Likewise, I'm pretty sure the break room at EPI never hears the words "Right-to-work laws are awesome!" Groups extend to their own less scrutiny than they extend to those who disagree with them. They form their own domains of knowledge that tend to exclude sources of disconfirming data. Agreement on core principles like "Society should maximize individual liberty" means a lot of questions never get asked.
I don't think that think tanks fudge their numbers. I know Cato pretty well, so I know it's full of earnest, extremely smart people who genuinely believe what they write, and are scrupulous about doing high-caliber work. Most of them are smarter than me, and all of them are probably more likeable in person. But in any sort of policy debate, there's always the danger of asking yourself the question you want to answer.
Say you want to know whether Bush's tax cuts made the tax code more or less progressive. You can ask whether the gradient between brackets has gotten steeper, or you can ask whether the rich now pay a higher or lower percentage of the nation's tax bill than they did before. Those will give you different answers to the original question.
Hence the dueling factoids over whether Bush's tax cuts disproportionately benefitted the rich. The left likes to look at the average amount individuals got, which leads to the conclusion that the rich got a lot more. The right likes to look at who got a bigger share of the tax cuts, which leads to the conclusion that the poor and the middle class were the big winners. Neither of those ways to frame the question is obviously wrong.
It is easier to do this when everyone who works with you, and most of the people you socialize with, agree with you. They also influence who you consider reliable sources--the extreme version of this is Chomskyites, who reject any source that disputes The Great Man's lies more fanciful interpretations of events. But everyone does it. Liberals like are fond of Card and Krueger. Conservatives like love Neumark, Wascher, and Murphy. The group acceptance of what are the "best" sources seriously influences work based on them.
I'm not saying academics are immune to this--indeed, the CK/NW divide is a good example of the tendency. But academics tend to ask narrower questions--not "Is the minimum wage a good idea" or "who benefits, rich or poor?" Instead they ask things like "what are the effects of the minimum wage on employment?" Now, often those figures get used as if they answered one of the other questions, either because the media needs a good lede, or because the professor has an axe to grind. But there's somewhat less room for choosing your data sources--and at least in economics, it will matter if your colleagues across the political aisle reject your approach. Cato loses little credibility with libertarians if CBPP publishes a withering critique of its work (I mean, it would if any such critique were possible.)
I certainly agree that academics and government employees are not some sort of objective priests who cannot be swayed by thought of politics. I wasn't, for example, very impressed when Kenneth Thorpe estimated that Kerry's healthcare plan would cost $900 million--then a few months later dialed down his estimate to very nearly exactly what Kerry was planning to raise from rolling back the Bush tax cuts. In that situation, I thought that AEI's estimate was probably much closer to the actual mark, and said so. Though to be fair, in part that's because I assume that every government health care plan is going to cost twice the most pessimistic estimate.
In an ideal world, we'd all assess the claims and check the numbers for ourselves.
But readers can't or won't do that. Without reading the studies, I need to rely on reputational credibility to assure them that the data are sound. Think tank numbers are totally useless in a cross-ideological debate. No one on the other side will accept them. And because the think tanks have usually chosen different questions that produce different answers, we bloggers end up in an extremely tiresome round of "dueling think tank studies". Unfortunately, everyone on the other side has a +3 anti-free-market shield on, and I never get through.
I imagine I will not be invited to Cato's annual dinner, and probably EPI has stricken me from the Christmas card list. But I didn't mean to malign Cato, or for that matter EPI, though we're a lot less ideologically compatible. Both are full of honest people who believe what they are writing. But when an institution gathers scholars together specifically to advance an agenda--even an agenda as broad as "Free markets and free minds"--that changes how you use their work, if for no other reason than that it makes a broad swathe of your audience mighty suspicious.
I do think Mr. Coulson is absolutely right about one thing: right wing, and particularly libertarian, think tanks get harsher scrutiny from the media than left wing, academic, or government figures--I once scratched a reference to the Manhattan Institute because the editor wanted me to label it "ultralibertarian" while pasting "nonpartisan" on some left wing group whose name escapes me. I ditched the paragraph rather than make the switch, which may be why they never commissioned work from me again.
The problem is, I don't think that the media are, in general, very good watchdogs about this sort of thing. Most reporters can't read a financial statement, don't know how to handle statistics, and would run screaming if you suggested a regression. That's why I think the most interesting work is the stuff that covers debates within the movement--things like net neutrality, or "libertarian paternalism", for example, or the internal debates on both sides about health care policy.
Anyway, Cato . . . what I'm trying to say is, I adore you. And EPI, I don't know any of you, but I'm sure you're all pretty swell folks too. Even if you don't invite me to your annual dinners, y'all are welcome at my place any time.
| 
Wow, Megan. That's downright Foucauldian! Knowledge created by power and power created by knowledge, think tanks form exclusionary discourses!
I never knew you were so Postmodernist!
Posted by MrProliferation | May 14, 2008 4:30 PM