You are using an outdated browser.
Please upgrade your browser
and improve your visit to our site.

The Emptiness of Data Journalism

Nate Silver could learn a lot from those op-ed columnists he maligns

ASSOCIATED PRESS/Nam Y. Huh

I wish to say a word or two in defense of “bullshit.” That is Nate Silver’s meticulously chosen term—he does nothing imprecisely—for opinion journalism. “Plenty of pundits have really high IQs,” he announced to New York magazine, “but they don’t have any discipline in how they look at the world, and so it leads to a lot of bullshit, basically.” Referring to the fragment of Archilochus about the hedgehog and the fox (he strangely calls it “a quote which was originally attributable to an obscure Greek poet”) made famous in modern times by Isaiah Berlin, he continues that “the op-ed columnists at the New York Times, Washington Post, and Wall Street Journal are probably the most hedgehoglike people. They don’t permit a lot of complexity in their thinking. They pull threads together from very weak evidence and draw grand conclusions from them. They’re ironically very predictable from week to week.” This predictability, he says, is owed to their “very strong ideological priors,” which prevent them from “evaluating the data as it comes in [and] doing a lot of [original] thinking. They’re just spitting out the same column every week.” Silver, by contrast, has chosen a fox’s snout for the logo of his new site for “data journalism, capital D.” He knows many things. He has no priors. He thinks only originally. He never repeats himself. Never mind that the ancient poet’s line was most likely preferring the hedgehog to the fox, and praising “one big thing.” The fox, a predatory creature, is loose.

The quality of opinion journalism in America is a matter of concern for opinion journalists, too. Opinion, after all, is easy. In a democratic society, moreover, opinion is holy. “It’s just my opinion”: with those magical words, which are designed to change the subject, Americans regularly seek sanctuary from intellectual pressure on their utterances. Their opinions do not deserve such immunity, of course, and neither do the opinions of columnists. The state of American punditry is not strong. A lot of it is lazy, tendentious, and lost to style. But Silver’s outburst is nonetheless a slander. There are all sorts of pundits just as there are all sorts of quants. The editorial pages of The Washington Post in particular are regularly filled with analytical and empirical seriousness. But Silver wishes to impugn not only the quality of opinion journalism, he wishes to impugn also its legitimacy. The new technology, which produces numbers the way plants produce oxygen, has inspired a new positivism, and he is one of its princes. He dignifies only facts. He honors only investigative journalism, explanatory journalism, and data journalism. He does not take a side, except the side of no side. He does not recognize the calling of, or grasp the need for, public reason; or rather, he cannot conceive of public reason except as an exercise in statistical analysis and data visualization. He is the hedgehog who knows only one big thing. And his thing may not be as big as he thinks it is.

Since an open society stands or falls on the quality of its citizens’ opinions, the refinement of their opinions, and more generally of the process of opinion-formation, is a primary activity of its intellectuals and its journalists. In such an enterprise, the insistence upon a solid evidentiary foundation for judgments—the combating of ignorance, which is another spectacular influence of the new technology—is obviously important. Just as obviously, this evidentiary foundation may include quantitative measurements; but only if such measurements are appropriate to the particular subject about which a particular judgment is being made. The assumption that it is appropriate to all subjects and all judgments—this auctoritas ex numero—is not at all obvious. Many of the issues that we debate are not issues of fact but issues of value. There is no numerical answer to the question of whether men should be allowed to marry men, and the question of whether the government should help the weak, and the question of whether we should intervene against genocide. And so the intimidation by quantification practiced by Silver and the other data mullahs must be resisted. Up with the facts! Down with the cult of facts! 

An opinion with a justification may be described as a belief. The justification that transforms an opinion into a belief may in some instances be empirical, but in many instances, in the morally and philosophically significant instances, it will not be empirical, it will be rational, achieved in the establishment of the truth of concepts or ideas by the methods of argument and the interpretation of experience. A certain kind of journalistic commentary, when it is done rightly, is a popular version of the same project, an application of thoughtfully (and sometimes wittily) held principles to public affairs, and is therefore an essential service to a free society. The intellectual predispositions that Silver ridicules as “priors” are nothing more than beliefs. What is so sinister about beliefs? He should be a little more wary of scorning them, even in degraded form: without beliefs we are nothing but data, himself included, and we deserve to be considered not only from the standpoint of our manipulability. I am sorry that he finds George Will and Paul Krugman repetitious, but should they revise their beliefs so as not to bore him? Repetition is one of the essential instruments of persuasion, and persuasion is one of the essential activities of a democracy. I do not expect Silver to relinquish his positivism—a prior if ever there was one—because I find it tedious.

Silver proclaimed in the interview that “we’re not trying to do advocacy here. We’re trying to just do analysis. We’re not trying to sway public opinion on anything except trying to make them more numerate.” His distinction between analysis and advocacy is a little innocent. (Like the insistence of the man who went from the Times to ESPN that he is an “outsider.”) Is numeracy really what American public discourse most urgently lacks? And why would one boast of having no interest in the great disputations about injustice and inequality? Neutrality is an evasion of responsibility, unless everything is like sports. Like Ezra Klein, whom he admires, Nate Silver had made a success out of an escape into diffidence. What is it about conviction that frightens these people?

Leon Wieseltier is literary editor of The New Republic.