A new study on the recent fact-checking trend to separate “fake news” from real reporting found that in the majority of cases, the fact-checkers are just as subject to bias as the news they evaluate.
The report underscored the importance of subjective judgments in the process of fact-checking, amply borne out by numerous examples where fact-checking organizations betray significant political and cultural biases in their assessments.
The results of the study, executed by Daniele Scalea of the Machiavelli Center for Political and Strategic Studies in Rome, were presented at the Italian Parliament Wednesday during an academic conference on the topic of fake news and journalism.
Many of the errors proceed from broadening the scope of fact-checking to include statements that express opinion, analysis or prediction.
Since fact-checkers do not limit themselves to appraising objectively verifiable assertions, the study revealed, they pronounce judgments not only about facts, but also about what attacks are fair, what arguments are reasonable, what forecasts are probable, and what language is appropriate.
In the majority of cases, the report continues, fact-checkers weigh the validity of arguments, rather than checking facts. This exercise involves significant space for human error and entails a good dose of subjective opinion, despite the pretension of impartial analysis.
As Glenn Greenwald had already noted in a 2011 essay titled “PolitiFact and the scam of neutral expertise,” Politifact “undermines its own credibility when it purports to resolve subjective disputes of political opinion under the guise of objective expertise.”
“What matters here more than PolitiFact’s obvious, specific errors,” Greenwald noted, “is the reason they were led to such error: namely, reliance on supposedly neutral, ideology-free ‘experts’ who are anything but that.”
Fact-checkers even evaluate predictions, the new study noted, which fall completely outside the realm of verifiable or falsifiable data. For instance, in 2011 PolitiFact evaluated the claim by Rick Perry that “when you sanction the Iranian Central Bank, that will shut down [Iran’s] economy.” PolitiFact judged the statement to be “half true,” because in their opinion the move would have “uncertain effects” and it’s not “proven” that Iran’s economy would shut down.
Ironically, an attentive reader wrote in to PolitiFact to point out a truly factual error in the same PolitiFact article, and the fact-checker was obliged to issue a public correction of the mistake.
In another humorous example, the fact-checkers at NBC News pronounced judgment on a claim by Donald Trump during the presidential debate that Hillary Clinton had “acid washed” her mail server. NBC called the claim false because Hillary had used a program called “BleachBit” to expunge her server of potentially damaging material rather than physically bathing the hard disk in corrosive acid.