Yes. Although, let me qualify: it’s been a failure if the purpose of the movement is to generate rationalists. That is, people that are capable of evaluating their beliefs and others, and then placing those beliefs along a continuum of naïve truth. Now, why do I believe this? Two reasons: the skeptic community doesn’t generally act in a way that you’d expect a rationalist community to act, and the necessary prerequisites to become a rational thinker aren’t the same prerequisites to generally be considered part of the movement.
How would a community of rational thinkers act? Well, they would understand most logical fallacies, cognitive biases, social biases, and methods for mitigating those irrational qualities inherent in all humans. As it stands, most people in this community are expected to understand a few logical fallacies, but, following that, not much else. For example, you’ll find podcasts from within the community discussing fallacies, or skeptic dictionaries or webpages discussing these fallacies, but not much on bias or rational training.
The most recent test for the skeptic community was Elevatorgate, and preceding that accomodationalism. You can google this and find the relevant information, but, suffice it to say, the skeptic community failed both tests. With the recent test, on every skeptic forum or community, you could find examples of irrationality on both sides of the issue, and you could see that the irrational comments vastly outweighed the rational. (To clarify: my criterion for an irrational comment in this context is one that appears to deliberately fail to understand the opposing side, and to make a flagrantly unsound argument.) Basically, Elevatorgate showed us a community that acted in a way that you’d expect a rationalist community to not act.
“But, wait…,” you say. “Doesn’t the skeptic community act more rationally than others? Don’t they oppose pseudoscience and other nonsense?” Yes, but how has the community come to act in this way regarding those topics and not Elevatorgate? I think the likely explanation is that there are skeptical leaders that lead the otherwise irrational community to their own rational conclusions. And, unfortunately, they do this through persuasive argument. They’re politicians. They should be teachers. But they’re politicians, and because they’re politicians, when they’re met with a topic outside their remit, they fall silent, and then their followers feel free to vocalize their thoughts. And chaos. Pure irrational chaos. We then see the movement for what it is: a skeptical republic.
The followers vote for their leaders with viewership. They give them power within the movement. The leaders are then tacitly tasked to follow through with the platform they ran on—lest they lose viewership and power. Here’s how it works: someone becomes popular through a science podcas. They make the decisions regarding what’s science and pseudoscience, and their voters live with the decisions. And, generally, I think this works. This generates a community that acts rationally in those areas. These leaders are elected because, typically, they are experts on the platforms they ran on, and so we can expect that they have a significant amount of knowledge within that area. However, this makes them act rationally qua them knowing what is and isn’t wrong within their remit rather than them acting rationality qua them being rational. They work backwards from what they already know to be true, and then find the flaws, any flaws, in their opposition.
So, if this model works for the most part, then there really isn’t a problem, right? No, I think there is a problem, and it parallels the problem faced by all systems where the majority has influence. It’s the signal to noise problem. As more people join the system, the noise grows and we eventually lose the signal. So, for example, as more people join the skeptic community, there will be more incentive to become a skeptical leader. More reward. With more reward people are more likely to forego their passion—to see a truly rational community—and then quell that passion with more demanding ones (e.g., money and power). Also, people that were otherwise not interested in the movement will see a dollar to be made, and then market themselves to the broadest segment of the community. When you market yourself to the broadest segment of a community, you don’t appeal to their high-mindedness. You appeal to emotion. To tribalism. You provide entertainment at the cost of intellectualism. Over time, this will degrade the purpose of the skeptical movement, and it will become just another subculture with little inherent meaning. “Oh, you’re a skeptic? I’m a new atheist.”
A skeptic should be able to evaluate a claim on its evidence. It doesn’t matter if the claim is regarding economic policy or climate change. Now, of course, we don’t have the time to evaluate all the evidence for most claims. However, we can evaluate some of the evidence, and we can use strategies that lead us attaining a reliable confidence interval for claims. For climate change, do we need to evaluate all the evidence used to come to the conclusion that there is climate change? Almost certainly not, because how likely is it that an entire field of experts would falsify the data? How likely is it that they’re interpreting the data incorrectly, where you, a non-expert, would? How likely is it that they would falsify data given that someone could make their career out of that kind of fraud? And so on.
For economic policy, it’s the same. How likely is it that the consensus in macroeconomics is wrong regarding the debt crisis, for example? Politicians and fringe economists disagree with the macroeconomic consensus, are they likely to be right? Probably not, but is there a chance they’re right? Yes, but why should we assume they’re right? Oh, they have what appears to be a sound argument. But, wait, I have unknown unknowns (i.e., I can’t know the depths of my ignorance) regarding macroeconomics. While their argument appears valid, how do I know there isn’t some knowledge in the possession of popular macroeconomics showing one of the opposing premises is false? I don’t unless I’ve studied the relevant information to a sufficient degree. In which case, I’m most likely to be on the correct side if I default with the expert consensus.
Now, this is all lovely and nice, but it only applies to The Big Things. And it’s just a rule of thumb. It’s deontological. It’s a guideline. But what if your friend thinks it’s a good idea to stop eating apples because for the last month every person he’s seen eating apples has gotten sick? Something about this feels wrong, but this isn’t something you’ll find an answer to by perusing the skeptical community. However, I admit, you will probably find the answer by asking. But, remember, this is an example. Reality can generate significantly more subtle situations than anything my imagination can come up with. So, here, a heuristic won’t work. You need to understand how to actually evaluate a claim, and in some situations you won’t be able to rely on the community for that ability. So, you have to be taught the post hoc ergo propter hoc fallacy. Great, now you can spot this fallacy when you feel something about a claim is wrong. I mean, you’re not applying this ability with claims that sound right, are you? E.g., people that become skeptics are generally smarter than others. Now, if you know anything about cognitive biases, you know how horrifying the qualifier “when you feel” is. That qualifier means you’ve activated your ability for pattern matching, and when a human wants to see a pattern, by God, they will see it.
So, now, we’re in a situation where a skeptic sees a fallacy in their friend’s line of reasoning. They’ve committed the post hoc ergo propter hoc fallacy! Except the skeptic wanted to see this because he felt something was wrong with the claim (it went against some preconceived beliefs! he’s eaten apples all his life without getting sick!) and so he found it. If he had noticed that he was being influenced by his own bias—i.e., he wanted to confirm his preconceived beliefs—he might have not been so quick. He might have asked for more information, and he might have tried to understand the non-skeptic’s position better. He also might have found that non-skeptic actually had multiple reasons for concluding that the apples weren’t safe for eating. Like, for example, his cousin supplies the apples to the market where all his friends bought their apples and subsequently became sick. He knows his cousin has poor hygienic practices, and so he concluded from that premise in combination with the premise that all his friends that became sick eating apples that the apples aren’t safe to eat. Except, he thought the only relevant premise was the one about his friends getting sick, because was the last link in his chain of reasoning preceding his conclusion.
Now, if this skeptic were never able to communicate with his friend again, he would go on thinking his friend was wrong. And the skeptic would be wrong. Is that rational? Really, all a rational person could say is that “given what I know about these apples, I don’t see any reason for them being unsafe to eat.” The post hoc ergo propter hoc fallacy shouldn’t come into play until you can verify that there are no unknown unknowns. But this isn’t taught in the skeptic movement, and this is just a scintilla of the kind of prerequisite knowledge you need to be a rational thinker.
Now, you might be thinking, “what the hell does he mean it isn’t taught? We don’t have classrooms for skepticism.” I mean, to be a skeptic, you’re generally expected to know a few things. You’re expected to trust science. I.e., to apply that heuristic I described earlier. You’re also expected to know some logical fallacies—like the one that led to the wrong conclusion. The community kind of applies a peer pressure to those within it to know these things. It’s like being a photographer. If you’re around a bunch of photographers, they’re not going to think to explain forced perspective to you when they bring it up in conversation. There’s a tacit understanding that to be a photographer means to know these kinds of things.
I’ve basically outlined two problems with the skeptic movement: the societal structure and the pedagogy. I’ll discuss how I think these problems can be fixed in future posts.