“The Baloney Detection Kit”
by Maria Popova
"The “Baloney Detection Kit” from the Richard Dawkins Foundation for Reason and Science and Skeptic Magazine editor Michael Shermer is a 10-point checklist for assessing the believability of a claim, covering everything from telling the difference between science (e.g., SETI) and pseudoscience (e.g., UFOlogy) to detecting personal agendas.
"You want to have a mind that’s open enough to accept radical new ideas, but not so open that your brains fall out.”
The above sentiment in particular echoes this beautiful definition of science as “systematic wonder” driven by an osmosis of empirical rigor and imaginative whimsy.
The complete checklist:
1. How reliable is the source of the claim?
2. Does the source make similar claims?
3. Have the claims been verified by somebody else?
4. Does this fit with the way the world works?
5. Has anyone tried to disprove the claim?
6. Where does the preponderance of evidence point?
7. Is the claimant playing by the rules of science?
8. Is the claimant providing positive evidence?
9. Does the new theory account for as many phenomena as the old theory?
10. Are personal beliefs driving the claim?"
○“It seems to me what is called for is an exquisite balance between two conflicting needs: the most skeptical scrutiny of all hypotheses that are served up to us and at the same time a great openness to new ideas. Obviously those two modes of thought are in some tension. But if you are able to exercise only one of these modes, whichever one it is, you’re in deep trouble.
If you are only skeptical, then no new ideas make it through to you. You never learn anything new. You become a crotchety old person convinced that nonsense is ruling the world. (There is, of course, much data to support you.) But every now and then, maybe once in a hundred cases, a new idea turns out to be on the mark, valid and wonderful. If you are too much in the habit of being skeptical about everything, you are going to miss or resent it, and either way you will be standing in the way of understanding and progress.
On the other hand, if you are open to the point of gullibility and have not an ounce of skeptical sense in you, then you cannot distinguish the useful as from the worthless ones. If all ideas have equal validity then you are lost, because then, it seems to me, no ideas have any validity at all.
Some ideas are better than others. The machinery for distinguishing them is an essential tool in dealing with the world and especially in dealing with the future. And it is precisely the mix of these two modes of thought that is central to the success of science.”