The Double-Blind Control Experiment and Scientific Thinking
by, 08-05-2012 at 06:51 AM (1400 Views)
Edge.org[/URL], the website of the science and technology think thank [URL="http://en.wikipedia.org/wiki/Edge.org"]Edge Foundation[/URL], has a great collection of answers from various experts to their "[URL="http://www.edge.org/q2011/q11_index.html"]Edge Question 2011[/URL]", "What Scientific Concept Would Improve Everybody's Cognitive Toolkit?"[/LEFT]
[COLOR=#000000][FONT=Verdana][/FONT][/COLOR][COLOR=#000000][FONT=Verdana]Among them is [URL="http://www.edge.org/q2011/q11_17.html#dawkins"]this great contribution[/URL] from Richard Dawkins that I think applies extremely well to the audiophile world:
[B]The Double-Blind Control Experiment[/B][/FONT][/COLOR]
Not all concepts wielded by professional scientists would improve everybody's cognitive toolkit. We are here not looking for tools with which research scientists might benefit their science. We are looking for tools to help non-scientists understand science better, and equip them to make better judgments throughout their lives.[/FONT][/COLOR]
Why do half of all Americans believe in ghosts, three quarters believe in angels, a third believe in astrology, three quarters believe in Hell? Why do a quarter of all Americans and believe that the President of the United States was born outside the country and is therefore ineligible to be President? Why do more than 40 percent of Americans think the universe began after the domestication of the dog?[/FONT][/COLOR]
Let's not give the defeatist answer and blame it all on stupidity. That's probably part of the story, but let's be optimistic and concentrate on something remediable: lack of training in how to think critically, and how to discount personal opinion, prejudice and anecdote, in favour of evidence. I believe that the double-blind control experiment does double duty. It is more than just an excellent research tool. It also has educational, didactic value in teaching people how to think critically. My thesis is that you needn't actually do double-blind control experiments in order to experience an improvement in your cognitive toolkit. You only need to understand the principle, grasp why it is necessary, and revel in its elegance.[/FONT][/COLOR]
If all schools taught their pupils how to do a double-blind control experiment, our cognitive toolkits would be improved in the following ways:[/FONT][/COLOR]
1. We would learn not to generalise from anecdotes.
2. We would learn how to assess the likelihood that an apparently important effect might have happened by chance alone.
3. We would learn how extremely difficult it is to eliminate subjective bias, and that subjective bias does not imply dishonesty or venality of any kind. This lesson goes deeper. It has the salutary effect of undermining respect for authority, and respect for personal opinion.
4. We would learn not to be seduced by homeopaths and other quacks and charlatans, who would consequently be put out of business.
5. We would learn critical and sceptical habits of thought more generally, which not only would improve our cognitive toolkit but might save the world.