Everything You Know Is Wrong

Well not everything. But more than quite a lot. Eric at Classical Values was discussing that with respect to advertising and fads. Including medical and scientific fads. You know the deal. Trust but verify.

Before seeing Eric's post I came across Why Most Published Research Findings Are False.

Summary

There is increasing concern that most current published research findings are false. The probability that a research claim is true may depend on study power and bias, the number of other studies on the same question, and, importantly, the ratio of true to no relationships among the relationships probed in each scientific field. In this framework, a research finding is less likely to be true when the studies conducted in a field are smaller; when effect sizes are smaller; when there is a greater number and lesser preselection of tested relationships; where there is greater flexibility in designs, definitions, outcomes, and analytical modes; when there is greater financial and other interest and prejudice; and when more teams are involved in a scientific field in chase of statistical significance. Simulations show that for most study designs and settings, it is more likely for a research claim to be false than true. Moreover, for many current scientific fields, claimed research findings may often be simply accurate measures of the prevailing bias. In this essay, I discuss the implications of these problems for the conduct and interpretation of research.

He does discuss it. Several pages worth - with foot notes that include external links.

One point that should be made is that biases are hard to maintain indefinitely. One day you will meet Heidi Cline and it will all be over.

Cross Posted at Power and Control

posted by Simon on 11.26.09 at 03:50 AM





TrackBack

TrackBack URL for this entry:
http://classicalvalues.com/cgi-bin/pings.cgi/9090






Comments

Yet another reason not to subordinate the individual to the prejudices of the intellectuals.

Brett   ·  November 26, 2009 09:57 AM

There is also a bias in favor of novelty. This is overwhelming in areas where there is not an obvious leftward political bias (e.g., diet and nutrition). Are you going to be published if you merely confirm existing knowledge? No. You need newness, you need novelty, you need to say "everything you know is wrong," in order to be published.

Rhodium Heart   ·  November 26, 2009 12:41 PM

Post a comment

You may use basic HTML for formatting.





Remember Me?

(you may use HTML tags for style)


November 2009
Sun Mon Tue Wed Thu Fri Sat
1 2 3 4 5 6 7
8 9 10 11 12 13 14
15 16 17 18 19 20 21
22 23 24 25 26 27 28
29 30          

ANCIENT (AND MODERN)
WORLD-WIDE CALENDAR


Search the Site


E-mail



Classics To Go

Classical Values PDA Link



Archives



Recent Entries



Links



Site Credits