Most scientific papers are probably wrong

Most published scientific research papers are wrong, according to a new analysis. Assuming that the new paper is itself correct, problems with experimental and statistical methods mean that there is less than a 50% chance that the results of any randomly chosen scientific paper are true.
[…]

Surprisingly, [epidemiologist John] Ioannidis says another predictor of false findings is if a field is “hot”, with many teams feeling pressure to beat the others to statistically significant findings.

But Solomon Snyder, senior editor at the Proceedings of the National Academy of Sciences, and a neuroscientist at Johns Hopkins Medical School in Baltimore, US, says most working scientists understand the limitations of published research.

“When I read the literature, I’m not reading it to find proof like a textbook. I’m reading to get ideas. So even if something is wrong with the paper, if they have the kernel of a novel idea, that’s something to think about,” he says.

Kurt KleinerMost scientific papers are probably wrong (New Scientist)

Post was last modified on 18 Oct 2019 10:12 am

View Comments

  • This is my favorite line: "When I read the literature, I'm not reading it to find proof like a textbook." But I AM looking for that - that's why I read papers in mathematics! All - that's right, all - papers based on population surveys and statistical analysis are potentially faulty! Come to contemporary math (MA105) this semester to learn about statistical variation and sampling problems!

    PS - sorry about the half-comment above this - feel free to delete it.

    [Done! --DGJ]

Share
Published by
Dennis G. Jerz

Recent Posts

Creating textures for background buildings in a medieval theater simulation project. I can always improve this later. #blender3d

Creating textures for background buildings in a medieval theater simulation project. I can always improve…

14 hours ago

Yesterday my stack of unmarked assignments was about 120, so this is not bad.

Nothing in this stack is pressing, but they do include rough drafts of final papers,…

1 day ago

ai, ai, ai: critical thinking and literacy won’t save you

Here’s the underlying problem. We have an operating image of thought, an understanding of what…

2 days ago

Representing the Humanities at Accepted Students Day.

Representing the Humanities at Accepted Students Day.

5 days ago

The daughter opens another show. This weekend only.

The daughter opens another show. This weekend only.

5 days ago

How to Disagree Academically: Using Graham’s “Disagreement Hierarchy” to organize a college term paper.

How to Disagree Academically: Using Graham's "Disagreement Hierarchy" to organize a college term paper.

6 days ago