The encyclopedia · R&D & Science · Technical decision · 2005–2020
Why most published research is false — John Ioannidis and the replication crisis
A 2005 paper showed most published research findings are false. The system rewarded positive results, not rigor. The crisis was built into incentives.
Stanford University · 2005-08-30
What happened
John Ioannidis was a Greek-American physician-scientist trained at Harvard and Tufts, with a PhD in biopathology. On August 30, 2005, he published a paper in PLOS Medicine titled 'Why Most Published Research Findings Are False.' It became the most-accessed article in PLOS history, with over 3 million views. Ioannidis argued that a research finding is less likely to be true when studies are small, effect sizes are small, tested relationships are numerous, and financial interests are present.
The paper systematically showed how the scientific method was being undermined by its own incentives. Journals wanted novel positive findings, so researchers produced them — often by p-hacking, selective reporting, and running small underpowered studies. Ioannidis later catalogued 235 biases in biomedical research and found that at least 1 in 6 widely cited health studies were later contradicted. In economics, nearly 80% of reported effects were exaggerated, typically by a factor of two, with one-third inflated by four or more.
The paper made Ioannidis a central figure in the replication crisis that swept through psychology, medicine, economics, and neuroscience. He co-authored the Manifesto for Reproducible Science and co-directed the Meta-Research Innovation Center at Stanford (METRICS). The crisis exposed a system that had been producing false findings for decades — not because of fraud, but because the incentives rewarded the wrong kind of science.
Why it happened
- Academic journals favor novel positive findings, not replications or null results. Researchers respond by producing what journals want — p-hacking, selective reporting, and small studies.
- Statistical power in most published studies is too low to detect claimed effects. A study with 20% power has an 80% chance of missing a real effect — but can still yield a false positive.
- The number of competing teams in a field multiplies the false-positive rate. If 100 teams test the same hypothesis, 5 will find a significant result by chance alone — and those 5 will be published.
- Financial conflicts of interest are pervasive. Industry-funded trials are more likely to report positive results, and the bias is built into the design, not just the reporting.
The lesson
When the system rewards novel positive findings over rigorous methods, false results are inevitable. The crisis was not a failure of individual scientists — it was a failure of the system.
Aftermath
The replication crisis led to major reforms: pre-registration of studies, registered reports (journals accept papers before results are known), data sharing mandates, and replication initiatives. The Reproducibility Project found only 36% of 100 landmark psychology studies could be replicated. Ioannidis became one of the most cited scientists globally, with an h-index of 278. His work reshaped how scientists think about evidence, statistical power, and systemic flaws in research. The crisis continues, but the awareness he sparked changed science permanently.
Sources
- PLOS Medicine — Why Most Published Research Findings Are False (Ioannidis, 30 Aug 2005; the paper itself)
- Wikipedia — John Ioannidis
spotted an error? The club wants to know.
More like this
Viagra: the failed heart drug that became a blockbuster
McBride linked thalidomide to birth defects — then fabricated data to repeat it
Karl Illmensee claimed he cloned mice — and the data was fabricated
Somewhere, someone solved the problem this company failed at. 2nd Opinion →

Comments · 0
Sign in to join the comments.