What is a p-value? An expert explains the most misunderstood number in science

The p-value is one of science's most misunderstood numbers. According to The Conversation, it measures the statistical significance of an experiment and determines whether researchers can say they've found something real. But here's the catch: a p-value doesn't mean what most people think. If a study produces p equals zero point zero five, it means that if there were genuinely no real effect, you'd see a result this extreme about five percent of the time purely by chance. It does NOT mean there's a five percent chance your result was a fluke. The conventional threshold of zero point zero five comes from nowhere particular—British statistician Ronald Fisher suggested it in the nineteen twenties as a rule of thumb, and it stuck. This creates absurd outcomes: a result at p equals zero point zero four nine is a discovery, while p equals zero point zero five one means nothing happened. Researchers often confuse "statistically significant" with "large or important." A drug raising IQ by half a point might be highly significant statistically yet meaningless in practice. Adding effect size and confidence intervals to the conversation could help. Some scientists have called for retiring p-values altogether, but others argue they still offer something useful: a way to measure how unusual your result would be if nothing real were going on.

Listen to this story

Hear this and more stories in a personalized audio briefing.

Open The Chonkerton