DEV Community

Ruxo Zheng
Ruxo Zheng

Posted on

p-value

Just recently understood p-value... I’ve seen many papers mention this value, but I didn’t really know what it meant.

The p-value is the probability of getting the observed experimental results assuming that our hypothesis is not true or has no effect.

For example, if we say that watering plant X every morning makes it grow 20% faster compared to watering it at other times of the day:

If the p-value is high, it means there's a high chance that plant X could grow 20% without us watering it in the morning (suggesting that our hypothesis might not be true).

For instance, if the p-value is 0.1 or 10%, it means there’s a 10% chance that the plant will grow 20% without being watered in the morning.

On Brilliant.org, it explains that the issue with p-values is that they represent confidence in a single experiment only. In practice, a good experiment should be independently replicated and consistently yield significant results. (In Bayesian terms, this means that confidence in the experimental results multiplies with each successful replication.)

The bottom line is... trusting a single paper isn’t very reliable.

Image of Timescale

🚀 pgai Vectorizer: SQLAlchemy and LiteLLM Make Vector Search Simple

We built pgai Vectorizer to simplify embedding management for AI applications—without needing a separate database or complex infrastructure. Since launch, developers have created over 3,000 vectorizers on Timescale Cloud, with many more self-hosted.

Read more →

Top comments (0)

Sentry image

See why 4M developers consider Sentry, “not bad.”

Fixing code doesn’t have to be the worst part of your day. Learn how Sentry can help.

Learn more

👋 Kindness is contagious

Please leave a ❤️ or a friendly comment on this post if you found it helpful!

Okay