Legacy statistics methodology - Docs - PostHog
posthog.com · 769 words · saved by 1 readers
Note: This document describes methodology used to evaluate experiments created prior to January 2025. Check out our statistics overview for an…
Legacy statistics methodology Contents Bayesian experimentation Funnel experiment calculations 1. Probability of being the best 2. Statistical significance Trend experiment calculations 1. Probability of being the best 2. Statistical significance How does PostHog determine final significance? Note: This document describes methodology used to evaluate experiments created prior to January 2025. Check out our statistics overview for an introduction to our updated methodology. Bayesian experimentation In the field of experimentation, there are two primary statistical approaches: frequentist and Ba
related reading
- Bayesian statistics - Docs - PostHogposthog.com
- Statsig | The modern product development platformstatsig.com
- How much do you believe your results? — LessWronglesswrong.com
- Running time and sample size - Docs - PostHogposthog.com
- Against NHST — LessWronglesswrong.com
- How to Measure Anything — LessWronglesswrong.com
- abtest.designabtest.design
- Writing - betanalpha.github.iobetanalpha.github.io
- What The Heck is... A Business Experiment?linkedin.com
- How Should We Critique Research? · Gwern.netgwern.net
- Bayesian Mindsetcold-takes.com
- A/B testing mistakes I learned the hard way - PostHogposthog.com