The concept of statistical significance is central to planning, executing and evaluating A/B (and multivariate) tests, but at the same time it is the most misunderstood and misused statistical tool in internet marketing, conversion optimization, landing page optimization, and user testing.| Blog for Web Analytics, Statistics and Data-Driven Internet Marketing | Analy...
The one-stop-shop for statistical planning and analysis of online A/B tests. Analytics Toolkit's advanced A/B test statistical calculator enable your A/B testing program to reach new levels of statistical rigor and efficiency. Plan and analyze A/B tests with ease and get results you can trust.| www.analytics-toolkit.com
One topic has surfaced in my ten years of developing statistical tools, consulting, and participating in discussions and conversations with CRO & A/B testing practitioners as causing the most confusion and that is statistical power and the related concept of minimum detectable effect (MDE). Some myths were previously dispelled in “Underpowered A/B tests – confusions, myths, and reality”, “A comprehensive guide to observed power (post hoc power)”, and other works. Yet others remain.| Blog for Web Analytics, Statistics and Data-Driven Internet Marketing | Analy...