Before we got distracted by things like being sued, we had been working on a series called Meaningless Means, which exposed the fact that meta-analytic averaging is (really) bad. When a meta-analysis says something like, “The average effect of mindsets on academic performance is d = .32”, you should not take it at face value.... The post [127] Meaningless Means #4: Correcting Scientific Misinformation appeared first on Data Colada.| Data Colada
This is the third post in a series (.htm) in which we argue/show that meta-analytic means are often meaningless, because they often (1) include invalid tests of the hypothesis of interest to the meta-analyst and (2) combine incommensurate results. The meta-analysis we discuss here explores how dishonesty differs across four different experimental paradigms (e.g., coin... The post [107] Meaningless Means #3: The Truth About Lies appeared first on Data Colada.| Data Colada
This post is the second in a series (.htm) in which we argue that meta-analytic means are often meaningless, because these averages (1) include invalid tests of the meta-analytic research question, and (2) aggregate incommensurable results. In each post we showcase examples of (1) and (2) in a different published meta-analysis. We seek out meta-analyses... The post [106] Meaningless Means #2: The Average Effect of Nudging in Academic Publications is 8.7% appeared first on Data Colada.| Data Colada
This post is the second in a series (see its introduction: htm) arguing that meta-analytic means are often meaningless, because (1) they include results from invalid tests of the research question of interest to the meta-analyst, and (2) they average across fundamentally incommensurable results. In this post we focus primarily on problem (2), though problem... The post [105] Meaningless Means #1: The Average Effect<BR> of Nudging Is d = .43 appeared first on Data Colada.| Data Colada
This post is an introduction to a series of posts about meta-analysis [1]. We think that many, perhaps most, meta-analyses in the behavioral sciences are invalid. In this introductory post, we make that case with arguments. In subsequent posts, we will make that case by presenting examples taken from published meta-analyses. We have recently written... The post [104] Meaningless Means: Some Fundamental Problems With Meta-Analytic Averages appeared first on Data Colada.| Data Colada
How long does a typical A/B test run for? What percentage of A/B tests result in a ‘winner’? What is the average lift achieved in online controlled experiments? How good are top conversion rate optimization specialists at coming up with impactful interventions for websites and mobile apps?| Blog for Web Analytics, Statistics and Data-Driven Internet Marketing | Analy...