Estimating Total Experimentation Impact

How to control for false-discovery and selection biases when measuring your organization’s total impact

Jared M. Maruskin, PhD
Towards Data Science
16 min readSep 20, 2023

--

Photo by CHUTTERSNAP on Unsplash

Introduction

Data-driven organizations often run hundreds or thousands of experiments at any given time, but what is the net impact of all of these experiments? A naive approach is to sum the…

--

--