How Not To Run an A/B Test

Evan Millerevanmiller.orgWritten April 2010Saved October 12, 20267 min read

• product
• thinking

Miller argues that peeking at A/B test results and stopping once they look significant inflates false positives, so sample size must be fixed in advance.

Another oneWhy vanity metrics are dangerous →