A/B TestingVery Hard

Why run a long-term holdout, and what does it measure that short A/B tests miss?

Seen at: Meta · Netflix · Airbnb

Your team ships features based on 2-week A/B tests. A skeptic says: 'the true effect of all these changes, measured over a year, might be zero.' How do you address that?

Draft your answer

Saved to this browser only. Try it before you peek at the model answer.

Reveals the model answer and the self-score rubric.

More a/b testing questions