A/B TestingEasy

Why does randomization matter in an A/B test?

Seen at: Meta · Uber · Netflix

A PM suggests splitting users by 'first 50% of user IDs to control, last 50% to treatment.' What's wrong with that?

Draft your answer

Saved to this browser only. Try it before you peek at the model answer.

Stuck? Peek at a hint

Reveals the model answer and the self-score rubric.

More a/b testing questions