A/B TestingMedium
How do you detect and control for the novelty effect?
Seen at: Meta · Uber · Airbnb
You launched a new UI and users are clicking it at a much higher rate than the old one. Your PM wants to ship. How do you figure out if the lift is real or just novelty?
Draft your answer
Saved to this browser only. Try it before you peek at the model answer.
Stuck? Peek at a hint
Reveals the model answer and the self-score rubric.