A/B TestingVery Hard
Why is a t-test on a ratio metric (like CTR) wrong, and what do you do instead?
Seen at: Meta · Google · Uber · Netflix
You're running an A/B test where the metric is click-through rate per user (clicks ÷ impressions per user). Why is a naive t-test on this ratio wrong, and what's the correct approach?
Draft your answer
Saved to this browser only. Try it before you peek at the model answer.
Reveals the model answer and the self-score rubric.