A/B TestingHard
Conversion +3%, revenue per visitor −1%. Do you ship?
Seen at: Airbnb · Stripe · DoorDash
Your A/B test shows conversion rate +3% (p = 0.01), but revenue per visitor is −1% (p = 0.04). Both are statistically significant. The PM wants to ship. What's your recommendation?
Draft your answer
Saved to this browser only. Try it before you peek at the model answer.
Reveals the model answer and the self-score rubric.