A/B TestingEasy
The PM sees a 0.04 p-value. Should they ship?
Seen at: Meta · Airbnb · Netflix
Your PM checks an A/B test that's been running for two weeks, sees a p-value of 0.04 and a 0.3% lift in conversion, and wants to ship. What questions do you ask before signing off?
Draft your answer
Saved to this browser only. Try it before you peek at the model answer.
Stuck? Peek at a hint
Reveals the model answer and the self-score rubric.