Traps & Trick QuestionsMedium
What does a p-value of 0.03 actually mean?
Seen at: Meta · Airbnb · Netflix
Your A/B test returns p = 0.03 for a conversion lift. A PM asks: “So there’s a 97% chance this change works, right?” How do you respond?
Draft your answer
Saved to this browser only. Try it before you peek at the model answer.
Stuck? Peek at a hint
Reveals the model answer and the self-score rubric.