Ship on a significant result

Ship on a significant result

Airbnb A/B Testing Interview Question

An A/B test on Airbnb's checkout flow shows a 3% lift in conversion with p = 0.04. The PM wants to ship it today. What do you check before agreeing?

Asked of

  • Data Scientist
  • Product Analyst
  • Data Analyst

Similar questions