Success up, ad revenue down, with a novelty curve — ship?
Decide from resultsMediumProblem. An experiment finishes: successful-session rate +0.5pp (p = 0.01), but ad revenue −1.5% (p = 0.04). The success lift was +1.2pp in week 1, decaying to +0.5pp by week 3. The allocation reads 50.8% / 49.2%. The PM wants to ship. What's your call?
Before you reveal: say your answer out loud, as if you were in the real interview — get your reasoning across clearly first. There is no single correct answer: reading what the interviewer is really after and defending your own thinking is what makes an answer strong.