Primary up, guardrail down, CTR up but clicks down — ship?
Decide from resultsMediumProblem. A commerce experiment finishes. The primary metric (payment-success) is +0.4pp, p = 0.03. A guardrail (voluntary churn) is +0.2pp, p = 0.06. A secondary signal: upsell click-through rate is up, but total upsell clicks are down. The PM wants to ship Friday. What's your call?
Before you reveal: say your answer out loud, as if you were in the real interview — get your reasoning across clearly first. There is no single correct answer: reading what the interviewer is really after and defending your own thinking is what makes an answer strong.