The group-allocation check flags your experiment — now what?

Decide from resultsMedium

Problem. Your Homefeed experiment was meant to be a 50/50 split, but the platform's group-allocation check (a chi-square test) flags that the arms came out uneven beyond chance. Treatment "won" on saves. Do you trust the result?

Before you reveal: say your answer out loud, as if you were in the real interview — get your reasoning across clearly first. There is no single correct answer: reading what the interviewer is really after and defending your own thinking is what makes an answer strong.

← Which test for a save-count metric, and why is a plain t-test risky?The save lift is fading over the days-in window — real or novelty? →