Is your experiment's split even trustworthy?

Multiple testingHard

Problem. An experiment reports a win on one of many metrics. Before you believe it, what quality checks does Snap's metric discipline (STOMP) demand — and how do you avoid a false win from testing many metrics?

Before you reveal: say your answer out loud, as if you were in the real interview — get your reasoning across clearly first. There is no single correct answer: reading what the interviewer is really after and defending your own thinking is what makes an answer strong.