The save lift is fading over the days-in window — real or novelty?

Novelty & durationHard

Problem. A Homefeed change showed a +7% save lift on day one, but on the platform's "days-in" view the daily lift has been sliding all two weeks. Is the effect real, and how do you report it?

Before you reveal: say your answer out loud, as if you were in the real interview — get your reasoning across clearly first. There is no single correct answer: reading what the interviewer is really after and defending your own thinking is what makes an answer strong.

← The group-allocation check flags your experiment — now what?You sliced 20 cohorts and one is significant — do you believe it? →