Your prototype risk model blocks payments. Set the threshold and measure it.

Experiment designHard

Problem. A prototype lets AI shopping agents pay businesses on a buyer's behalf. The team trained a risk model that scores each agent payment, and payments above a threshold get blocked. You're asked to choose the threshold, and then to show it's working once it's live. How would you do both?

Before you reveal: say your answer out loud, as if you were in the real interview — get your reasoning across clearly first. There is no single correct answer: reading what the interviewer is really after and defending your own thinking is what makes an answer strong.