Customers miss fraud in their labels. Estimate true recall.
Metric designHardProblem. A lender's dashboard shows Protect's recall at 57%: of 700 frauds last quarter, 400 were caught by Protect and 300 got through. But the 300 are only the frauds the lender labeled, and their labeling misses some fraud, especially first-party fraud written off as bad debt. How would you estimate Protect's true recall?
Before you reveal: say your answer out loud, as if you were in the real interview — get your reasoning across clearly first. There is no single correct answer: reading what the interviewer is really after and defending your own thinking is what makes an answer strong.