We spent two months polishing offline evals and still had almost no production traffic.
The breakthrough was a narrow golden set (40 queries), a human weekly review, and a hard latency budget.
Takeaway: ship a constrained RAG loop first, then expand coverage — not the other way around.
Comments (0)
No comments yet.