Evaluating LLM Outputs: Building an Eval Harness That Actually Catches Regressions
"It looked fine when I tried it" is not an evaluation strategy. Here is the harness we run before any prompt or model change ships.
The clever prompt phrase mattered when models were smaller. What actually moves the needle now is what you put in the context window, and what you leave out.
Two years ago, finding the magic phrasing that unlocked a model's best behaviour was a real skill worth a blog post of its own. Modern frontier models are far less sensitive to that kind of incantation — and far more sensitive to what is actually sitting in the context window when they generate. The skill shifted from wordsmithing the instruction to engineering everything around it.
None of this is about finding cleverer words for the system prompt. It is closer to database query optimization than to writing — the question is not "how do I phrase this" but "what is the minimum, highest-signal set of information this call actually needs to succeed."
This does not mean prompts are irrelevant. A clear task instruction, explicit output format, and a couple of well-chosen examples still measurably improve results. It means that effort spent tuning adjectives in a system prompt has a far lower ceiling than effort spent on retrieval quality, and teams that keep optimizing the wrong layer plateau early.
More from the same category.
"It looked fine when I tried it" is not an evaluation strategy. Here is the harness we run before any prompt or model change ships.
The vector database market is crowded and most comparisons focus on benchmark recall numbers that won't matter for your actual traffic.
Most token-cost conversations jump straight to "use a cheaper model." That is the last lever to pull, not the first.
Thirty minutes with the people who would actually do the work — no discovery deck, no account manager.