Tag: evals

All the articles with the tag "evals".

• The LLM judge is a model too

  16 Jun, 2026·32 min read

  The judge is a model too, with the same length, position and self-preference biases. Measuring it, versioning it, and knowing when not to use one.

• Containment is measured on the calls that never needed you

  9 Jun, 2026·36 min read

  Containment counts the sessions that never needed you. A booking agent's rollback is a refund, and a surge multiple is a scalar over a rotating mixture.

• Faithful to the wrong version

  17 Jun, 2025·26 min read

  On a versioned corpus, faithfulness metrics pass an answer grounded in a revision retired months ago. Treating the corpus as bitemporal is what fixes it.