Archives
All the articles I've archived.
A confidence score is not a reason
45 min readAn extraction confidence is not an adverse-action reason. Document Intelligence returns two scores, and the gate reads the wrong one.
The permission model was built for people holding jobs
52 min readAn HCM grants permissions to people holding jobs, and an agent is neither. Least privilege with no native expression, and the primitive that just shipped.
Nobody owns the join between two agent platforms
40 min readFour vendor agent platforms in one mesh, each sound alone. The seven joins that failed, starting with three catalogs where the loosest one decides.
The LLM judge is a model too
32 min readThe judge is a model too, with the same length, position and self-preference biases. Measuring it, versioning it, and knowing when not to use one.
Containment is measured on the calls that never needed you
36 min readContainment counts the sessions that never needed you. A booking agent's rollback is a refund, and a surge multiple is a scalar over a rotating mixture.
Throughput per dollar, once the traffic is bursty
23 min readOne roofline number sets the speculative-decoding gate, the batch-size knee and the chunked-prefill floor. Why max-num-seqs is a latency control.
Validating a system that never returns the same answer twice
27 min readValidating a system that never returns the same answer twice: what qualification becomes when the output is distributional, and where sampling breaks.
The guarantee is marginal and the audit is not
47 min readA conformal coverage guarantee is marginal, not conditional, so it can hold overall and fail on exactly the subgroup your fairness audit is about.
The wall an 8B model hits on a mid-tier Android phone
32 min readAn 8B model on a $250 Android phone hits a bandwidth ceiling, a residency ceiling and a thermal ceiling, in that order, and dies mid-sentence.
Tail sampling has three ways to lose the trace you wanted
24 min readTail sampling fixes head sampling and adds three quieter ways to lose the same traces, none visible in the config and none logged as an error.
Model Armor and DLP have to get through the perimeter too
32 min readThe content screens you put inline are themselves services behind the same wall. The endpoint Model Armor needs, and the field that says a screen ran.
Who runs the OAuth flow decides your network topology
24 min readWho runs the OAuth flow decides your network topology. Token exchange across agent hops, and why an act claim records who acted but never when.
The handoff is the part nobody writes down
22 min readLeaving a fleet of LLM agents a client's own team can run: discovery by directory, scorecards a stranger can read, runbooks drilled against real failures.
Faithful to the wrong version
26 min readOn a versioned corpus, faithfulness metrics pass an answer grounded in a revision retired months ago. Treating the corpus as bitemporal is what fixes it.
Text-to-SQL that can't leak data it shouldn't
25 min readThe seam between what a model may see and what it may run, enforced by different systems owned by different teams, and the error message as a leak channel.