§ Topic
evaluation
2 posts tagged evaluation.
July 31, 2026 · 6 min read
A gateway is a control point, not a proof
Reading the docs for Google's Agent Gateway. Some of what it enforces is a genuine invariant. Some of it is a language model grading another language model, which the docs are refreshingly honest about.
June 18, 2026 · 4 min read
Fine-tuning for COBOL, and the harness that measures it
A 0.5B model for COBOL system understanding is the easy half. The hard half is knowing whether it got better — which means fixing the benchmark first.