Nov 10, 2026
The test name was the spec
A 12B local model could not learn a rule from a test's expected values in seven tries. Renaming one test to state the rule fixed it three times out of three. What that says about the AGENTS.md debate, and about what your tests are actually telling a model.
- LLM Evaluation
- Evaluation Design