Changes
The changelog of measured change: an entry exists only when an eval's output moved from one measured value to another — both dated, both backed by evidence. New providers or models joining the sheet don't appear here; a provider's behavior changing does. Providers ship changes silently — this page is where those changes stop being silent.
Lightning · cot-carry: DROPS → CARRIES
Replayed reasoning now reaches the model: the 99-memory-test canary planted in the replayed reasoning field is recalled, where the 2026-07-06 battery measured invention (0/12 across both spellings). what the probe measures →
SambaNova · cot-carry: DROPS → CARRIES
Replayed reasoning now reaches the model, where the 2026-07-06 battery measured a drop. what the probe measures →
DeepInfra · cot-carry: DROPS → CARRIES
Replayed reasoning now reaches the model, where the 2026-07-06 battery measured a drop on both request spellings (0/2 each). what the probe measures →
SambaNova · tool-image: 404 (model delisted) → 500 (deterministic)
The verdict tracks the model listing: while the gemma-4 model id was delisted the probe returned 404; with the id listed again, images in tool results fail with the historic deterministic 500 (7/7 attempts). the finding →