---
title: "All notes"
url: https://aimodelscompare.com/notes/
description: "The complete index of working notes on comparing language models, newest first."
---

# All notes

Notes

Every note in the river, newest first, grouped by publishing day.

MONDAY 17 AUGUST 2026

- 17 AUG 2026 · 09:20 · EVALUATION[How to compare two language models without fooling yourself](https://aimodelscompare.com/notes/how-to-compare-language-models/)

- 17 AUG 2026 · 08:05 · CONTEXT[Token counts are not word counts](https://aimodelscompare.com/notes/token-counts-are-not-word-counts/)

FRIDAY 14 AUGUST 2026

- 14 AUG 2026 · 16:40 · BENCHMARKS[What a published benchmark score leaves out](https://aimodelscompare.com/notes/reading-a-benchmark-score/)

- 14 AUG 2026 · 11:15 · BENCHMARKS[A tie is a result, not a failed test](https://aimodelscompare.com/notes/a-tie-is-a-result/)

- 14 AUG 2026 · 09:00 · EVALUATION[Building an evaluation set from fifty examples you care about](https://aimodelscompare.com/notes/building-your-own-evaluation-set/)

TUESDAY 11 AUGUST 2026

- 11 AUG 2026 · 15:30 · CONTEXT[Context windows: capacity is not attention](https://aimodelscompare.com/notes/context-windows-explained/)

- 11 AUG 2026 · 10:10 · PROMPTING[Sampling temperature changes what you are measuring](https://aimodelscompare.com/notes/prompt-sensitivity-and-variance/)

THURSDAY 6 AUGUST 2026

- 6 AUG 2026 · 14:25 · COST & LATENCY[Latency, throughput and cost move in different directions](https://aimodelscompare.com/notes/latency-throughput-and-cost/)

- 6 AUG 2026 · 11:40 · COST & LATENCY[Cached prompts distort a latency comparison](https://aimodelscompare.com/notes/cached-prompts-and-latency/)

- 6 AUG 2026 · 09:45 · DEPLOYMENT[What changes when the weights are on your own machine](https://aimodelscompare.com/notes/open-weight-and-hosted-models/)