A model never sees words, only tokens, which is why it miscounts letters, why context has a size and why usage is billed as it is.
Reason about a model in tokens: that is what it reads, what fills its window and what you pay for.
Explaining how a language model works, estimating the cost of an AI feature, and debugging a model that fails at a character-level task.
From Most Devs Don’t Understand How LLM Tokens Work · Matt Pocock
A compute vendor's case is a flywheel from agents to tokens to compute; the buyer's case is the return on that compute, and both have to be read together.
Semiconductor and data-centre coverage, technology investing, and any debate about AI capital spending.
From NVIDIA's fiscal 2026 letter from Jensen Huang · Jensen Huang
A long window degrades before it fills; curate and order what goes in rather than relying on size.
Designing any system that feeds documents to a model, and explaining why a model missed something that was in its context.
From Why LLMs Get Dumb (Context Windows Explained) · NetworkChuck