The context window

Everything the model knows at answer time is in the window, and attention across it degrades before the window fills.

• Artificial intelligence

2 ideas that carry it

• TechniqueArtificial intelligenceVideo located

  A prompt is a brief: task, role, background and output format

  Write to a model as you would brief a capable junior: the task, their role, the context they lack, and what the output should look like.

  Using any model on real work, and explaining in an interview how you would get a useful answer from one.

  From Prompting 101 · Anthropic

• FrameworkArtificial intelligenceVideo located

  The context window is not the constraint people think it is; attention across it is

  A long window degrades before it fills; curate and order what goes in rather than relying on size.

  Designing any system that feeds documents to a model, and explaining why a model missed something that was in its context.

  From Why LLMs Get Dumb (Context Windows Explained) · NetworkChuck