Context window

Also: context length · token limit

The context window is the maximum number of tokens a model can attend to at once, spanning both the prompt and the generated output. Larger context enables bigger documents and longer histories but consumes more memory and can raise latency and cost, so it is a real trade-off rather than a free upgrade.

← All terms · Definitions maintained by Mintok. Methodology.