What is a context window?
A context window is the maximum amount of text an AI model can take into account at once, measured in tokens. It works like the model's working memory: your instructions, any documents you share, the conversation so far and the model's reply all have to fit inside it.
Every LLM has a fixed context window, and anything beyond it is either cut off or never seen. The window is counted in tokens, which are chunks of text; in English a token averages roughly three quarters of a word. This explains a lot of everyday AI frustrations, like an assistant forgetting instructions from early in a long chat or missing a clause in a long contract. Windows have grown dramatically, and many current models can hold the equivalent of several books, but bigger isn't automatically better. Models tend to pay less attention to material buried in the middle of a very long context, and every token sent costs time and money on each request.
That's why well-built AI systems curate what goes into the window. RAG (retrieval-augmented generation) searches your documents and passes the model only the passages relevant to the question, and long conversations are often summarised so the key points stay in view. Deciding what the model sees, and in what order, is a large part of the custom AI tools we build.
For example, a Brisbane law firm might want an assistant that answers questions about its 2,000 past matters. Pasting every file into one chat would overflow even a large window and produce vague answers. A better design retrieves the five most relevant matters for each question and gives the model those with clear instructions, which keeps answers accurate and the cost per question low.
Related questions
How big is a 200K context window?
A 200K context window holds about 200,000 tokens, which is roughly 150,000 English words, or around 500 pages of a typical book. That's enough for a long report, a full contract bundle or a medium-sized codebase in one go. The exact amount varies with the language and the model's tokeniser.
What is a ChatGPT context window?
ChatGPT's context window is the amount of conversation and uploaded material it can consider at once in a chat. The size depends on the model and the plan you're using, and OpenAI has increased it several times. When a conversation grows beyond it, the earliest parts drop out of view, which is why long chats can lose track of early instructions.
What is a context window in simple terms?
In simple terms, a context window is how much an AI can read and remember at one time. Think of it as a desk: everything the AI needs for the current task has to fit on the desk, and when it's full, older papers fall off the edge. Anything not on the desk, the AI can't use.
What does a 1 million token context window mean?
A 1 million token context window means the model can take in about a million tokens at once, roughly 750,000 English words, or several thick novels. Several AI providers now offer windows of this size on some models. In practice, very long inputs are slower and more expensive, and accuracy on details deep inside them can drop.
How many tokens is 32K context?
A 32K context is usually 32,768 tokens, because model limits are often set as powers of two, though some providers round it to 32,000. That's about 24,000 English words, or around 50 to 60 pages of text. It covers the prompt, any documents and the model's response combined.
Why is the AI context window so small?
Context windows are limited because the computing power and memory a model needs grow quickly as the input gets longer, which makes long contexts slower and more expensive to run. Models are also trained on inputs up to a certain length and become less reliable beyond it. Windows have grown a lot in recent years, so a limit that felt small in older tools may no longer apply to current models.

