Context window
Context window: The maximum number of tokens a model can consider at once across instructions, context and output. A larger window supports longer documents and conversations but increases memory and compute and does not guarantee use of every detail. Summarization, retrieval and context ordering remain important.
In italiano: Context WindowLegge III · Come una rete impara dai datiA larger window supports longer documents and conversations but increases memory and compute and does not guarantee use of every detail. Summarization, retrieval and context ordering remain important.
Examples
- Documents and answer sharing one prompt window
- Summarizing earlier messages
- Selecting the most relevant chunks