Das Kontextfenster refers to the range of text that an künstliche Intelligenz (AI) model, particularly in der Verarbeitung natürlicher Sprache (NLP), can consider simultaneously while processing or generating responses. This concept is crucial for understanding how KI-Systemen verstehen und Sprache generieren kann.
In praktischer Hinsicht definiert das Context Window die maximale Anzahl von tokens (words, punctuation marks, and special characters) that the AI can analyze at once. For instance, if an AI model has a context window of 2048 tokens, it will only take into account the most recent 2048 tokens of input when producing an output. Any text that exceeds this limit is effectively ignored, which can affect the coherence and relevance of the AI’s responses.
The size of the context window can significantly influence the performance of the model. A larger context window allows the model to understand broader contexts, maintaining continuity in conversations or complex texts. This is particularly important for tasks that require maintaining context over longer interactions, such as storytelling or technical discussions.
Different AI architectures have varying context window sizes. For example, earlier models like GPT-2 had smaller context windows compared to their successors, such as GPT-3 and GPT-4, which can handle more extensive inputs. Researchers continuously strive to increase this capacity, facilitating more sophisticated Sprachverständnis und Generierung.