context_window
// How much text an AI can "see" at once โ€” and why it matters
๐Ÿ’ก The core idea: The "context window" is the AI's working memory โ€” everything it can currently see and use. Think of it like a whiteboard. If your conversation gets too long, old messages fall off the whiteboard (the AI forgets them). Context is measured in "tokens" โ€” about ยพ of a word each.
See how context is allocated
SELECT A MODEL
System Prompt
500 tokens
Conversation History
3,000 tokens
Your New Message
500 tokens
CONTEXT WINDOW ALLOCATION
System History Your msg Free
What is a context window?
The context window is the maximum amount of text an AI can read at once โ€” the full conversation, documents you share, and the system prompt all need to fit in this window. 1 token โ‰ˆ 4 characters โ‰ˆ ยพ of an English word. A 128K context window can hold about 100,000 words โ€” roughly 400 pages of text.
1 TOKEN โ‰ˆ ยพ WORD128K TOKENS โ‰ˆ 400 PAGES
also by echobash