// How an AI language model goes from your message to a response
๐ก The core idea: ChatGPT, Claude, and Gemini all work the same way โ they predict the next word, over and over. You type "The sky is", the AI predicts "blue". Then predicts "and" after that. Then "the". One word at a time, billions of calculations each time. That's it. Click "step" to see exactly how.
Step 0 / 0
Ready โ click "step" to begin
PROMPT
The capital of France is
PROBABILITY DISTRIBUTION (next token)
GENERATED OUTPUT
What is an LLM?
A Large Language Model (LLM) is a neural network trained to predict the next token given previous tokens. It learns patterns from massive text corpora and can generate coherent, contextually relevant text. Click "step" to walk through the forward pass.