attention_explained
// How words "pay attention" to each other — click any word to see what it focuses on
Click any word to see how it attends to others
SENTENCE — click any word
ATTENTION MAP — darker = more attention
High attention Medium attention Low attention
What is Attention?
Attention is how an AI model figures out which words are most important when reading a sentence. When you read "The animal didn't cross the street because it was too tired" — you know "it" refers to "animal", not "street". Attention lets the AI make that same connection automatically.
also by echobash