✨ Generative AI
Tokens — How AI Reads Text
AI models don't read words — they read tokens. A token is roughly 4 characters or ¾ of a word. 'Hello world' is about 2 tokens. Why does it matter? Because AI models have a context window — a maximum number of tokens they can process at once. Understanding tokens helps you write better prompts!
3 min 10 XP Lesson 1 of 7

AI models don't read words — they read tokens. A token is roughly 4 characters or ¾ of a word. 'Hello world' is about 2 tokens. Why does it matter? Because AI models have a context window — a maximum number of tokens they can process at once. Understanding tokens helps you write better prompts!
Quick Quiz
What is a token?