🇬🇧 Limited Time — UK Only·🎓 Free Learning for 1 Month·🤖 Free AI Training Included·📚 4,000+ Lessons · 35,000+ Quizzes·🏆 GCSE Mocks · Olympiad Papers·⚡ Selected Students Only · Limited Places·🎁 Free Value Worth £2,000·🇬🇧 Limited Time — UK Only·🎓 Free Learning for 1 Month·🤖 Free AI Training Included·📚 4,000+ Lessons · 35,000+ Quizzes·🏆 GCSE Mocks · Olympiad Papers·⚡ Selected Students Only · Limited Places·🎁 Free Value Worth £2,000·🇬🇧 Limited Time — UK Only·🎓 Free Learning for 1 Month·🤖 Free AI Training Included·📚 4,000+ Lessons · 35,000+ Quizzes·🏆 GCSE Mocks · Olympiad Papers·⚡ Selected Students Only · Limited Places·🎁 Free Value Worth £2,000·
Generative AI

Tokens — How AI Reads Text

AI models don't read words — they read tokens. A token is roughly 4 characters or ¾ of a word. 'Hello world' is about 2 tokens. Why does it matter? Because AI models have a context window — a maximum number of tokens they can process at once. Understanding tokens helps you write better prompts!

3 min 10 XP Lesson 1 of 7
Tokens — How AI Reads Text

AI models don't read words — they read tokens. A token is roughly 4 characters or ¾ of a word. 'Hello world' is about 2 tokens. Why does it matter? Because AI models have a context window — a maximum number of tokens they can process at once. Understanding tokens helps you write better prompts!

Quick Quiz

1 / 2

What is a token?