AI & Machine Learning

Understand the machines rewriting everything

Novice

Mastery0%

Novice

Note. AI tools change fast and confidently get things wrong. Verify anything high-stakes against primary sources, and never paste secrets/PII into untrusted endpoints.

Concept 02 of 19

settled

Tokens

AI doesn't read letters. It reads chunks of words called tokens.

Definition

Tokens are the sub-word chunks an AI reads and writes. About 4 English characters or 3/4 of a word per token.

Step 1

Predict first

In one or two sentences, what do you think this concept means? Wrong is fine; the small struggle is what makes the answer stick.