Quration AIQ

basics

Language models like ChatGPT don't read sentences whole — they chop text into small pieces, and Korean breaks into noticeably more of them than English.

What are these pieces called?

Tokens
LLMs process text as tokens. Korean tends to use more tokens than English for the same meaning, which puts it at a disadvantage in API pricing and context limits.
▶ Quration AIQ

basics

When people describe an AI model as having '70 billion parameters,' what are they counting?What is this phenomenon called?What was it called?What is this human-feedback training step called?What is this limit called?Llama, the flagship of 'open-weight' models anyone can download and run on their own servers, was released by which company?What do we call models that handle multiple forms of input and output?What are these 'reasoning models' doing during that pause?What's this approach called?What is it?What's one of the industry's main responses?What is this empirical rule — the justification for billion-dollar bets — called?

Quration — Quration AIQ