Quration AIQ

basics

AI companies love bragging about model size using one single giant number, as if bigger numbers alone guaranteed a smarter machine.

When people describe an AI model as having '70 billion parameters,' what are they counting?

The number of adjustable numbers (weights) inside the model
Parameters are the internal weights tuned during training. More generally means more expressive power — though well-trained small models increasingly beat larger ones.

Parameters refer to the number of adjustable numbers, or weights, tuned inside a model during training, not the number of documents it learned from or how many people it can serve at once. Generally speaking, more parameters mean more capacity for a model to represent complex patterns, since there are simply more internal values that can be adjusted to capture nuance in the data.

The number of training documents describes the size of the dataset a model learned from, and the number of simultaneous users describes something about server infrastructure and demand, both very different concepts from the count of adjustable weights baked into the model itself.

Bigger is not automatically better, since well-trained smaller models have increasingly matched or beaten larger ones on many tasks, showing that how a model is trained and what data it sees can matter just as much as raw parameter count.

▶ Quration AIQ

basics

What is this phenomenon called?What was it called?What is this human-feedback training step called?What is this limit called?Llama, the flagship of 'open-weight' models anyone can download and run on their own servers, was released by which company?What do we call models that handle multiple forms of input and output?What are these 'reasoning models' doing during that pause?What's this approach called?What is it?What's one of the industry's main responses?What is this empirical rule — the justification for billion-dollar bets — called?What's the acronym for the goal beyond task-specific AI — machine intelligence as general as a human's?

Quration — Quration AIQ