Transformer

The infographic shows the right big shape: an LLM receives text, turns it into tokens, maps those tokens into vectors, runs transformer blocks, projects the fin…

You have probably seen a claim shaped like this on a model card: "70B total parameters, but only 13B active per token." That is not marketing rounding — it desc…

Transformers are often described as if they are a mysterious reasoning machine. At the mechanical level, they are a repeated pattern: turn tokens into vectors, …