explore

Interactive explainers for people who've never looked inside. One idea per piece. Every number on screen comes from a real model.

  1. How a language model picks the next word

    A sentence with a blank at the end, fifty thousand candidates, and the four dials that decide which one you get.

  2. The loop around the model

    Why the chat forgets, what the thinking toggle costs, and the small trick that turned a chatbot into a coding agent.

    not yet
  3. What the bits are

    bf16, fp8, int8, 4-bit. The same model with every weight rounded to a coarser ruler, and what that does to the words.

    not yet

Written by Andrew Marx, built with AI help, and it says so. The models are run offline and their scores are baked in; the math runs in your browser on the real numbers. xram.net