◈ OSKAR LAB / VISUAL EXPERIMENT / 001
VISUAL EXPERIMENT / 001

VISUAL EXPERIMENT / 001

Inside a Language Model

From a message to numbers. From numbers to the next token.

60 seconds inside a transformer
0:00 / 1:00

Camera positions

Space to play / pause · Esc to leave recording mode
Numbers, assumptions & sources

The token counts are illustrative estimates for the visible text, not tokenizer measurements. System prompts, chat history, tools and hidden reasoning are excluded. The animated compute counter uses approximately 2 × 8.2 billion parameters per processed token, with one prefill and cached decoding; attention overhead is omitted. BF16 weight storage is 2 bytes per parameter; actual memory also includes activations, caches and runtime. These are Qwen3-8B scale calculations, not ChatGPT or Claude internals.

Environmental figures are Google’s reported median Gemini Apps text-prompt footprint from May 2025, not a prediction for this sentence or Qwen. They include serving infrastructure and data-center overhead; water refers to operational data-center cooling. They exclude model training, device use and other lifecycle impacts. The price is an illustrative energy-only conversion using €0.30/kWh, not a provider tariff or API price. Counters begin at submission and reach their reference totals by 59 seconds. Their interpolated progress is cinematic, not a measured resource-use curve. Weight memory is a fixed capacity, not a cumulative consumption.

Sources checked 30 September 2026.