INTERACTIVE EXPERIMENT 001YOUR FIRST PREDICTION
/ OPEN THE BLACK BOX

You're already good at predicting.

Before learning how AI works, try the kind of prediction a language model calculates.

COMPLETE THE SENTENCEThe cat sat on the ___
Which ending seems most likely?
Research & verificationTransformers and next-token predictionPeer reviewed
Peer reviewedSite demo: not independently audited
Attention Is All You Need ↗Vaswani and colleagues, NeurIPS 2017, 2017

Publication review: Peer-reviewed conference publication that established the Transformer architecture. GPT-2 autoregressive decoding is a later development.

Independent verification: The step-by-step explanations summarize a typical autoregressive pipeline; they are not independently audited claims about any single deployed model.

Peer review of a paper does not certify this demo.

/ THE MAIN EXPERIENCE

Follow one sentence.
See every transformation.

Your prompt stays with you from text to prediction. Watch the numbers change and inspect each operation.

Enter the machine →
/ YOUR LEARNING STYLE

One topic.
Three ways to understand it.

Choose a level in the header. Your explanations and some diagrams adapt as you explore.

Try your own explanation level ↗
05Visual intuition

Make the invisible easy to picture.

15How it works

Connect the pictures to real math.

25Under the hood

Inspect the formulas and limitations.

/ FREEDOM TO EXPERIMENT

What if you change the rules?

Train a small network, add neurons, adjust learning rates, and test real next-token predictions.

Open the experiments ↗ ↗
01CHANGE THE WEIGHTSREAL GRADIENT DESCENT
02COMPARE TOKEN VECTORSREAL PRETRAINED EMBEDDINGS
03TEST THE PREDICTIONREAL MODEL LOGITS
/ TRUST, BUT VERIFY

A paper and a demo aren't the same thing.

Every experiment links to research and clearly states whether its publication was reviewed and its code independently audited.

Review the sources ↗ ↗
↗EVIDENCE FIRST.
CLAIMS SECOND.