Simulations
Interactive and animated explainers that show the math inside a Tensor Core step by step.
See the math happen
Interactive explainers that show the matrix multiply-accumulate inside a Tensor Core step by step. Change the inputs, watch each product and sum appear, then test yourself in a game or the challenge.
Start here
Tools for this topic
Edited by Sami Ullah Khan. Read our editorial policy.
All Simulations articles
LLM Sampling Simulator: Temperature, Top-k and Top-p Explained
Change temperature, top-k, top-p and min-p and watch a language model's next-token probabilities reshape. Sample one token or a thousand and see exactly how…
Roofline Model Simulator: Memory-Bound or Compute-Bound?
An interactive roofline chart for 11 AI chips. Drag LLM decode, prefill, matrix multiply and attention workloads to see whether memory bandwidth or Tensor…
Attention Mechanism Simulator: Self-Attention Step by Step
Type any sentence and watch self-attention, the core of every transformer, compute queries, keys, values, scores, the causal mask, softmax and the output, with…
LLM Inference Simulator: How GPUs Generate Tokens
Pick a GPU, a model, a prompt length and how many people are using it at once, then watch prefill and decode happen token…
What Is a Tensor Core? A Plain-Language Guide
A Tensor Core is the matrix-math engine inside NVIDIA GPUs. Here is what it computes, why AI depends on it, and how it went…
FP16, BF16, FP8 and FP4: Precision Formats Explained
Why AI runs on 16-, 8- and even 4-bit numbers, how each format trades range for precision, and what microscaling, NVFP4 and FP32 accumulation…