TensorCore.si Blog
Tensor Cores, GPUs and AI chips, explained
In-depth guides, generation-by-generation breakdowns and analysis of the hardware that trains and runs modern AI.
Groq LPU vs GPU: How the LPU Works and NVIDIA's Groq 3 LPX
Groq's LPU keeps model weights in on-chip SRAM and schedules every step in advance, which makes token generation very fast but limits capacity. How…
FlashAttention Explained: How It Makes Transformers Faster on GPUs
FlashAttention computes exact attention without writing the huge attention matrix to GPU memory, using tiling and an online softmax. How it works, why it…
Prefill vs Decode: How LLM Inference Runs on a GPU
Every LLM response has two phases: prefill reads the whole prompt at once and is limited by compute; decode generates one token at a…
How Much Does It Cost to Train an LLM? Compute, GPU-Hours and Real Examples
Training an LLM costs about 6 × parameters × tokens in compute. How to turn that into GPU-hours and dollars, worked examples from 7B…
B200 vs B300: NVIDIA Blackwell vs Blackwell Ultra Specs Compared
B300 (Blackwell Ultra) keeps B200's FP8 and FP16 throughput but adds 60% more memory (288 GB), 50% more dense FP4, faster attention and 800G…
AMD vs NVIDIA for AI in 2026: ROCm vs CUDA, Instinct vs Blackwell and Rubin
AMD or NVIDIA for AI in 2026? Data-center chips (MI355X and MI455X vs B200, B300 and Rubin), consumer cards for local AI, the state…
GPU vs CPU for AI: Why GPUs Run Machine Learning
Why AI runs on GPUs instead of CPUs: thousands of parallel cores, Tensor Cores and much faster memory. A side-by-side comparison, real numbers, and…
What Is DLSS? How Tensor Cores Power AI Upscaling and Frame Generation
DLSS uses AI models running on Tensor Cores to upscale games, generate extra frames and clean up ray tracing. Every version from DLSS 1…
Tensor Cores vs RT Cores: What Each Does in an RTX GPU
Tensor Cores do matrix math for AI and DLSS; RT Cores trace rays for lighting and reflections; CUDA cores handle everything else. How the…
What Is CUDA? NVIDIA's GPU Computing Platform Explained
CUDA is NVIDIA's platform for running general programs on its GPUs. What it includes, how kernels, threads and warps work, why every AI framework…