https://florianmattana.com/tags/quantization/ Recent content in Quantization on Florian Mattana Hugo en Sun, 05 Apr 2026 00:00:00 +0000 https://florianmattana.com/posts/mxfp4_article/ Sun, 05 Apr 2026 00:00:00 +0000 https://florianmattana.com/posts/mxfp4_article/ <h2 id="why-i-did-this">Why I Did This</h2> <p>I&rsquo;m building an FP4 fused attention kernel for consumer Blackwell GPUs (SM120). That means I spend my days thinking about how to squeeze 32-bit numbers into 4 bits without losing too much information.</p> <p><a href="https://tensara.org">Tensara</a> is a platform where you submit GPU kernels and compete on real hardware. They had an MXFP4 quantization problem with almost no submissions. I figured: I already know this format inside out on SM120, how hard can it be to write a standalone quantization kernel?</p>