The only deployed sparse FP4 GEMM on SM120: beats CUTLASS 80b on every shape, wins end-to-end request latency in 81 of 112 serving regimes vs dense NVFP4.
cuda sparse quantization gpu-kernels mixed-precision tensor-cores blackwell vllm llm-inference fp4 sm120 nvfp4 2-4-sparsity
-
Updated
Jul 18, 2026 - Python