---
id: pr-sglang-23590
repo: sgl-project/sglang
pr: 23590
title: Reland Cute-DSL FP4 dense GEMM
author: b8zhong
date: '2026-05-09'
url: https://github.com/sgl-project/sglang/pull/23590
source_category: upstream-code
architectures:
- sm100
tags:
- benchmark_test
- cutlass
- flashinfer
- fp4
- gemm_quant
- nvfp4
techniques:
- fine-grained-quantization
hardware_features:
- fp4
- nvfp4
kernel_types:
- gemm
languages:
- cuda-cpp
- cute-dsl
captured_at: '2026-05-16'
status: merged
merge_sha: 8f33bee31ba3d0f21f7c282b2438aef912f4428c
inclusion_reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.
changed_paths:
- docs_new/docs/advanced_features/server_arguments.mdx
- python/sglang/srt/layers/quantization/fp4_utils.py
- python/sglang/srt/server_args.py
- python/sglang/srt/utils/common.py
- sgl-kernel/benchmark/bench_fp4_gemm.py
- test/registered/quant/test_nvfp4_gemm.py
artifact_dir: evidence/pull-bundles/sglang/gh-23590
head_ref_oid: fef1e5100d4a03541f875cd5a72aead131cf03be
---
# Reland Cute-DSL FP4 dense GEMM

- Repository: `sgl-project/sglang`
- PR: [23590](https://github.com/sgl-project/sglang/pull/23590)
- Decision: `Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.`
- Reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.

## Changed Paths

- `docs_new/docs/advanced_features/server_arguments.mdx`
- `python/sglang/srt/layers/quantization/fp4_utils.py`
- `python/sglang/srt/server_args.py`
- `python/sglang/srt/utils/common.py`
- `sgl-kernel/benchmark/bench_fp4_gemm.py`
- `test/registered/quant/test_nvfp4_gemm.py`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-23590`
