---
id: pr-sglang-18801
repo: sgl-project/sglang
pr: 18801
title: Support CuteDSL `mm_fp4` backend
author: b8zhong
date: '2026-03-19'
url: https://github.com/sgl-project/sglang/pull/18801
source_category: upstream-code
architectures:
- sm100
tags:
- benchmark_test
- compiler_runtime
- cutlass
- gemm_quant
techniques:
- autotuning
- fine-grained-quantization
hardware_features:
- fp4
- nvfp4
kernel_types:
- compiler
- gemm
languages:
- cuda-cpp
- cute-dsl
captured_at: '2026-05-16'
status: merged
merge_sha: b42b9f6e1a1ec91562dd5a5255a1ebf8fd279350
inclusion_reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.
changed_paths:
- python/sglang/srt/layers/quantization/fp4_utils.py
- python/sglang/srt/server_args.py
- sgl-kernel/benchmark/bench_fp4_gemm.py
- sgl-kernel/benchmark/bench_nvfp4_scaled_gemm.py
- test/registered/quant/test_nvfp4_gemm.py
artifact_dir: evidence/pull-bundles/sglang/gh-18801
head_ref_oid: 6aa805e853d80c7779c4410b74b91619e0ee527e
---
# Support CuteDSL `mm_fp4` backend

- Repository: `sgl-project/sglang`
- PR: [18801](https://github.com/sgl-project/sglang/pull/18801)
- Decision: `Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.`
- Reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.

## Changed Paths

- `python/sglang/srt/layers/quantization/fp4_utils.py`
- `python/sglang/srt/server_args.py`
- `sgl-kernel/benchmark/bench_fp4_gemm.py`
- `sgl-kernel/benchmark/bench_nvfp4_scaled_gemm.py`
- `test/registered/quant/test_nvfp4_gemm.py`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-18801`
