---
id: pr-sglang-23745
repo: sgl-project/sglang
pr: 23745
title: Use Cute-DSL NVFP4 quantization kernels
author: b8zhong
date: '2026-05-11'
url: https://github.com/sgl-project/sglang/pull/23745
source_category: upstream-code
architectures:
- sm100
tags:
- PDL
- benchmark_test
- compiler_runtime
- fp4
- gemm_quant
- nvfp4
techniques:
- fine-grained-quantization
hardware_features:
- fp4
- nvfp4
- pdl
kernel_types:
- compiler
- gemm
- moe
languages:
- cuda-cpp
- cute-dsl
captured_at: '2026-05-16'
status: merged
merge_sha: 1d80a1a9fe6d6611cf55abb3a72767603d3db666
inclusion_reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.
changed_paths:
- benchmark/kernels/quantization/bench_fp4_quant.py
- python/sglang/srt/layers/moe/moe_runner/flashinfer_cutedsl.py
- python/sglang/srt/layers/moe/moe_runner/flashinfer_trtllm.py
- python/sglang/srt/layers/moe/token_dispatcher/flashinfer.py
- python/sglang/srt/layers/moe/token_dispatcher/standard.py
- python/sglang/srt/layers/quantization/compressed_tensors/schemes/compressed_tensors_w4a4_nvfp4_moe.py
- python/sglang/srt/layers/quantization/fp4_utils.py
- python/sglang/srt/layers/quantization/modelopt_quant.py
artifact_dir: evidence/pull-bundles/sglang/gh-23745
head_ref_oid: dce712c8dfcab3ffdaed3629bae9a3bc624a360d
---
# Use Cute-DSL NVFP4 quantization kernels

- Repository: `sgl-project/sglang`
- PR: [23745](https://github.com/sgl-project/sglang/pull/23745)
- Decision: `Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.`
- Reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.

## Changed Paths

- `benchmark/kernels/quantization/bench_fp4_quant.py`
- `python/sglang/srt/layers/moe/moe_runner/flashinfer_cutedsl.py`
- `python/sglang/srt/layers/moe/moe_runner/flashinfer_trtllm.py`
- `python/sglang/srt/layers/moe/token_dispatcher/flashinfer.py`
- `python/sglang/srt/layers/moe/token_dispatcher/standard.py`
- `python/sglang/srt/layers/quantization/compressed_tensors/schemes/compressed_tensors_w4a4_nvfp4_moe.py`
- `python/sglang/srt/layers/quantization/fp4_utils.py`
- `python/sglang/srt/layers/quantization/modelopt_quant.py`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-23745`
