---
id: pr-sglang-22717
repo: sgl-project/sglang
pr: 22717
title: '[codex] Add flashinfer TRTLLM backend for diffusion NVFP4'
author: BBuf
date: '2026-04-18'
url: https://github.com/sgl-project/sglang/pull/22717
source_category: upstream-code
architectures:
- sm100
tags:
- cutlass
- flashinfer
- fp4
- gemm_quant
- jit_kernel
- nvfp4
techniques:
- fine-grained-quantization
- kernel-fusion
hardware_features:
- fp4
- nvfp4
kernel_types:
- gemm
languages:
- cuda-cpp
- cute-dsl
captured_at: '2026-05-16'
status: merged
merge_sha: 615d6c93b2fcb499be219d4bfa6407e5bc8b884b
inclusion_reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.
changed_paths:
- docs/diffusion/quantization.md
- python/sglang/jit_kernel/tests/diffusion/test_diffusion_nvfp4_scaled_mm.py
- python/sglang/multimodal_gen/envs.py
- python/sglang/multimodal_gen/runtime/layers/quantization/modelopt_quant.py
- python/sglang/multimodal_gen/runtime/platforms/cuda.py
- python/sglang/multimodal_gen/tools/compare_diffusion_trajectory_similarity.py
artifact_dir: evidence/pull-bundles/sglang/gh-22717
head_ref_oid: 148e84d764442fd9fa335a089190a1f67b6ba0d8
---
# [codex] Add flashinfer TRTLLM backend for diffusion NVFP4

- Repository: `sgl-project/sglang`
- PR: [22717](https://github.com/sgl-project/sglang/pull/22717)
- Decision: `Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.`
- Reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.

## Changed Paths

- `docs/diffusion/quantization.md`
- `python/sglang/jit_kernel/tests/diffusion/test_diffusion_nvfp4_scaled_mm.py`
- `python/sglang/multimodal_gen/envs.py`
- `python/sglang/multimodal_gen/runtime/layers/quantization/modelopt_quant.py`
- `python/sglang/multimodal_gen/runtime/platforms/cuda.py`
- `python/sglang/multimodal_gen/tools/compare_diffusion_trajectory_similarity.py`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-22717`
