---
id: pr-sglang-9199
repo: sgl-project/sglang
pr: 9199
title: '[NVIDIA] [3/N] Nvfp4 Masked Gemm: Add flashinfer grouped_gemm_nt_masked '
author: wenscarl
date: '2025-09-12'
url: https://github.com/sgl-project/sglang/pull/9199
source_category: upstream-code
architectures:
- sm100
tags:
- fp4
- gemm
- grouped-gemm
- moe
- nvfp4
- quantization
techniques: []
hardware_features:
- fp4
- nvfp4
kernel_types:
- gemm
- grouped-gemm
- moe
- quantization
languages:
- cute-dsl
- python
captured_at: '2026-04-27'
status: merged
merge_sha: 3df05f4d6ab80fb78918168b71c82282a041529d
inclusion_reason: kernel file changes
changed_paths:
- docs/references/environment_variables.md
- python/sglang/srt/layers/moe/ep_moe/layer.py
- python/sglang/srt/layers/moe/flashinfer_cutedsl_moe.py
- python/sglang/srt/layers/moe/token_dispatcher/deepep.py
- python/sglang/srt/layers/moe/utils.py
- python/sglang/srt/layers/quantization/modelopt_quant.py
- python/sglang/srt/models/deepseek_v2.py
- python/sglang/srt/server_args.py
- python/sglang/test/test_fp4_moe.py
- python/sglang/test/test_utils.py
- test/srt/test_cutedsl_flashinfer_8gpu.py
head_ref_oid: cd64a568928b5769a555ea7217213f08097e467f
artifact_dir: evidence/pull-bundles/sglang/gh-9199
---
# [NVIDIA] [3/N] Nvfp4 Masked Gemm: Add flashinfer grouped_gemm_nt_masked 

- Repository: `sgl-project/sglang`
- PR: [9199](https://github.com/sgl-project/sglang/pull/9199)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `docs/references/environment_variables.md`
- `python/sglang/srt/layers/moe/ep_moe/layer.py`
- `python/sglang/srt/layers/moe/flashinfer_cutedsl_moe.py`
- `python/sglang/srt/layers/moe/token_dispatcher/deepep.py`
- `python/sglang/srt/layers/moe/utils.py`
- `python/sglang/srt/layers/quantization/modelopt_quant.py`
- `python/sglang/srt/models/deepseek_v2.py`
- `python/sglang/srt/server_args.py`
- `python/sglang/test/test_fp4_moe.py`
- `python/sglang/test/test_utils.py`
- `test/srt/test_cutedsl_flashinfer_8gpu.py`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-9199`
