---
id: pr-sglang-24986
repo: sgl-project/sglang
pr: 24986
title: '[rebase]Deepseek_v4 support w4(mxfp4)a16 on hopper'
author: shiyu7
date: '2026-05-13'
url: https://github.com/sgl-project/sglang/pull/24986
source_category: upstream-code
architectures:
- sm100
- sm90
tags:
- gemm_quant
- hopper
- mxfp4
techniques:
- fine-grained-quantization
- kernel-fusion
hardware_features:
- fp4
- fp8
- hopper
- mxfp4
kernel_types:
- gemm
- moe
languages:
- cuda-cpp
- triton
captured_at: '2026-05-16'
status: merged
merge_sha: 37f18438c593809abfd6edc816f77b5257bb6797
inclusion_reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.
changed_paths:
- python/sglang/jit_kernel/csrc/gemm/marlin_moe/moe_wna16_marlin.cuh
- python/sglang/srt/layers/moe/fused_moe_triton/fused_marlin_moe.py
- python/sglang/srt/layers/quantization/marlin_utils_fp4.py
- python/sglang/srt/layers/quantization/mxfp4.py
- python/sglang/srt/layers/quantization/mxfp4_marlin_moe.py
- test/registered/dsv4/test_deepseek_v4_flash_fp4_h200.py
- test/registered/dsv4/test_deepseek_v4_flash_fp8_h200.py
artifact_dir: evidence/pull-bundles/sglang/gh-24986
head_ref_oid: 62ca39ffa75180e51e1810a189b2f9dd7cae7a86
---
# [rebase]Deepseek_v4 support w4(mxfp4)a16 on hopper

- Repository: `sgl-project/sglang`
- PR: [24986](https://github.com/sgl-project/sglang/pull/24986)
- Decision: `Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.`
- Reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.

## Changed Paths

- `python/sglang/jit_kernel/csrc/gemm/marlin_moe/moe_wna16_marlin.cuh`
- `python/sglang/srt/layers/moe/fused_moe_triton/fused_marlin_moe.py`
- `python/sglang/srt/layers/quantization/marlin_utils_fp4.py`
- `python/sglang/srt/layers/quantization/mxfp4.py`
- `python/sglang/srt/layers/quantization/mxfp4_marlin_moe.py`
- `test/registered/dsv4/test_deepseek_v4_flash_fp4_h200.py`
- `test/registered/dsv4/test_deepseek_v4_flash_fp8_h200.py`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-24986`
