---
id: pr-sglang-23686
repo: sgl-project/sglang
pr: 23686
title: Deepseek_v4 support w4(mxfp4)a16 on hopper
author: zhangxiaolei123456
date: '2026-04-28'
url: https://github.com/sgl-project/sglang/pull/23686
source_category: upstream-code
architectures:
- sm100
- sm90
tags:
- deepgemm
- gemm_quant
- hopper
- mxfp4
techniques:
- fine-grained-quantization
- kernel-fusion
hardware_features:
- fp4
- fp8
- hopper
- mxfp4
kernel_types:
- gemm
- moe
languages:
- cuda-cpp
- triton
captured_at: '2026-05-16'
status: merged
merge_sha: 2ef83105bea35d2008468a81727ff4a34db018c2
inclusion_reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.
changed_paths:
- python/sglang/srt/layers/moe/fused_moe_triton/fused_marlin_moe.py
- python/sglang/srt/layers/moe/moe_runner/marlin.py
- python/sglang/srt/layers/quantization/fp8.py
- python/sglang/srt/layers/quantization/marlin_utils_fp4.py
- python/sglang/srt/layers/quantization/mxfp4_deepseek.py
- python/sglang/srt/server_args.py
- sgl-kernel/csrc/moe/marlin_moe_wna16/marlin_template.h
- sgl-kernel/csrc/moe/marlin_moe_wna16/ops.cu
artifact_dir: evidence/pull-bundles/sglang/gh-23686
head_ref_oid: ab3ae4554cb6085fcb0ae250932ec137fbaed87e
---
# Deepseek_v4 support w4(mxfp4)a16 on hopper

- Repository: `sgl-project/sglang`
- PR: [23686](https://github.com/sgl-project/sglang/pull/23686)
- Decision: `Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.`
- Reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.

## Changed Paths

- `python/sglang/srt/layers/moe/fused_moe_triton/fused_marlin_moe.py`
- `python/sglang/srt/layers/moe/moe_runner/marlin.py`
- `python/sglang/srt/layers/quantization/fp8.py`
- `python/sglang/srt/layers/quantization/marlin_utils_fp4.py`
- `python/sglang/srt/layers/quantization/mxfp4_deepseek.py`
- `python/sglang/srt/server_args.py`
- `sgl-kernel/csrc/moe/marlin_moe_wna16/marlin_template.h`
- `sgl-kernel/csrc/moe/marlin_moe_wna16/ops.cu`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-23686`
