---
id: pr-sglang-8464
repo: sgl-project/sglang
pr: 8464
title: '[2/N]Support DeepSeek-R1 w4a8 low latency deepep'
author: ayrnb
date: '2025-10-25'
url: https://github.com/sgl-project/sglang/pull/8464
source_category: upstream-code
architectures:
- sm100
tags:
- fp8
- moe
- quantization
techniques: []
hardware_features:
- fp8
kernel_types:
- moe
- quantization
languages:
- cuda-cpp
- python
captured_at: '2026-04-27'
status: merged
merge_sha: 13bf565d60f894acf6a496591c2f2fc0eecc4a98
inclusion_reason: kernel file changes
changed_paths:
- python/sglang/srt/layers/moe/cutlass_w4a8_moe.py
- python/sglang/srt/layers/moe/ep_moe/kernels.py
- python/sglang/srt/layers/moe/ep_moe/layer.py
- python/sglang/srt/layers/quantization/w4afp8.py
- sgl-kernel/csrc/moe/cutlass_moe/w4a8/w4a8_get_group_starts.cuh
- sgl-kernel/csrc/moe/cutlass_moe/w4a8/w4a8_grouped_mm_c3x.cuh
- test/srt/quant/test_w4a8_deepseek_v3.py
- test/srt/run_suite.py
head_ref_oid: 47945cc27ec7e614de9cd8f6aa15bffaaebc0a99
artifact_dir: evidence/pull-bundles/sglang/gh-8464
---
# [2/N]Support DeepSeek-R1 w4a8 low latency deepep

- Repository: `sgl-project/sglang`
- PR: [8464](https://github.com/sgl-project/sglang/pull/8464)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `python/sglang/srt/layers/moe/cutlass_w4a8_moe.py`
- `python/sglang/srt/layers/moe/ep_moe/kernels.py`
- `python/sglang/srt/layers/moe/ep_moe/layer.py`
- `python/sglang/srt/layers/quantization/w4afp8.py`
- `sgl-kernel/csrc/moe/cutlass_moe/w4a8/w4a8_get_group_starts.cuh`
- `sgl-kernel/csrc/moe/cutlass_moe/w4a8/w4a8_grouped_mm_c3x.cuh`
- `test/srt/quant/test_w4a8_deepseek_v3.py`
- `test/srt/run_suite.py`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-8464`
