---
id: pr-sglang-8118
repo: sgl-project/sglang
pr: 8118
title: '[feat] Support tp mode for DeepSeek-R1-W4AFP8'
author: chenxijun1029
date: '2025-09-02'
url: https://github.com/sgl-project/sglang/pull/8118
source_category: upstream-code
architectures:
- sm100
tags:
- fp8
- kernel-fusion
- moe
- quantization
techniques:
- kernel-fusion
hardware_features:
- fp8
kernel_types:
- moe
- quantization
languages:
- cuda-cpp
- python
- triton
captured_at: '2026-04-27'
status: merged
merge_sha: d4a938417d2c310eae3bae19f1376a3fec142e07
inclusion_reason: kernel file changes
changed_paths:
- python/sglang/srt/configs/model_config.py
- python/sglang/srt/layers/moe/cutlass_w4a8_moe.py
- python/sglang/srt/layers/moe/ep_moe/layer.py
- python/sglang/srt/layers/moe/fused_moe_triton/layer.py
- python/sglang/srt/layers/quantization/w4afp8.py
- python/sglang/srt/models/deepseek_v2.py
- python/sglang/test/test_cutlass_w4a8_moe.py
- sgl-kernel/csrc/moe/cutlass_moe/w4a8/w4a8_get_group_starts.cuh
- sgl-kernel/csrc/moe/cutlass_moe/w4a8/w4a8_grouped_mm_c3x.cu
- sgl-kernel/csrc/moe/cutlass_moe/w4a8/w4a8_grouped_mm_c3x.cuh
- sgl-kernel/tests/test_cutlass_w4a8_moe_mm.py
head_ref_oid: 6fa12e0f7bdaaee005d83f9ca54a887bc9ca841b
artifact_dir: evidence/pull-bundles/sglang/gh-8118
---
# [feat] Support tp mode for DeepSeek-R1-W4AFP8

- Repository: `sgl-project/sglang`
- PR: [8118](https://github.com/sgl-project/sglang/pull/8118)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `python/sglang/srt/configs/model_config.py`
- `python/sglang/srt/layers/moe/cutlass_w4a8_moe.py`
- `python/sglang/srt/layers/moe/ep_moe/layer.py`
- `python/sglang/srt/layers/moe/fused_moe_triton/layer.py`
- `python/sglang/srt/layers/quantization/w4afp8.py`
- `python/sglang/srt/models/deepseek_v2.py`
- `python/sglang/test/test_cutlass_w4a8_moe.py`
- `sgl-kernel/csrc/moe/cutlass_moe/w4a8/w4a8_get_group_starts.cuh`
- `sgl-kernel/csrc/moe/cutlass_moe/w4a8/w4a8_grouped_mm_c3x.cu`
- `sgl-kernel/csrc/moe/cutlass_moe/w4a8/w4a8_grouped_mm_c3x.cuh`
- `sgl-kernel/tests/test_cutlass_w4a8_moe_mm.py`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-8118`
