---
id: pr-sglang-4918
repo: sgl-project/sglang
pr: 4918
title: Add DeepSeek V3/R1 shared experts fusion
author: BBuf
date: '2025-04-04'
url: https://github.com/sgl-project/sglang/pull/4918
source_category: upstream-code
architectures:
- sm100
tags:
- fp8
- kernel-fusion
- moe
- quantization
techniques:
- kernel-fusion
hardware_features:
- fp8
kernel_types:
- moe
- quantization
languages:
- python
- triton
captured_at: '2026-04-27'
status: merged
merge_sha: 924ca7c92c86fa3a6a321e7944e2fdd193f30c50
inclusion_reason: kernel file changes
changed_paths:
- benchmark/kernels/fused_moe_triton/tuning_fused_moe_triton.py
- python/sglang/bench_serving.py
- python/sglang/srt/layers/moe/fused_moe_triton/configs/E=257,N=256,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128, 128].json
- python/sglang/srt/layers/moe/fused_moe_triton/configs/E=264,N=256,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128, 128].json
- python/sglang/srt/layers/moe/fused_moe_triton/fused_moe.py
- python/sglang/srt/layers/moe/topk.py
- python/sglang/srt/layers/quantization/__init__.py
- python/sglang/srt/layers/quantization/compressed_tensors/compressed_tensors.py
- python/sglang/srt/layers/quantization/compressed_tensors/compressed_tensors_moe.py
- python/sglang/srt/managers/schedule_batch.py
- python/sglang/srt/model_executor/model_runner.py
- python/sglang/srt/models/deepseek_v2.py
- python/sglang/srt/server_args.py
- sgl-kernel/tests/test_moe_align.py
head_ref_oid: dbcae930df5fe4cb593a9287be14f4c584581bb3
artifact_dir: evidence/pull-bundles/sglang/gh-4918
---
# Add DeepSeek V3/R1 shared experts fusion

- Repository: `sgl-project/sglang`
- PR: [4918](https://github.com/sgl-project/sglang/pull/4918)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `benchmark/kernels/fused_moe_triton/tuning_fused_moe_triton.py`
- `python/sglang/bench_serving.py`
- `python/sglang/srt/layers/moe/fused_moe_triton/configs/E=257,N=256,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128, 128].json`
- `python/sglang/srt/layers/moe/fused_moe_triton/configs/E=264,N=256,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128, 128].json`
- `python/sglang/srt/layers/moe/fused_moe_triton/fused_moe.py`
- `python/sglang/srt/layers/moe/topk.py`
- `python/sglang/srt/layers/quantization/__init__.py`
- `python/sglang/srt/layers/quantization/compressed_tensors/compressed_tensors.py`
- `python/sglang/srt/layers/quantization/compressed_tensors/compressed_tensors_moe.py`
- `python/sglang/srt/managers/schedule_batch.py`
- `python/sglang/srt/model_executor/model_runner.py`
- `python/sglang/srt/models/deepseek_v2.py`
- `python/sglang/srt/server_args.py`
- `sgl-kernel/tests/test_moe_align.py`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-4918`
