---
id: pr-sglang-7150
repo: sgl-project/sglang
pr: 7150
title: Refactor DeepGEMM integration
author: fzyzcjy
date: '2025-06-14'
url: https://github.com/sgl-project/sglang/pull/7150
source_category: upstream-code
architectures:
- sm100
tags: []
techniques: []
hardware_features: []
kernel_types: []
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: b4c41f7276e224b03cbcb9121c01a8be88109520
inclusion_reason: defer
changed_paths:
- python/sglang/srt/layers/moe/ep_moe/kernels.py
- python/sglang/srt/layers/moe/ep_moe/layer.py
- python/sglang/srt/layers/moe/ep_moe/token_dispatcher.py
- python/sglang/srt/layers/quantization/deep_gemm_wrapper/__init__.py
- python/sglang/srt/layers/quantization/deep_gemm_wrapper/compile_utils.py
- python/sglang/srt/layers/quantization/deep_gemm_wrapper/configurer.py
- python/sglang/srt/layers/quantization/deep_gemm_wrapper/entrypoint.py
- python/sglang/srt/layers/quantization/fp8_kernel.py
- python/sglang/srt/layers/quantization/fp8_utils.py
- python/sglang/srt/model_executor/model_runner.py
- python/sglang/srt/models/deepseek_v2.py
- python/sglang/srt/two_batch_overlap.py
artifact_dir: evidence/pull-bundles/sglang/gh-7150
head_ref_oid: aa52fac9fa29c66046ba2f45bea4efd75d4d3a66
---
# Refactor DeepGEMM integration

- Repository: `sgl-project/sglang`
- PR: [7150](https://github.com/sgl-project/sglang/pull/7150)
- Decision: `defer`
- Reason: defer

## Changed Paths

- `python/sglang/srt/layers/moe/ep_moe/kernels.py`
- `python/sglang/srt/layers/moe/ep_moe/layer.py`
- `python/sglang/srt/layers/moe/ep_moe/token_dispatcher.py`
- `python/sglang/srt/layers/quantization/deep_gemm_wrapper/__init__.py`
- `python/sglang/srt/layers/quantization/deep_gemm_wrapper/compile_utils.py`
- `python/sglang/srt/layers/quantization/deep_gemm_wrapper/configurer.py`
- `python/sglang/srt/layers/quantization/deep_gemm_wrapper/entrypoint.py`
- `python/sglang/srt/layers/quantization/fp8_kernel.py`
- `python/sglang/srt/layers/quantization/fp8_utils.py`
- `python/sglang/srt/model_executor/model_runner.py`
- `python/sglang/srt/models/deepseek_v2.py`
- `python/sglang/srt/two_batch_overlap.py`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-7150`
