---
id: pr-sglang-4770
repo: sgl-project/sglang
pr: 4770
title: Support (1 <= dp < tp) in the dp attention in DeepEP
author: RunkaiTao
date: '2025-03-28'
url: https://github.com/sgl-project/sglang/pull/4770
source_category: upstream-code
architectures:
- sm100
tags:
- attention
- moe
techniques: []
hardware_features: []
kernel_types:
- attention
- moe
languages:
- cuda-cpp
- python
captured_at: '2026-04-27'
status: merged
merge_sha: 7f19e083c1d22ddd4ed7784c24326fac1c67aeea
inclusion_reason: kernel file changes
changed_paths:
- docs/backend/server_arguments.md
- python/sglang/srt/distributed/device_communicators/custom_all_reduce.py
- python/sglang/srt/distributed/parallel_state.py
- python/sglang/srt/layers/dp_attention.py
- python/sglang/srt/managers/scheduler.py
- python/sglang/srt/model_executor/cuda_graph_runner.py
- python/sglang/srt/model_executor/model_runner.py
- python/sglang/srt/models/deepseek_v2.py
- python/sglang/srt/server_args.py
- test/srt/test_moe_deepep.py
head_ref_oid: 13907448d06c14264556702861f73e1d36cd276b
artifact_dir: evidence/pull-bundles/sglang/gh-4770
---
# Support (1 <= dp < tp) in the dp attention in DeepEP

- Repository: `sgl-project/sglang`
- PR: [4770](https://github.com/sgl-project/sglang/pull/4770)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `docs/backend/server_arguments.md`
- `python/sglang/srt/distributed/device_communicators/custom_all_reduce.py`
- `python/sglang/srt/distributed/parallel_state.py`
- `python/sglang/srt/layers/dp_attention.py`
- `python/sglang/srt/managers/scheduler.py`
- `python/sglang/srt/model_executor/cuda_graph_runner.py`
- `python/sglang/srt/model_executor/model_runner.py`
- `python/sglang/srt/models/deepseek_v2.py`
- `python/sglang/srt/server_args.py`
- `test/srt/test_moe_deepep.py`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-4770`
