---
id: pr-sglang-19216
repo: sgl-project/sglang
pr: 19216
title: '[AMD][with CI Fix] support two batch overlapping for mori ep'
author: billishyahao
date: '2026-02-25'
url: https://github.com/sgl-project/sglang/pull/19216
source_category: upstream-code
architectures:
- sm100
tags: []
techniques: []
hardware_features: []
kernel_types: []
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: 60eeef73701a5e5d79b28bd4b9b6d552c576854f
inclusion_reason: defer
changed_paths:
- docs/advanced_features/server_arguments.md
- python/sglang/srt/batch_overlap/operations.py
- python/sglang/srt/batch_overlap/operations_strategy.py
- python/sglang/srt/batch_overlap/two_batch_overlap.py
- python/sglang/srt/layers/attention/aiter_backend.py
- python/sglang/srt/layers/moe/ep_moe/layer.py
- python/sglang/srt/layers/moe/fused_moe_triton/layer.py
- python/sglang/srt/layers/moe/token_dispatcher/__init__.py
- python/sglang/srt/layers/moe/token_dispatcher/moriep.py
- python/sglang/srt/models/deepseek_v2.py
- python/sglang/srt/server_args.py
- python/sglang/test/bench_one_batch_server_internal.py
artifact_dir: evidence/pull-bundles/sglang/gh-19216
head_ref_oid: 34212a4a2fe19f12897214d8fddeaab09ca00c03
---
# [AMD][with CI Fix] support two batch overlapping for mori ep

- Repository: `sgl-project/sglang`
- PR: [19216](https://github.com/sgl-project/sglang/pull/19216)
- Decision: `defer`
- Reason: defer

## Changed Paths

- `docs/advanced_features/server_arguments.md`
- `python/sglang/srt/batch_overlap/operations.py`
- `python/sglang/srt/batch_overlap/operations_strategy.py`
- `python/sglang/srt/batch_overlap/two_batch_overlap.py`
- `python/sglang/srt/layers/attention/aiter_backend.py`
- `python/sglang/srt/layers/moe/ep_moe/layer.py`
- `python/sglang/srt/layers/moe/fused_moe_triton/layer.py`
- `python/sglang/srt/layers/moe/token_dispatcher/__init__.py`
- `python/sglang/srt/layers/moe/token_dispatcher/moriep.py`
- `python/sglang/srt/models/deepseek_v2.py`
- `python/sglang/srt/server_args.py`
- `python/sglang/test/bench_one_batch_server_internal.py`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-19216`
