---
id: pr-sglang-18233
repo: sgl-project/sglang
pr: 18233
title: Support Qwen3 MoE context parallel
author: Shunkangz
date: '2026-03-22'
url: https://github.com/sgl-project/sglang/pull/18233
source_category: upstream-code
architectures:
- sm100
tags:
- attention
- kernel-fusion
- moe
- prefill
techniques:
- kernel-fusion
hardware_features: []
kernel_types:
- attention
- moe
- prefill
languages:
- python
captured_at: '2026-04-27'
status: merged
merge_sha: bb737d7a829bac8fb6386fb6f494e1b2403c598f
inclusion_reason: kernel file changes
changed_paths:
- python/sglang/srt/distributed/communication_op.py
- python/sglang/srt/distributed/parallel_state.py
- python/sglang/srt/layers/attention/flashattention_backend.py
- python/sglang/srt/layers/communicator.py
- python/sglang/srt/layers/flashinfer_comm_fusion.py
- python/sglang/srt/layers/layernorm.py
- python/sglang/srt/layers/utils/cp_utils.py
- python/sglang/srt/managers/schedule_batch.py
- python/sglang/srt/managers/schedule_policy.py
- python/sglang/srt/model_executor/forward_batch_info.py
- python/sglang/srt/model_executor/model_runner.py
- python/sglang/srt/models/qwen2_moe.py
- python/sglang/srt/models/qwen3_moe.py
- python/sglang/srt/models/utils.py
- python/sglang/srt/server_args.py
- python/sglang/test/attention/test_flashattn_backend.py
- test/registered/4-gpu-models/test_qwen3_30b.py
- test/registered/8-gpu-models/test_qwen3_235b.py
- test/registered/unit/managers/test_prefill_adder.py
head_ref_oid: 9de747efb4840f97cf3208d84cdff26e5ecaac26
artifact_dir: evidence/pull-bundles/sglang/gh-18233
---
# Support Qwen3 MoE context parallel

- Repository: `sgl-project/sglang`
- PR: [18233](https://github.com/sgl-project/sglang/pull/18233)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `python/sglang/srt/distributed/communication_op.py`
- `python/sglang/srt/distributed/parallel_state.py`
- `python/sglang/srt/layers/attention/flashattention_backend.py`
- `python/sglang/srt/layers/communicator.py`
- `python/sglang/srt/layers/flashinfer_comm_fusion.py`
- `python/sglang/srt/layers/layernorm.py`
- `python/sglang/srt/layers/utils/cp_utils.py`
- `python/sglang/srt/managers/schedule_batch.py`
- `python/sglang/srt/managers/schedule_policy.py`
- `python/sglang/srt/model_executor/forward_batch_info.py`
- `python/sglang/srt/model_executor/model_runner.py`
- `python/sglang/srt/models/qwen2_moe.py`
- `python/sglang/srt/models/qwen3_moe.py`
- `python/sglang/srt/models/utils.py`
- `python/sglang/srt/server_args.py`
- `python/sglang/test/attention/test_flashattn_backend.py`
- `test/registered/4-gpu-models/test_qwen3_30b.py`
- `test/registered/8-gpu-models/test_qwen3_235b.py`
- `test/registered/unit/managers/test_prefill_adder.py`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-18233`
