---
id: pr-vllm-23273
repo: vllm-project/vllm
pr: 23273
title: '[Kernels] Overlap shared experts with send/recv'
author: bnellnm
date: '2025-09-03'
url: https://github.com/vllm-project/vllm/pull/23273
source_category: upstream-code
architectures:
- sm100
tags:
- fp4
- fp8
- kernel-fusion
- moe
- quantization
techniques:
- kernel-fusion
hardware_features:
- fp4
- fp8
kernel_types:
- moe
- quantization
languages:
- python
captured_at: '2026-04-27'
status: merged
merge_sha: e9b92dcd89e8d05f162a8fdaa3d5d60012615514
inclusion_reason: kernel file changes
changed_paths:
- docs/design/fused_moe_modular_kernel.md
- examples/offline_inference/data_parallel.py
- tests/kernels/moe/test_pplx_moe.py
- tests/kernels/moe/utils.py
- vllm/distributed/device_communicators/all2all.py
- vllm/distributed/device_communicators/base_device_communicator.py
- vllm/model_executor/layers/fused_moe/deepep_ht_prepare_finalize.py
- vllm/model_executor/layers/fused_moe/deepep_ll_prepare_finalize.py
- vllm/model_executor/layers/fused_moe/flashinfer_cutlass_prepare_finalize.py
- vllm/model_executor/layers/fused_moe/fused_batched_moe.py
- vllm/model_executor/layers/fused_moe/layer.py
- vllm/model_executor/layers/fused_moe/modular_kernel.py
- vllm/model_executor/layers/fused_moe/pplx_prepare_finalize.py
- vllm/model_executor/layers/fused_moe/prepare_finalize.py
- vllm/model_executor/layers/quantization/awq_marlin.py
- vllm/model_executor/layers/quantization/bitsandbytes.py
- vllm/model_executor/layers/quantization/compressed_tensors/compressed_tensors_moe.py
- vllm/model_executor/layers/quantization/experts_int8.py
- vllm/model_executor/layers/quantization/fp8.py
- vllm/model_executor/layers/quantization/gguf.py
- vllm/model_executor/layers/quantization/gptq_marlin.py
- vllm/model_executor/layers/quantization/modelopt.py
- vllm/model_executor/layers/quantization/moe_wna16.py
- vllm/model_executor/layers/quantization/mxfp4.py
- vllm/model_executor/layers/quantization/quark/quark_moe.py
- vllm/model_executor/layers/quantization/rtn.py
- vllm/model_executor/layers/shared_fused_moe/__init__.py
- vllm/model_executor/layers/shared_fused_moe/shared_fused_moe.py
- vllm/model_executor/models/deepseek_v2.py
- vllm/model_executor/models/glm4_moe.py
- vllm/model_executor/models/llama4.py
- vllm/v1/worker/gpu_worker.py
head_ref_oid: b94296f46ae398e33b97acfc723092718fc4a20b
artifact_dir: evidence/pull-bundles/vllm/gh-23273
---
# [Kernels] Overlap shared experts with send/recv

- Repository: `vllm-project/vllm`
- PR: [23273](https://github.com/vllm-project/vllm/pull/23273)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `docs/design/fused_moe_modular_kernel.md`
- `examples/offline_inference/data_parallel.py`
- `tests/kernels/moe/test_pplx_moe.py`
- `tests/kernels/moe/utils.py`
- `vllm/distributed/device_communicators/all2all.py`
- `vllm/distributed/device_communicators/base_device_communicator.py`
- `vllm/model_executor/layers/fused_moe/deepep_ht_prepare_finalize.py`
- `vllm/model_executor/layers/fused_moe/deepep_ll_prepare_finalize.py`
- `vllm/model_executor/layers/fused_moe/flashinfer_cutlass_prepare_finalize.py`
- `vllm/model_executor/layers/fused_moe/fused_batched_moe.py`
- `vllm/model_executor/layers/fused_moe/layer.py`
- `vllm/model_executor/layers/fused_moe/modular_kernel.py`
- `vllm/model_executor/layers/fused_moe/pplx_prepare_finalize.py`
- `vllm/model_executor/layers/fused_moe/prepare_finalize.py`
- `vllm/model_executor/layers/quantization/awq_marlin.py`
- `vllm/model_executor/layers/quantization/bitsandbytes.py`
- `vllm/model_executor/layers/quantization/compressed_tensors/compressed_tensors_moe.py`
- `vllm/model_executor/layers/quantization/experts_int8.py`
- `vllm/model_executor/layers/quantization/fp8.py`
- `vllm/model_executor/layers/quantization/gguf.py`
- `vllm/model_executor/layers/quantization/gptq_marlin.py`
- `vllm/model_executor/layers/quantization/modelopt.py`
- `vllm/model_executor/layers/quantization/moe_wna16.py`
- `vllm/model_executor/layers/quantization/mxfp4.py`
- `vllm/model_executor/layers/quantization/quark/quark_moe.py`
- `vllm/model_executor/layers/quantization/rtn.py`
- `vllm/model_executor/layers/shared_fused_moe/__init__.py`
- `vllm/model_executor/layers/shared_fused_moe/shared_fused_moe.py`
- `vllm/model_executor/models/deepseek_v2.py`
- `vllm/model_executor/models/glm4_moe.py`
- `vllm/model_executor/models/llama4.py`
- `vllm/v1/worker/gpu_worker.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-23273`
