---
id: pr-vllm-19636
repo: vllm-project/vllm
pr: 19636
title: '[Kernels] MoE refactor'
author: bnellnm
date: '2025-07-02'
url: https://github.com/vllm-project/vllm/pull/19636
source_category: upstream-code
architectures:
- sm100
tags: []
techniques: []
hardware_features: []
kernel_types: []
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: c1909e7e8ccd2037e76536a8e726120c85d3754e
inclusion_reason: defer
changed_paths:
- benchmarks/kernels/benchmark_grouped_gemm_cutlass.py
- tests/kernels/moe/parallel_utils.py
- tests/kernels/moe/test_batched_moe.py
- tests/kernels/moe/test_block_fp8.py
- tests/kernels/moe/test_block_int8.py
- tests/kernels/moe/test_cutlass_moe.py
- tests/kernels/moe/test_deepep_deepgemm_moe.py
- tests/kernels/moe/test_deepep_moe.py
- tests/kernels/moe/test_moe.py
- tests/kernels/moe/test_nvfp4_moe.py
- tests/kernels/moe/test_pplx_cutlass_moe.py
- tests/kernels/moe/test_pplx_moe.py
- tests/kernels/moe/utils.py
- tests/kernels/quant_utils.py
- tests/kernels/quantization/test_block_fp8.py
- tests/kernels/quantization/test_block_int8.py
- tests/kernels/utils.py
- vllm/_custom_ops.py
- vllm/model_executor/layers/fused_moe/__init__.py
- vllm/model_executor/layers/fused_moe/batched_deep_gemm_moe.py
- vllm/model_executor/layers/fused_moe/batched_triton_or_deep_gemm_moe.py
- vllm/model_executor/layers/fused_moe/config.py
- vllm/model_executor/layers/fused_moe/cutlass_moe.py
- vllm/model_executor/layers/fused_moe/deep_gemm_moe.py
- vllm/model_executor/layers/fused_moe/deepep_ht_prepare_finalize.py
- vllm/model_executor/layers/fused_moe/deepep_ll_prepare_finalize.py
- vllm/model_executor/layers/fused_moe/fused_batched_moe.py
- vllm/model_executor/layers/fused_moe/fused_moe.py
- vllm/model_executor/layers/fused_moe/layer.py
- vllm/model_executor/layers/fused_moe/modular_kernel.py
- vllm/model_executor/layers/fused_moe/pplx_prepare_finalize.py
- vllm/model_executor/layers/fused_moe/prepare_finalize.py
- vllm/model_executor/layers/fused_moe/triton_deep_gemm_moe.py
- vllm/model_executor/layers/fused_moe/utils.py
- vllm/model_executor/layers/quantization/compressed_tensors/compressed_tensors_moe.py
- vllm/model_executor/layers/quantization/fp8.py
artifact_dir: evidence/pull-bundles/vllm/gh-19636
head_ref_oid: 86224d005444895ca00cb3b4e61f5a05e52f8b27
---
# [Kernels] MoE refactor

- Repository: `vllm-project/vllm`
- PR: [19636](https://github.com/vllm-project/vllm/pull/19636)
- Decision: `defer`
- Reason: defer

## Changed Paths

- `benchmarks/kernels/benchmark_grouped_gemm_cutlass.py`
- `tests/kernels/moe/parallel_utils.py`
- `tests/kernels/moe/test_batched_moe.py`
- `tests/kernels/moe/test_block_fp8.py`
- `tests/kernels/moe/test_block_int8.py`
- `tests/kernels/moe/test_cutlass_moe.py`
- `tests/kernels/moe/test_deepep_deepgemm_moe.py`
- `tests/kernels/moe/test_deepep_moe.py`
- `tests/kernels/moe/test_moe.py`
- `tests/kernels/moe/test_nvfp4_moe.py`
- `tests/kernels/moe/test_pplx_cutlass_moe.py`
- `tests/kernels/moe/test_pplx_moe.py`
- `tests/kernels/moe/utils.py`
- `tests/kernels/quant_utils.py`
- `tests/kernels/quantization/test_block_fp8.py`
- `tests/kernels/quantization/test_block_int8.py`
- `tests/kernels/utils.py`
- `vllm/_custom_ops.py`
- `vllm/model_executor/layers/fused_moe/__init__.py`
- `vllm/model_executor/layers/fused_moe/batched_deep_gemm_moe.py`
- `vllm/model_executor/layers/fused_moe/batched_triton_or_deep_gemm_moe.py`
- `vllm/model_executor/layers/fused_moe/config.py`
- `vllm/model_executor/layers/fused_moe/cutlass_moe.py`
- `vllm/model_executor/layers/fused_moe/deep_gemm_moe.py`
- `vllm/model_executor/layers/fused_moe/deepep_ht_prepare_finalize.py`
- `vllm/model_executor/layers/fused_moe/deepep_ll_prepare_finalize.py`
- `vllm/model_executor/layers/fused_moe/fused_batched_moe.py`
- `vllm/model_executor/layers/fused_moe/fused_moe.py`
- `vllm/model_executor/layers/fused_moe/layer.py`
- `vllm/model_executor/layers/fused_moe/modular_kernel.py`
- `vllm/model_executor/layers/fused_moe/pplx_prepare_finalize.py`
- `vllm/model_executor/layers/fused_moe/prepare_finalize.py`
- `vllm/model_executor/layers/fused_moe/triton_deep_gemm_moe.py`
- `vllm/model_executor/layers/fused_moe/utils.py`
- `vllm/model_executor/layers/quantization/compressed_tensors/compressed_tensors_moe.py`
- `vllm/model_executor/layers/quantization/fp8.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-19636`
