---
id: pr-vllm-18762
repo: vllm-project/vllm
pr: 18762
title: '[Kernel] Integrate CUTLASS MoE kernel with PPLX'
author: ElizaWszola
date: '2025-06-07'
url: https://github.com/vllm-project/vllm/pull/18762
source_category: upstream-code
architectures:
- sm100
tags:
- fp8
- gemm
- grouped-gemm
- kernel-fusion
- moe
- quantization
techniques:
- kernel-fusion
hardware_features:
- fp8
kernel_types:
- gemm
- grouped-gemm
- moe
- quantization
languages:
- cuda-cpp
- triton
captured_at: '2026-04-27'
status: merged
merge_sha: 84166fee9770e6fba71a96978b3e7d149392fb28
inclusion_reason: kernel file changes
changed_paths:
- CMakeLists.txt
- benchmarks/kernels/benchmark_grouped_gemm_cutlass.py
- csrc/ops.h
- csrc/quantization/cutlass_w8a8/moe/grouped_mm_c3x.cu
- csrc/quantization/cutlass_w8a8/moe/grouped_mm_c3x.cuh
- csrc/quantization/cutlass_w8a8/moe/moe_data.cu
- csrc/quantization/cutlass_w8a8/scaled_mm_entry.cu
- csrc/torch_bindings.cpp
- tests/kernels/moe/test_cutlass_moe.py
- tests/kernels/moe/test_pplx_cutlass_moe.py
- tests/kernels/moe/test_pplx_moe.py
- tests/kernels/quantization/test_cutlass_scaled_mm.py
- tests/pplx_utils.py
- vllm/_custom_ops.py
- vllm/model_executor/layers/fused_moe/batched_deep_gemm_moe.py
- vllm/model_executor/layers/fused_moe/batched_triton_or_deep_gemm_moe.py
- vllm/model_executor/layers/fused_moe/cutlass_moe.py
- vllm/model_executor/layers/fused_moe/deep_gemm_moe.py
- vllm/model_executor/layers/fused_moe/fused_batched_moe.py
- vllm/model_executor/layers/fused_moe/fused_moe.py
- vllm/model_executor/layers/fused_moe/layer.py
- vllm/model_executor/layers/fused_moe/modular_kernel.py
- vllm/model_executor/layers/fused_moe/pplx_prepare_finalize.py
- vllm/model_executor/layers/fused_moe/triton_deep_gemm_moe.py
- vllm/model_executor/layers/quantization/compressed_tensors/compressed_tensors_moe.py
- vllm/model_executor/layers/quantization/fp8.py
head_ref_oid: db5aa2d7c860659fcd19f209f6da659313b52847
artifact_dir: evidence/pull-bundles/vllm/gh-18762
---
# [Kernel] Integrate CUTLASS MoE kernel with PPLX

- Repository: `vllm-project/vllm`
- PR: [18762](https://github.com/vllm-project/vllm/pull/18762)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `CMakeLists.txt`
- `benchmarks/kernels/benchmark_grouped_gemm_cutlass.py`
- `csrc/ops.h`
- `csrc/quantization/cutlass_w8a8/moe/grouped_mm_c3x.cu`
- `csrc/quantization/cutlass_w8a8/moe/grouped_mm_c3x.cuh`
- `csrc/quantization/cutlass_w8a8/moe/moe_data.cu`
- `csrc/quantization/cutlass_w8a8/scaled_mm_entry.cu`
- `csrc/torch_bindings.cpp`
- `tests/kernels/moe/test_cutlass_moe.py`
- `tests/kernels/moe/test_pplx_cutlass_moe.py`
- `tests/kernels/moe/test_pplx_moe.py`
- `tests/kernels/quantization/test_cutlass_scaled_mm.py`
- `tests/pplx_utils.py`
- `vllm/_custom_ops.py`
- `vllm/model_executor/layers/fused_moe/batched_deep_gemm_moe.py`
- `vllm/model_executor/layers/fused_moe/batched_triton_or_deep_gemm_moe.py`
- `vllm/model_executor/layers/fused_moe/cutlass_moe.py`
- `vllm/model_executor/layers/fused_moe/deep_gemm_moe.py`
- `vllm/model_executor/layers/fused_moe/fused_batched_moe.py`
- `vllm/model_executor/layers/fused_moe/fused_moe.py`
- `vllm/model_executor/layers/fused_moe/layer.py`
- `vllm/model_executor/layers/fused_moe/modular_kernel.py`
- `vllm/model_executor/layers/fused_moe/pplx_prepare_finalize.py`
- `vllm/model_executor/layers/fused_moe/triton_deep_gemm_moe.py`
- `vllm/model_executor/layers/quantization/compressed_tensors/compressed_tensors_moe.py`
- `vllm/model_executor/layers/quantization/fp8.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-18762`
