---
id: pr-vllm-31415
repo: vllm-project/vllm
pr: 31415
title: '[MoE Refactor][15/N] Apply Refactor to Fp8'
author: robertgshaw2-redhat
date: '2026-01-08'
url: https://github.com/vllm-project/vllm/pull/31415
source_category: upstream-code
architectures:
- sm100
tags: []
techniques: []
hardware_features: []
kernel_types: []
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: 5dcd7ef1f219068e6b6be5b614bc43978f028651
inclusion_reason: defer
changed_paths:
- .buildkite/test-pipeline.yaml
- benchmarks/kernels/benchmark_cutlass_moe_fp8.py
- benchmarks/kernels/benchmark_grouped_gemm_cutlass.py
- benchmarks/kernels/benchmark_moe.py
- docs/design/moe_kernel_features.md
- tests/evals/gsm8k/configs/moe-refactor-dp-ep/Llama-4-Scout-Fp8-ModelOpt-triton.yaml
- tests/evals/gsm8k/configs/moe-refactor-dp-ep/Qwen3-30B-A3B-Fp8-AutoFp8-deepgemm-deepep-ht.yaml
- tests/evals/gsm8k/configs/moe-refactor-dp-ep/Qwen3-30B-A3B-Fp8-AutoFp8-deepgemm-deepep-ll.yaml
- tests/evals/gsm8k/configs/moe-refactor-dp-ep/Qwen3-30B-A3B-Fp8-AutoFp8-deepgemm.yaml
- tests/evals/gsm8k/configs/moe-refactor-dp-ep/Qwen3-30B-A3B-Fp8-CT-Block-deepgemm-deepep-ht.yaml
- tests/evals/gsm8k/configs/moe-refactor-dp-ep/Qwen3-30B-A3B-Fp8-CT-Block-deepgemm-deepep-ll.yaml
- tests/evals/gsm8k/configs/moe-refactor-dp-ep/Qwen3-30B-A3B-Fp8-CT-Block-deepgemm.yaml
- tests/evals/gsm8k/configs/moe-refactor-dp-ep/Qwen3-30B-A3B-NvFp4-CT-fi-cutlass.yaml
- tests/evals/gsm8k/configs/moe-refactor-dp-ep/config-b200.txt
- tests/evals/gsm8k/configs/moe-refactor/Llama-4-Scout-Fp8-CT-vllm-cutlass.yaml
- tests/evals/gsm8k/configs/moe-refactor/Qwen3-30B-A3B-Fp8-CT-Block-triton.yaml
- tests/evals/gsm8k/configs/moe-refactor/config-b200.txt
- tests/evals/gsm8k/configs/moe-refactor/config-h100.txt
- tests/evals/gsm8k/test_gsm8k_correctness.py
- tests/kernels/moe/test_cutlass_moe.py
- tests/kernels/moe/test_flashinfer.py
- tests/quantization/test_fp8.py
- vllm/model_executor/layers/fused_moe/__init__.py
- vllm/model_executor/layers/fused_moe/cutlass_moe.py
- vllm/model_executor/layers/fused_moe/fallback.py
- vllm/model_executor/layers/fused_moe/flashinfer_trtllm_moe.py
- vllm/model_executor/layers/fused_moe/oracle/__init__.py
- vllm/model_executor/layers/fused_moe/oracle/fp8.py
- vllm/model_executor/layers/fused_moe/triton_cutlass_moe.py
- vllm/model_executor/layers/fused_moe/triton_deep_gemm_moe.py
- vllm/model_executor/layers/quantization/compressed_tensors/compressed_tensors_moe.py
- vllm/model_executor/layers/quantization/fp8.py
- vllm/model_executor/layers/quantization/modelopt.py
- vllm/model_executor/layers/quantization/quark/quark_moe.py
- vllm/model_executor/layers/quantization/utils/flashinfer_utils.py
- vllm/model_executor/layers/quantization/utils/fp8_utils.py
- vllm/model_executor/layers/quantization/utils/marlin_utils.py
- vllm/model_executor/layers/quantization/utils/marlin_utils_fp8.py
artifact_dir: evidence/pull-bundles/vllm/gh-31415
head_ref_oid: 5dccfc638f772ddd00f84cf721744700d5cfe423
---
# [MoE Refactor][15/N] Apply Refactor to Fp8

- Repository: `vllm-project/vllm`
- PR: [31415](https://github.com/vllm-project/vllm/pull/31415)
- Decision: `defer`
- Reason: defer

## Changed Paths

- `.buildkite/test-pipeline.yaml`
- `benchmarks/kernels/benchmark_cutlass_moe_fp8.py`
- `benchmarks/kernels/benchmark_grouped_gemm_cutlass.py`
- `benchmarks/kernels/benchmark_moe.py`
- `docs/design/moe_kernel_features.md`
- `tests/evals/gsm8k/configs/moe-refactor-dp-ep/Llama-4-Scout-Fp8-ModelOpt-triton.yaml`
- `tests/evals/gsm8k/configs/moe-refactor-dp-ep/Qwen3-30B-A3B-Fp8-AutoFp8-deepgemm-deepep-ht.yaml`
- `tests/evals/gsm8k/configs/moe-refactor-dp-ep/Qwen3-30B-A3B-Fp8-AutoFp8-deepgemm-deepep-ll.yaml`
- `tests/evals/gsm8k/configs/moe-refactor-dp-ep/Qwen3-30B-A3B-Fp8-AutoFp8-deepgemm.yaml`
- `tests/evals/gsm8k/configs/moe-refactor-dp-ep/Qwen3-30B-A3B-Fp8-CT-Block-deepgemm-deepep-ht.yaml`
- `tests/evals/gsm8k/configs/moe-refactor-dp-ep/Qwen3-30B-A3B-Fp8-CT-Block-deepgemm-deepep-ll.yaml`
- `tests/evals/gsm8k/configs/moe-refactor-dp-ep/Qwen3-30B-A3B-Fp8-CT-Block-deepgemm.yaml`
- `tests/evals/gsm8k/configs/moe-refactor-dp-ep/Qwen3-30B-A3B-NvFp4-CT-fi-cutlass.yaml`
- `tests/evals/gsm8k/configs/moe-refactor-dp-ep/config-b200.txt`
- `tests/evals/gsm8k/configs/moe-refactor/Llama-4-Scout-Fp8-CT-vllm-cutlass.yaml`
- `tests/evals/gsm8k/configs/moe-refactor/Qwen3-30B-A3B-Fp8-CT-Block-triton.yaml`
- `tests/evals/gsm8k/configs/moe-refactor/config-b200.txt`
- `tests/evals/gsm8k/configs/moe-refactor/config-h100.txt`
- `tests/evals/gsm8k/test_gsm8k_correctness.py`
- `tests/kernels/moe/test_cutlass_moe.py`
- `tests/kernels/moe/test_flashinfer.py`
- `tests/quantization/test_fp8.py`
- `vllm/model_executor/layers/fused_moe/__init__.py`
- `vllm/model_executor/layers/fused_moe/cutlass_moe.py`
- `vllm/model_executor/layers/fused_moe/fallback.py`
- `vllm/model_executor/layers/fused_moe/flashinfer_trtllm_moe.py`
- `vllm/model_executor/layers/fused_moe/oracle/__init__.py`
- `vllm/model_executor/layers/fused_moe/oracle/fp8.py`
- `vllm/model_executor/layers/fused_moe/triton_cutlass_moe.py`
- `vllm/model_executor/layers/fused_moe/triton_deep_gemm_moe.py`
- `vllm/model_executor/layers/quantization/compressed_tensors/compressed_tensors_moe.py`
- `vllm/model_executor/layers/quantization/fp8.py`
- `vllm/model_executor/layers/quantization/modelopt.py`
- `vllm/model_executor/layers/quantization/quark/quark_moe.py`
- `vllm/model_executor/layers/quantization/utils/flashinfer_utils.py`
- `vllm/model_executor/layers/quantization/utils/fp8_utils.py`
- `vllm/model_executor/layers/quantization/utils/marlin_utils.py`
- `vllm/model_executor/layers/quantization/utils/marlin_utils_fp8.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-31415`
