---
id: pr-vllm-41986
repo: vllm-project/vllm
pr: 41986
title: '[Bugfix] Add swiglu limits to deepgemm fp8 methods'
author: zyongye
date: '2026-05-14'
url: https://github.com/vllm-project/vllm/pull/41986
source_category: upstream-code
architectures:
- sm100
tags:
- DeepGEMM
- fp8
- gemm_quant
- mxfp4
- quantization kernel
techniques:
- fine-grained-quantization
- kernel-fusion
hardware_features:
- fp4
- fp8
- mxfp4
kernel_types:
- gemm
- moe
languages:
- cuda-cpp
captured_at: '2026-05-16'
status: merged
merge_sha: f8848b2f2da56418480fa4be1a8a9adbe4b960b4
inclusion_reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.
changed_paths:
- tests/kernels/moe/test_silu_mul_per_token_group_quant_fp8_colmajor.py
- vllm/model_executor/layers/fused_moe/config.py
- vllm/model_executor/layers/fused_moe/experts/deep_gemm_moe.py
- vllm/model_executor/layers/fused_moe/oracle/fp8.py
- vllm/model_executor/layers/fused_moe/oracle/mxfp4.py
- vllm/model_executor/layers/quantization/compressed_tensors/compressed_tensors_moe/compressed_tensors_moe_w8a8_fp8.py
- vllm/model_executor/layers/quantization/compressed_tensors/compressed_tensors_moe/compressed_tensors_moe_w8a8_mxfp8.py
- vllm/model_executor/layers/quantization/fp8.py
- vllm/model_executor/layers/quantization/modelopt.py
- vllm/model_executor/layers/quantization/online/fp8.py
- vllm/model_executor/layers/quantization/online/mxfp8.py
- vllm/model_executor/layers/quantization/quark/quark_moe.py
- vllm/model_executor/layers/quantization/utils/fp8_utils.py
artifact_dir: evidence/pull-bundles/vllm/gh-41986
head_ref_oid: 14ee72a81b6614d7c307b75890dbf5e508698096
---
# [Bugfix] Add swiglu limits to deepgemm fp8 methods

- Repository: `vllm-project/vllm`
- PR: [41986](https://github.com/vllm-project/vllm/pull/41986)
- Decision: `Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.`
- Reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.

## Changed Paths

- `tests/kernels/moe/test_silu_mul_per_token_group_quant_fp8_colmajor.py`
- `vllm/model_executor/layers/fused_moe/config.py`
- `vllm/model_executor/layers/fused_moe/experts/deep_gemm_moe.py`
- `vllm/model_executor/layers/fused_moe/oracle/fp8.py`
- `vllm/model_executor/layers/fused_moe/oracle/mxfp4.py`
- `vllm/model_executor/layers/quantization/compressed_tensors/compressed_tensors_moe/compressed_tensors_moe_w8a8_fp8.py`
- `vllm/model_executor/layers/quantization/compressed_tensors/compressed_tensors_moe/compressed_tensors_moe_w8a8_mxfp8.py`
- `vllm/model_executor/layers/quantization/fp8.py`
- `vllm/model_executor/layers/quantization/modelopt.py`
- `vllm/model_executor/layers/quantization/online/fp8.py`
- `vllm/model_executor/layers/quantization/online/mxfp8.py`
- `vllm/model_executor/layers/quantization/quark/quark_moe.py`
- `vllm/model_executor/layers/quantization/utils/fp8_utils.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-41986`
