---
id: pr-vllm-41566
repo: vllm-project/vllm
pr: 41566
title: '[Quantization] Rework quantization_config to use QuantKey and allow for activation override'
author: mgoin
date: '2026-05-13'
url: https://github.com/vllm-project/vllm/pull/41566
source_category: upstream-code
architectures:
- sm100
- sm90
tags:
- FlashInfer
- Marlin
- MoE kernel
- blackwell
- cutlass
- fp8
- gemm_quant
- hopper
- mxfp4
- nvfp4
- quantization kernel
techniques:
- fine-grained-quantization
- kernel-fusion
hardware_features:
- blackwell
- fp4
- fp8
- hopper
- mxfp4
- nvfp4
kernel_types:
- gemm
- moe
languages:
- cuda-cpp
- cute-dsl
captured_at: '2026-05-16'
status: merged
merge_sha: 8efd508204e5a3f55a27407f39869ccd8b1c1af9
inclusion_reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.
changed_paths:
- docs/features/quantization/online.md
- tests/compile/fusions_e2e/conftest.py
- tests/compile/fusions_e2e/models.py
- tests/evals/gpt_oss/configs/gpt-oss-20b-flashinfer-mxfp4-mxfp8-cutlass.yaml
- tests/evals/gpt_oss/configs/gpt-oss-20b-sm100-fi-mxfp4-mxfp8-trtllm.yaml
- tests/quantization/test_blackwell_moe.py
- tests/quantization/test_online.py
- tests/quantization/test_quantization_config_args.py
- vllm/config/model.py
- vllm/config/quantization.py
- vllm/engine/arg_utils.py
- vllm/entrypoints/llm.py
- vllm/model_executor/layers/fused_moe/oracle/mxfp4.py
- vllm/model_executor/layers/quantization/__init__.py
- vllm/model_executor/layers/quantization/online/base.py
- vllm/model_executor/model_loader/weight_utils.py
artifact_dir: evidence/pull-bundles/vllm/gh-41566
head_ref_oid: f46acbf700f48c7f54f03b55bcc29d3abe55e044
---
# [Quantization] Rework quantization_config to use QuantKey and allow for activation override

- Repository: `vllm-project/vllm`
- PR: [41566](https://github.com/vllm-project/vllm/pull/41566)
- Decision: `Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.`
- Reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.

## Changed Paths

- `docs/features/quantization/online.md`
- `tests/compile/fusions_e2e/conftest.py`
- `tests/compile/fusions_e2e/models.py`
- `tests/evals/gpt_oss/configs/gpt-oss-20b-flashinfer-mxfp4-mxfp8-cutlass.yaml`
- `tests/evals/gpt_oss/configs/gpt-oss-20b-sm100-fi-mxfp4-mxfp8-trtllm.yaml`
- `tests/quantization/test_blackwell_moe.py`
- `tests/quantization/test_online.py`
- `tests/quantization/test_quantization_config_args.py`
- `vllm/config/model.py`
- `vllm/config/quantization.py`
- `vllm/engine/arg_utils.py`
- `vllm/entrypoints/llm.py`
- `vllm/model_executor/layers/fused_moe/oracle/mxfp4.py`
- `vllm/model_executor/layers/quantization/__init__.py`
- `vllm/model_executor/layers/quantization/online/base.py`
- `vllm/model_executor/model_loader/weight_utils.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-41566`
