---
id: pr-vllm-41664
repo: vllm-project/vllm
pr: 41664
title: '[MXFP4] Support for linear layers + compressed-tensors integration'
author: dsikka
date: '2026-05-12'
url: https://github.com/vllm-project/vllm/pull/41664
source_category: upstream-code
architectures:
- sm100
tags:
- FlashInfer
- Marlin
- cutlass
- fp4
- gemm_quant
- mxfp4
- nvfp4
- quantization kernel
- sm100
techniques:
- fine-grained-quantization
hardware_features:
- blackwell
- fp4
- mxfp4
- nvfp4
kernel_types:
- gemm
- moe
languages:
- cuda-cpp
- cute-dsl
captured_at: '2026-05-16'
status: merged
merge_sha: a7b801e26d6b9d96bb49e939c0b6b3acf1d85796
inclusion_reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.
changed_paths:
- tests/quantization/test_compressed_tensors.py
- vllm/model_executor/kernels/linear/__init__.py
- vllm/model_executor/kernels/linear/mxfp4/__init__.py
- vllm/model_executor/kernels/linear/mxfp4/base.py
- vllm/model_executor/kernels/linear/mxfp4/flashinfer.py
- vllm/model_executor/kernels/linear/mxfp4/marlin.py
- vllm/model_executor/layers/quantization/compressed_tensors/compressed_tensors.py
- vllm/model_executor/layers/quantization/compressed_tensors/compressed_tensors_moe/compressed_tensors_moe_w4a4_mxfp4.py
- vllm/model_executor/layers/quantization/compressed_tensors/schemes/__init__.py
- vllm/model_executor/layers/quantization/compressed_tensors/schemes/compressed_tensors_w4a4_mxfp4.py
- vllm/utils/flashinfer.py
artifact_dir: evidence/pull-bundles/vllm/gh-41664
head_ref_oid: ece7377650659cb2896ea0fe1898871659b7f583
---
# [MXFP4] Support for linear layers + compressed-tensors integration

- Repository: `vllm-project/vllm`
- PR: [41664](https://github.com/vllm-project/vllm/pull/41664)
- Decision: `Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.`
- Reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.

## Changed Paths

- `tests/quantization/test_compressed_tensors.py`
- `vllm/model_executor/kernels/linear/__init__.py`
- `vllm/model_executor/kernels/linear/mxfp4/__init__.py`
- `vllm/model_executor/kernels/linear/mxfp4/base.py`
- `vllm/model_executor/kernels/linear/mxfp4/flashinfer.py`
- `vllm/model_executor/kernels/linear/mxfp4/marlin.py`
- `vllm/model_executor/layers/quantization/compressed_tensors/compressed_tensors.py`
- `vllm/model_executor/layers/quantization/compressed_tensors/compressed_tensors_moe/compressed_tensors_moe_w4a4_mxfp4.py`
- `vllm/model_executor/layers/quantization/compressed_tensors/schemes/__init__.py`
- `vllm/model_executor/layers/quantization/compressed_tensors/schemes/compressed_tensors_w4a4_mxfp4.py`
- `vllm/utils/flashinfer.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-41664`
