---
id: pr-vllm-36205
repo: vllm-project/vllm
pr: 36205
title: '[mla] Support fused FP8/NVFP4 output quantization in MLA attention (#35792)'
author: carlyou
date: '2026-04-03'
url: https://github.com/vllm-project/vllm/pull/36205
source_category: upstream-code
architectures:
- sm100
tags:
- attention
- fp4
- fp8
- kernel-fusion
- mla
- nvfp4
- quantization
techniques:
- kernel-fusion
hardware_features:
- fp4
- fp8
- nvfp4
kernel_types:
- attention
- mla
- quantization
languages:
- python
captured_at: '2026-04-27'
status: merged
merge_sha: 1f5ec2889c4176593c2fedae3b33b6244c996d29
inclusion_reason: kernel file changes
changed_paths:
- .buildkite/test_areas/compile.yaml
- docs/design/fusions.md
- tests/compile/fusions_e2e/conftest.py
- tests/compile/fusions_e2e/models.py
- tests/compile/fusions_e2e/test_tp1_quant.py
- tests/compile/fusions_e2e/test_tp2_ar_rms.py
- tests/compile/passes/test_mla_attn_quant_fusion.py
- vllm/compilation/passes/fusion/mla_attn_quant_fusion.py
- vllm/compilation/passes/pass_manager.py
- vllm/config/compilation.py
- vllm/model_executor/layers/attention/mla_attention.py
- vllm/v1/attention/backend.py
head_ref_oid: 9ed41065503d3fb848ac5c4cdbfba924f44ec6b3
artifact_dir: evidence/pull-bundles/vllm/gh-36205
---
# [mla] Support fused FP8/NVFP4 output quantization in MLA attention (#35792)

- Repository: `vllm-project/vllm`
- PR: [36205](https://github.com/vllm-project/vllm/pull/36205)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `.buildkite/test_areas/compile.yaml`
- `docs/design/fusions.md`
- `tests/compile/fusions_e2e/conftest.py`
- `tests/compile/fusions_e2e/models.py`
- `tests/compile/fusions_e2e/test_tp1_quant.py`
- `tests/compile/fusions_e2e/test_tp2_ar_rms.py`
- `tests/compile/passes/test_mla_attn_quant_fusion.py`
- `vllm/compilation/passes/fusion/mla_attn_quant_fusion.py`
- `vllm/compilation/passes/pass_manager.py`
- `vllm/config/compilation.py`
- `vllm/model_executor/layers/attention/mla_attention.py`
- `vllm/v1/attention/backend.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-36205`
