---
id: pr-vllm-37332
repo: vllm-project/vllm
pr: 37332
title: Add nvfp4 support to reshape_and_cache_flash
author: sychen52
date: '2026-04-17'
url: https://github.com/vllm-project/vllm/pull/37332
source_category: upstream-code
architectures:
- sm100
tags:
- attention_kv
- gemm_quant
- memory_primitives
- nvfp4
techniques:
- cache-policy
- fine-grained-quantization
hardware_features:
- fp4
- nvfp4
kernel_types:
- attention
- gemm
- memory
languages:
- cuda-cpp
captured_at: '2026-05-16'
status: merged
merge_sha: 6b2b7bd0ebd43ef756632d2142ce974929f05d8f
inclusion_reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.
changed_paths:
- CMakeLists.txt
- csrc/cache_kernels.cu
- csrc/nvfp4_kv_cache_kernels.cu
- tests/kernels/attention/test_cache.py
- tests/kernels/quantization/nvfp4_utils.py
- vllm/config/cache.py
- vllm/model_executor/layers/attention/attention.py
- vllm/utils/torch_utils.py
- vllm/v1/attention/backends/flashinfer.py
- vllm/v1/kv_cache_interface.py
artifact_dir: evidence/pull-bundles/vllm/gh-37332
head_ref_oid: 54c34587c7d670b6ca8217e520e51e48a747e7b5
---
# Add nvfp4 support to reshape_and_cache_flash

- Repository: `vllm-project/vllm`
- PR: [37332](https://github.com/vllm-project/vllm/pull/37332)
- Decision: `Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.`
- Reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.

## Changed Paths

- `CMakeLists.txt`
- `csrc/cache_kernels.cu`
- `csrc/nvfp4_kv_cache_kernels.cu`
- `tests/kernels/attention/test_cache.py`
- `tests/kernels/quantization/nvfp4_utils.py`
- `vllm/config/cache.py`
- `vllm/model_executor/layers/attention/attention.py`
- `vllm/utils/torch_utils.py`
- `vllm/v1/attention/backends/flashinfer.py`
- `vllm/v1/kv_cache_interface.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-37332`
