---
id: pr-vllm-40941
repo: vllm-project/vllm
pr: 40941
title: '[Attention][TurboQuant] Share dequant buffers, eliminate float16_copy'
author: bhoomit
date: '2026-04-27'
url: https://github.com/vllm-project/vllm/pull/40941
source_category: upstream-code
architectures:
- sm100
tags:
- CUDA kernel
- attention_kv
- benchmark kernel
- gemm_quant
- memory_primitives
techniques:
- cache-policy
- fine-grained-quantization
hardware_features: []
kernel_types:
- attention
- decode
- gemm
- memory
languages:
- cuda-cpp
- triton
captured_at: '2026-05-16'
status: merged
merge_sha: 2cc008e7b491bb77f0caf4d27ad55a83f196114c
inclusion_reason: Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.
changed_paths:
- vllm/model_executor/layers/attention/attention.py
- vllm/v1/attention/backends/turboquant_attn.py
- vllm/v1/attention/ops/triton_decode_attention.py
- vllm/v1/attention/ops/triton_turboquant_decode.py
artifact_dir: evidence/pull-bundles/vllm/gh-40941
head_ref_oid: 5f994a914b6f33eb639e34e0f3cd894e441c5b71
---
# [Attention][TurboQuant] Share dequant buffers, eliminate float16_copy

- Repository: `vllm-project/vllm`
- PR: [40941](https://github.com/vllm-project/vllm/pull/40941)
- Decision: `Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.`
- Reason: Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.

## Changed Paths

- `vllm/model_executor/layers/attention/attention.py`
- `vllm/v1/attention/backends/turboquant_attn.py`
- `vllm/v1/attention/ops/triton_decode_attention.py`
- `vllm/v1/attention/ops/triton_turboquant_decode.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-40941`
