---
id: pr-vllm-34758
repo: vllm-project/vllm
pr: 34758
title: '[Model Bash] DeepSeek R1 BF16 Min Latency QKV A GEMM (0.5% E2E Speedup)'
author: robertgshaw2-redhat
date: '2026-02-18'
url: https://github.com/vllm-project/vllm/pull/34758
source_category: upstream-code
architectures:
- sm90
tags:
- attention_kv
- benchmark_test
- csrc kernel
- gemm_quant
- hopper
- sm90
techniques:
- fine-grained-quantization
- kernel-fusion
hardware_features:
- hopper
- pdl
kernel_types:
- attention
- gemm
- mla
languages:
- cuda-cpp
captured_at: '2026-05-16'
status: merged
merge_sha: 6874638bc443ae99ee900072e0bb039fa5f7f0e7
inclusion_reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.
changed_paths:
- CMakeLists.txt
- csrc/dsv3_fused_a_gemm.cu
- csrc/ops.h
- csrc/torch_bindings.cpp
- vllm/_custom_ops.py
- vllm/model_executor/layers/mla.py
- vllm/model_executor/models/deepseek_v2.py
artifact_dir: evidence/pull-bundles/vllm/gh-34758
head_ref_oid: c354d751eed3c38c8f33e6866ebcc2e5f8f57187
---
# [Model Bash] DeepSeek R1 BF16 Min Latency QKV A GEMM (0.5% E2E Speedup)

- Repository: `vllm-project/vllm`
- PR: [34758](https://github.com/vllm-project/vllm/pull/34758)
- Decision: `Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.`
- Reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.

## Changed Paths

- `CMakeLists.txt`
- `csrc/dsv3_fused_a_gemm.cu`
- `csrc/ops.h`
- `csrc/torch_bindings.cpp`
- `vllm/_custom_ops.py`
- `vllm/model_executor/layers/mla.py`
- `vllm/model_executor/models/deepseek_v2.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-34758`
