---
id: pr-vllm-26835
repo: vllm-project/vllm
pr: 26835
title: Add attention benchmarking tools
author: MatthewBonanni
date: '2026-01-28'
url: https://github.com/vllm-project/vllm/pull/26835
source_category: upstream-code
architectures:
- sm100
tags: []
techniques: []
hardware_features: []
kernel_types: []
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: e82fa448c40bb5a24add0949271813a61f2aa47f
inclusion_reason: defer
changed_paths:
- benchmarks/attention_benchmarks/README.md
- benchmarks/attention_benchmarks/__init__.py
- benchmarks/attention_benchmarks/batch_spec.py
- benchmarks/attention_benchmarks/benchmark.py
- benchmarks/attention_benchmarks/common.py
- benchmarks/attention_benchmarks/configs/mla_decode.yaml
- benchmarks/attention_benchmarks/configs/mla_mixed_batch.yaml
- benchmarks/attention_benchmarks/configs/reorder_threshold.yaml
- benchmarks/attention_benchmarks/configs/speculative_decode.yaml
- benchmarks/attention_benchmarks/configs/standard_attention.yaml
- benchmarks/attention_benchmarks/mla_runner.py
- benchmarks/attention_benchmarks/runner.py
artifact_dir: evidence/pull-bundles/vllm/gh-26835
head_ref_oid: 32e9280c5d5c3563db85b9c435c3db5c73bd61b5
---
# Add attention benchmarking tools

- Repository: `vllm-project/vllm`
- PR: [26835](https://github.com/vllm-project/vllm/pull/26835)
- Decision: `defer`
- Reason: defer

## Changed Paths

- `benchmarks/attention_benchmarks/README.md`
- `benchmarks/attention_benchmarks/__init__.py`
- `benchmarks/attention_benchmarks/batch_spec.py`
- `benchmarks/attention_benchmarks/benchmark.py`
- `benchmarks/attention_benchmarks/common.py`
- `benchmarks/attention_benchmarks/configs/mla_decode.yaml`
- `benchmarks/attention_benchmarks/configs/mla_mixed_batch.yaml`
- `benchmarks/attention_benchmarks/configs/reorder_threshold.yaml`
- `benchmarks/attention_benchmarks/configs/speculative_decode.yaml`
- `benchmarks/attention_benchmarks/configs/standard_attention.yaml`
- `benchmarks/attention_benchmarks/mla_runner.py`
- `benchmarks/attention_benchmarks/runner.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-26835`
