---
id: pr-vllm-34552
repo: vllm-project/vllm
pr: 34552
title: '[BugFix] Add support for MTP num_speculative_tokens > 1 with sparse MLA'
author: LucasWilkinson
date: '2026-03-03'
url: https://github.com/vllm-project/vllm/pull/34552
source_category: upstream-code
architectures:
- sm100
tags:
- attention
- decode
- mla
techniques: []
hardware_features: []
kernel_types:
- attention
- decode
- mla
languages:
- python
captured_at: '2026-04-27'
status: merged
merge_sha: 28ef9ba399340ea7013df8cd1c359b07acc0a302
inclusion_reason: kernel file changes
changed_paths:
- tests/v1/spec_decode/test_eagle.py
- tests/v1/spec_decode/test_mtp.py
- vllm/model_executor/layers/sparse_attn_indexer.py
- vllm/v1/attention/backends/mla/indexer.py
- vllm/v1/spec_decode/eagle.py
- vllm/v1/worker/gpu_model_runner.py
- vllm/v1/worker/utils.py
head_ref_oid: 7f24f67add7c0b19489ed212d53cff39be8e28b0
artifact_dir: evidence/pull-bundles/vllm/gh-34552
---
# [BugFix] Add support for MTP num_speculative_tokens > 1 with sparse MLA

- Repository: `vllm-project/vllm`
- PR: [34552](https://github.com/vllm-project/vllm/pull/34552)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `tests/v1/spec_decode/test_eagle.py`
- `tests/v1/spec_decode/test_mtp.py`
- `vllm/model_executor/layers/sparse_attn_indexer.py`
- `vllm/v1/attention/backends/mla/indexer.py`
- `vllm/v1/spec_decode/eagle.py`
- `vllm/v1/worker/gpu_model_runner.py`
- `vllm/v1/worker/utils.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-34552`
