---
id: pr-vllm-35850
repo: vllm-project/vllm
pr: 35850
title: '[ROCm] Support MLA with nhead<16 and FP8 KV cache for TP=8 (Kimi K2.5/Linear)'
author: ChuanLi1101
date: '2026-03-06'
url: https://github.com/vllm-project/vllm/pull/35850
source_category: upstream-code
architectures:
- sm100
tags:
- attention
- fp8
- mla
techniques: []
hardware_features:
- fp8
kernel_types:
- attention
- mla
languages:
- python
captured_at: '2026-04-27'
status: merged
merge_sha: c188749bcdaa2c72cc3c8a4a28e722af2abc4bb8
inclusion_reason: kernel file changes
changed_paths:
- vllm/v1/attention/backends/mla/rocm_aiter_mla.py
head_ref_oid: 04adb9e75960f9d87ba99f036ee14f5707e429a9
artifact_dir: evidence/pull-bundles/vllm/gh-35850
---
# [ROCm] Support MLA with nhead<16 and FP8 KV cache for TP=8 (Kimi K2.5/Linear)

- Repository: `vllm-project/vllm`
- PR: [35850](https://github.com/vllm-project/vllm/pull/35850)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `vllm/v1/attention/backends/mla/rocm_aiter_mla.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-35850`
