---
id: pr-vllm-30684
repo: vllm-project/vllm
pr: 30684
title: '[MM Encoder]: Migrate legacy ViT `MultiHeadAttention` to new `MMEncoderAttention` interface'
author: Isotr0py
date: '2025-12-18'
url: https://github.com/vllm-project/vllm/pull/30684
source_category: upstream-code
architectures:
- sm100
tags: []
techniques: []
hardware_features: []
kernel_types: []
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: 700a5ad6c616358f42db7d9b55e8bc9caa140ca5
inclusion_reason: defer
changed_paths:
- tests/kernels/attention/test_attention.py
- tests/kernels/attention/test_mha_attn.py
- tests/v1/tpu/test_mha_attn.py
- vllm/attention/layer.py
- vllm/attention/layers/mm_encoder_attention.py
- vllm/attention/ops/vit_attn_wrappers.py
- vllm/model_executor/models/aimv2.py
- vllm/model_executor/models/blip.py
- vllm/model_executor/models/clip.py
- vllm/model_executor/models/deepencoder.py
- vllm/model_executor/models/glm4v.py
- vllm/model_executor/models/hunyuan_vision.py
- vllm/model_executor/models/idefics2_vision_model.py
- vllm/model_executor/models/intern_vit.py
- vllm/model_executor/models/interns1_vit.py
- vllm/model_executor/models/mllama4.py
- vllm/model_executor/models/molmo.py
- vllm/model_executor/models/siglip.py
- vllm/model_executor/models/step3_vl.py
- vllm/model_executor/models/whisper.py
artifact_dir: evidence/pull-bundles/vllm/gh-30684
head_ref_oid: 1aa79eedec9684d263898e0a21ac3f72a457f652
---
# [MM Encoder]: Migrate legacy ViT `MultiHeadAttention` to new `MMEncoderAttention` interface

- Repository: `vllm-project/vllm`
- PR: [30684](https://github.com/vllm-project/vllm/pull/30684)
- Decision: `defer`
- Reason: defer

## Changed Paths

- `tests/kernels/attention/test_attention.py`
- `tests/kernels/attention/test_mha_attn.py`
- `tests/v1/tpu/test_mha_attn.py`
- `vllm/attention/layer.py`
- `vllm/attention/layers/mm_encoder_attention.py`
- `vllm/attention/ops/vit_attn_wrappers.py`
- `vllm/model_executor/models/aimv2.py`
- `vllm/model_executor/models/blip.py`
- `vllm/model_executor/models/clip.py`
- `vllm/model_executor/models/deepencoder.py`
- `vllm/model_executor/models/glm4v.py`
- `vllm/model_executor/models/hunyuan_vision.py`
- `vllm/model_executor/models/idefics2_vision_model.py`
- `vllm/model_executor/models/intern_vit.py`
- `vllm/model_executor/models/interns1_vit.py`
- `vllm/model_executor/models/mllama4.py`
- `vllm/model_executor/models/molmo.py`
- `vllm/model_executor/models/siglip.py`
- `vllm/model_executor/models/step3_vl.py`
- `vllm/model_executor/models/whisper.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-30684`
