---
id: pr-vllm-38065
repo: vllm-project/vllm
pr: 38065
title: '[Perf] FP8 FlashInfer Attn for ViT'
author: zhandaz
date: '2026-04-27'
url: https://github.com/vllm-project/vllm/pull/38065
source_category: upstream-code
architectures:
- sm100
- sm90
tags:
- FlashInfer
- attention_kv
- benchmark kernel
- benchmark_test
- fp8
- gemm_quant
- hopper
- quantization kernel
techniques:
- fine-grained-quantization
hardware_features:
- fp4
- fp8
- hopper
- nvfp4
kernel_types:
- attention
- gemm
languages:
- cuda-cpp
- triton
captured_at: '2026-05-16'
status: merged
merge_sha: 5d5c7764446da0d4888add9a060604e376e4e856
inclusion_reason: Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.
changed_paths:
- benchmarks/kernels/benchmark_vit_fp8_attn.py
- docs/features/quantization/README.md
- docs/features/quantization/fp8_vit_attn.md
- tests/config/test_multimodal_config.py
- tests/kernels/core/test_vit_fp8_attn.py
- tests/kernels/core/test_vit_fp8_quant.py
- tests/kernels/core/test_vit_fp8_scaling.py
- vllm/config/model.py
- vllm/config/multimodal.py
- vllm/engine/arg_utils.py
- vllm/kernels/triton/__init__.py
- vllm/kernels/triton/qkv_padded_fp8_quant.py
- vllm/model_executor/layers/attention/mm_encoder_attention.py
- vllm/model_executor/model_loader/utils.py
- vllm/model_executor/models/qwen3_vl.py
- vllm/model_executor/models/vision.py
- vllm/utils/flashinfer.py
- vllm/v1/attention/ops/vit_attn_wrappers.py
artifact_dir: evidence/pull-bundles/vllm/gh-38065
head_ref_oid: b5676c1153508d8231e92bd87b0c3bfb747e7071
---
# [Perf] FP8 FlashInfer Attn for ViT

- Repository: `vllm-project/vllm`
- PR: [38065](https://github.com/vllm-project/vllm/pull/38065)
- Decision: `Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.`
- Reason: Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.

## Changed Paths

- `benchmarks/kernels/benchmark_vit_fp8_attn.py`
- `docs/features/quantization/README.md`
- `docs/features/quantization/fp8_vit_attn.md`
- `tests/config/test_multimodal_config.py`
- `tests/kernels/core/test_vit_fp8_attn.py`
- `tests/kernels/core/test_vit_fp8_quant.py`
- `tests/kernels/core/test_vit_fp8_scaling.py`
- `vllm/config/model.py`
- `vllm/config/multimodal.py`
- `vllm/engine/arg_utils.py`
- `vllm/kernels/triton/__init__.py`
- `vllm/kernels/triton/qkv_padded_fp8_quant.py`
- `vllm/model_executor/layers/attention/mm_encoder_attention.py`
- `vllm/model_executor/model_loader/utils.py`
- `vllm/model_executor/models/qwen3_vl.py`
- `vllm/model_executor/models/vision.py`
- `vllm/utils/flashinfer.py`
- `vllm/v1/attention/ops/vit_attn_wrappers.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-38065`
