---
id: pr-vllm-27532
repo: vllm-project/vllm
pr: 27532
title: '[Attention] Use sparse prefill kernel for fp8 kv-cache in DeepSeek-v3.2'
author: LucasWilkinson
date: '2025-12-12'
url: https://github.com/vllm-project/vllm/pull/27532
source_category: upstream-code
architectures:
- sm100
tags:
- attention
- fp4
- fp8
- gemm
- kernel-fusion
- mla
- moe
- nvfp4
- prefill
techniques:
- kernel-fusion
hardware_features:
- fp4
- fp8
- nvfp4
kernel_types:
- attention
- gemm
- mla
- moe
- prefill
languages:
- cuda-cpp
- triton
captured_at: '2026-04-27'
status: merged
merge_sha: 3e41992fecdc31ee60715bb350f18fec18ed6680
inclusion_reason: kernel file changes
changed_paths:
- csrc/cache.h
- csrc/cache_kernels.cu
- csrc/torch_bindings.cpp
- tests/conftest.py
- tests/kernels/moe/test_batched_deepgemm.py
- tests/kernels/moe/test_batched_moe.py
- tests/kernels/moe/test_block_fp8.py
- tests/kernels/moe/test_cutlass_moe.py
- tests/kernels/moe/test_deepep_deepgemm_moe.py
- tests/kernels/moe/test_deepep_moe.py
- tests/kernels/moe/test_deepgemm.py
- tests/kernels/moe/test_flashinfer.py
- tests/kernels/moe/test_flashinfer_moe.py
- tests/kernels/moe/test_gpt_oss_triton_kernels.py
- tests/kernels/moe/test_modular_kernel_combinations.py
- tests/kernels/moe/test_modular_oai_triton_moe.py
- tests/kernels/moe/test_moe.py
- tests/kernels/moe/test_nvfp4_moe.py
- tests/kernels/moe/test_pplx_moe.py
- tests/v1/attention/test_sparse_mla_backends.py
- vllm/_custom_ops.py
- vllm/envs.py
- vllm/model_executor/layers/fused_moe/modular_kernel.py
- vllm/model_executor/models/deepseek_v2.py
- vllm/v1/attention/backends/mla/flashmla_sparse.py
- vllm/v1/attention/backends/mla/indexer.py
- vllm/v1/attention/backends/utils.py
- vllm/v1/worker/gpu_model_runner.py
- vllm/v1/worker/gpu_worker.py
- vllm/v1/worker/workspace.py
head_ref_oid: 14dd4fe396f4c06aa654b27ff55338df7962efe7
artifact_dir: evidence/pull-bundles/vllm/gh-27532
---
# [Attention] Use sparse prefill kernel for fp8 kv-cache in DeepSeek-v3.2

- Repository: `vllm-project/vllm`
- PR: [27532](https://github.com/vllm-project/vllm/pull/27532)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `csrc/cache.h`
- `csrc/cache_kernels.cu`
- `csrc/torch_bindings.cpp`
- `tests/conftest.py`
- `tests/kernels/moe/test_batched_deepgemm.py`
- `tests/kernels/moe/test_batched_moe.py`
- `tests/kernels/moe/test_block_fp8.py`
- `tests/kernels/moe/test_cutlass_moe.py`
- `tests/kernels/moe/test_deepep_deepgemm_moe.py`
- `tests/kernels/moe/test_deepep_moe.py`
- `tests/kernels/moe/test_deepgemm.py`
- `tests/kernels/moe/test_flashinfer.py`
- `tests/kernels/moe/test_flashinfer_moe.py`
- `tests/kernels/moe/test_gpt_oss_triton_kernels.py`
- `tests/kernels/moe/test_modular_kernel_combinations.py`
- `tests/kernels/moe/test_modular_oai_triton_moe.py`
- `tests/kernels/moe/test_moe.py`
- `tests/kernels/moe/test_nvfp4_moe.py`
- `tests/kernels/moe/test_pplx_moe.py`
- `tests/v1/attention/test_sparse_mla_backends.py`
- `vllm/_custom_ops.py`
- `vllm/envs.py`
- `vllm/model_executor/layers/fused_moe/modular_kernel.py`
- `vllm/model_executor/models/deepseek_v2.py`
- `vllm/v1/attention/backends/mla/flashmla_sparse.py`
- `vllm/v1/attention/backends/mla/indexer.py`
- `vllm/v1/attention/backends/utils.py`
- `vllm/v1/worker/gpu_model_runner.py`
- `vllm/v1/worker/gpu_worker.py`
- `vllm/v1/worker/workspace.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-27532`
