---
id: pr-vllm-38460
repo: vllm-project/vllm
pr: 38460
title: '[Perf] Batch KV cache swap copies via cuMemcpyBatchAsync'
author: Etelis
date: '2026-04-03'
url: https://github.com/vllm-project/vllm/pull/38460
source_category: upstream-code
architectures:
- sm100
tags:
- gemm
techniques: []
hardware_features: []
kernel_types:
- gemm
languages:
- cuda-cpp
captured_at: '2026-04-17'
status: merged
merge_sha: 4a06e1246e30214d644a1732d6853cfe2b935a75
inclusion_reason: kernel file changes
changed_paths:
- csrc/cache.h
- csrc/cache_kernels.cu
- csrc/torch_bindings.cpp
- vllm/_custom_ops.py
- vllm/v1/kv_offload/worker/cpu_gpu.py
head_ref_oid: 15ab2fe6a2fe7459283899a11f76bfa987befb21
artifact_dir: evidence/pull-bundles/vllm/gh-38460
---
# [Perf] Batch KV cache swap copies via cuMemcpyBatchAsync

- Repository: `vllm-project/vllm`
- PR: [38460](https://github.com/vllm-project/vllm/pull/38460)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `csrc/cache.h`
- `csrc/cache_kernels.cu`
- `csrc/torch_bindings.cpp`
- `vllm/_custom_ops.py`
- `vllm/v1/kv_offload/worker/cpu_gpu.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-38460`
