---
id: pr-vllm-29941
repo: vllm-project/vllm
pr: 29941
title: '[offloader] v2: Hide weight onloading latency via prefetching'
author: minosfuture
date: '2026-02-26'
url: https://github.com/vllm-project/vllm/pull/29941
source_category: upstream-code
architectures:
- sm100
tags: []
techniques: []
hardware_features: []
kernel_types: []
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: 6831650c40ac3a34f049e285d9ad6b87daddbe00
inclusion_reason: include
changed_paths:
- .buildkite/scripts/scheduled_integration_test/deepseek_v2_lite_prefetch_offload.sh
- .buildkite/test_areas/e2e_integration.yaml
- tests/basic_correctness/test_prefetch_offload.py
- vllm/compilation/cuda_graph.py
- vllm/config/__init__.py
- vllm/config/cache.py
- vllm/config/offload.py
- vllm/config/vllm.py
- vllm/engine/arg_utils.py
- vllm/entrypoints/llm.py
- vllm/model_executor/models/utils.py
- vllm/model_executor/offloader/__init__.py
- vllm/model_executor/offloader/base.py
- vllm/model_executor/offloader/prefetch.py
- vllm/model_executor/offloader/prefetch_ops.py
- vllm/model_executor/offloader/uva.py
- vllm/v1/worker/gpu/cudagraph_utils.py
- vllm/v1/worker/gpu/spec_decode/eagle/cudagraph.py
- vllm/v1/worker/gpu_model_runner.py
- vllm/v1/worker/gpu_ubatch_wrapper.py
artifact_dir: evidence/pull-bundles/vllm/gh-29941
head_ref_oid: 0478a6a89daef89f418f7244163e5a6f3770647b
---
# [offloader] v2: Hide weight onloading latency via prefetching

- Repository: `vllm-project/vllm`
- PR: [29941](https://github.com/vllm-project/vllm/pull/29941)
- Decision: `include`
- Reason: include

## Changed Paths

- `.buildkite/scripts/scheduled_integration_test/deepseek_v2_lite_prefetch_offload.sh`
- `.buildkite/test_areas/e2e_integration.yaml`
- `tests/basic_correctness/test_prefetch_offload.py`
- `vllm/compilation/cuda_graph.py`
- `vllm/config/__init__.py`
- `vllm/config/cache.py`
- `vllm/config/offload.py`
- `vllm/config/vllm.py`
- `vllm/engine/arg_utils.py`
- `vllm/entrypoints/llm.py`
- `vllm/model_executor/models/utils.py`
- `vllm/model_executor/offloader/__init__.py`
- `vllm/model_executor/offloader/base.py`
- `vllm/model_executor/offloader/prefetch.py`
- `vllm/model_executor/offloader/prefetch_ops.py`
- `vllm/model_executor/offloader/uva.py`
- `vllm/v1/worker/gpu/cudagraph_utils.py`
- `vllm/v1/worker/gpu/spec_decode/eagle/cudagraph.py`
- `vllm/v1/worker/gpu_model_runner.py`
- `vllm/v1/worker/gpu_ubatch_wrapper.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-29941`
