---
id: pr-vllm-23693
repo: vllm-project/vllm
pr: 23693
title: '[Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM'
author: SageMoore
date: '2025-09-16'
url: https://github.com/vllm-project/vllm/pull/23693
source_category: upstream-code
architectures:
- sm100
tags:
- attention
- decode
- kernel-fusion
- moe
techniques:
- kernel-fusion
hardware_features: []
kernel_types:
- attention
- decode
- moe
languages:
- python
captured_at: '2026-04-27'
status: merged
merge_sha: 567939953b7a9cb0ded6bf0bb21a76917b8fed97
inclusion_reason: kernel file changes
changed_paths:
- examples/offline_inference/data_parallel.py
- tests/v1/attention/test_attention_splitting.py
- tests/v1/spec_decode/test_eagle.py
- vllm/config/__init__.py
- vllm/config/parallel.py
- vllm/distributed/device_communicators/all2all.py
- vllm/engine/arg_utils.py
- vllm/forward_context.py
- vllm/model_executor/layers/fused_moe/deepep_ht_prepare_finalize.py
- vllm/model_executor/layers/fused_moe/deepep_ll_prepare_finalize.py
- vllm/model_executor/layers/fused_moe/layer.py
- vllm/model_executor/layers/fused_moe/modular_kernel.py
- vllm/model_executor/layers/fused_moe/pplx_prepare_finalize.py
- vllm/v1/attention/backends/utils.py
- vllm/v1/spec_decode/eagle.py
- vllm/v1/worker/cpu_model_runner.py
- vllm/v1/worker/gpu_model_runner.py
- vllm/v1/worker/gpu_ubatch_wrapper.py
- vllm/v1/worker/ubatch_splitting.py
- vllm/v1/worker/ubatch_utils.py
- vllm/v1/worker/ubatching.py
- vllm/v1/worker/utils.py
head_ref_oid: 9e86147ac8a287dcd4d7cf4cdcdf37481790a29f
artifact_dir: evidence/pull-bundles/vllm/gh-23693
---
# [Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM

- Repository: `vllm-project/vllm`
- PR: [23693](https://github.com/vllm-project/vllm/pull/23693)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `examples/offline_inference/data_parallel.py`
- `tests/v1/attention/test_attention_splitting.py`
- `tests/v1/spec_decode/test_eagle.py`
- `vllm/config/__init__.py`
- `vllm/config/parallel.py`
- `vllm/distributed/device_communicators/all2all.py`
- `vllm/engine/arg_utils.py`
- `vllm/forward_context.py`
- `vllm/model_executor/layers/fused_moe/deepep_ht_prepare_finalize.py`
- `vllm/model_executor/layers/fused_moe/deepep_ll_prepare_finalize.py`
- `vllm/model_executor/layers/fused_moe/layer.py`
- `vllm/model_executor/layers/fused_moe/modular_kernel.py`
- `vllm/model_executor/layers/fused_moe/pplx_prepare_finalize.py`
- `vllm/v1/attention/backends/utils.py`
- `vllm/v1/spec_decode/eagle.py`
- `vllm/v1/worker/cpu_model_runner.py`
- `vllm/v1/worker/gpu_model_runner.py`
- `vllm/v1/worker/gpu_ubatch_wrapper.py`
- `vllm/v1/worker/ubatch_splitting.py`
- `vllm/v1/worker/ubatch_utils.py`
- `vllm/v1/worker/ubatching.py`
- `vllm/v1/worker/utils.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-23693`
