---
id: pr-vllm-13591
repo: vllm-project/vllm
pr: 13591
title: '[core] set up data parallel communication'
author: youkaichao
date: '2025-02-22'
url: https://github.com/vllm-project/vllm/pull/13591
source_category: upstream-code
architectures:
- sm100
tags: []
techniques: []
hardware_features: []
kernel_types: []
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: 3e472d882a6071813bf6e683f5b9269e0d1d9678
inclusion_reason: include
changed_paths:
- .buildkite/test-pipeline.yaml
- examples/offline_inference/data_parallel.py
- vllm/config.py
- vllm/distributed/device_communicators/cuda_communicator.py
- vllm/distributed/device_communicators/custom_all_reduce.py
- vllm/distributed/parallel_state.py
- vllm/distributed/utils.py
- vllm/envs.py
- vllm/forward_context.py
- vllm/utils.py
- vllm/v1/engine/core.py
- vllm/v1/engine/core_client.py
- vllm/v1/engine/llm_engine.py
- vllm/v1/executor/multiproc_executor.py
- vllm/v1/worker/gpu_model_runner.py
- vllm/v1/worker/gpu_worker.py
- vllm/worker/worker_base.py
artifact_dir: evidence/pull-bundles/vllm/gh-13591
head_ref_oid: 267cd82b6cdf6720cb8b1c78288a23868fc8b214
---
# [core] set up data parallel communication

- Repository: `vllm-project/vllm`
- PR: [13591](https://github.com/vllm-project/vllm/pull/13591)
- Decision: `include`
- Reason: include

## Changed Paths

- `.buildkite/test-pipeline.yaml`
- `examples/offline_inference/data_parallel.py`
- `vllm/config.py`
- `vllm/distributed/device_communicators/cuda_communicator.py`
- `vllm/distributed/device_communicators/custom_all_reduce.py`
- `vllm/distributed/parallel_state.py`
- `vllm/distributed/utils.py`
- `vllm/envs.py`
- `vllm/forward_context.py`
- `vllm/utils.py`
- `vllm/v1/engine/core.py`
- `vllm/v1/engine/core_client.py`
- `vllm/v1/engine/llm_engine.py`
- `vllm/v1/executor/multiproc_executor.py`
- `vllm/v1/worker/gpu_model_runner.py`
- `vllm/v1/worker/gpu_worker.py`
- `vllm/worker/worker_base.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-13591`
