---
id: pr-vllm-18343
repo: vllm-project/vllm
pr: 18343
title: '[Feature] Expert Parallelism Load Balancer (EPLB)'
author: abmfy
date: '2025-06-26'
url: https://github.com/vllm-project/vllm/pull/18343
source_category: upstream-code
architectures:
- sm100
tags:
- fp8
- kernel-fusion
- moe
- pipeline-stages
- quantization
techniques:
- kernel-fusion
- pipeline-stages
hardware_features:
- fp8
kernel_types:
- moe
- quantization
languages:
- python
captured_at: '2026-04-27'
status: merged
merge_sha: e9fd658a736a4d30f7a367c317506c87ad7f5359
inclusion_reason: kernel file changes
changed_paths:
- .buildkite/test-pipeline.yaml
- tests/distributed/test_eplb_algo.py
- tests/distributed/test_eplb_execute.py
- tests/models/test_initialization.py
- vllm/config.py
- vllm/distributed/eplb/__init__.py
- vllm/distributed/eplb/eplb_state.py
- vllm/distributed/eplb/rebalance_algo.py
- vllm/distributed/eplb/rebalance_execute.py
- vllm/engine/arg_utils.py
- vllm/model_executor/layers/fused_moe/layer.py
- vllm/model_executor/layers/quantization/awq_marlin.py
- vllm/model_executor/layers/quantization/compressed_tensors/compressed_tensors_moe.py
- vllm/model_executor/layers/quantization/experts_int8.py
- vllm/model_executor/layers/quantization/fp8.py
- vllm/model_executor/layers/quantization/gguf.py
- vllm/model_executor/layers/quantization/gptq_marlin.py
- vllm/model_executor/layers/quantization/modelopt.py
- vllm/model_executor/layers/quantization/moe_wna16.py
- vllm/model_executor/layers/quantization/quark/quark_moe.py
- vllm/model_executor/models/deepseek_v2.py
- vllm/model_executor/models/interfaces.py
- vllm/v1/worker/gpu_model_runner.py
- vllm/v1/worker/gpu_worker.py
head_ref_oid: c479d2c1456def25ac04f26f4d480c63049a536c
artifact_dir: evidence/pull-bundles/vllm/gh-18343
---
# [Feature] Expert Parallelism Load Balancer (EPLB)

- Repository: `vllm-project/vllm`
- PR: [18343](https://github.com/vllm-project/vllm/pull/18343)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `.buildkite/test-pipeline.yaml`
- `tests/distributed/test_eplb_algo.py`
- `tests/distributed/test_eplb_execute.py`
- `tests/models/test_initialization.py`
- `vllm/config.py`
- `vllm/distributed/eplb/__init__.py`
- `vllm/distributed/eplb/eplb_state.py`
- `vllm/distributed/eplb/rebalance_algo.py`
- `vllm/distributed/eplb/rebalance_execute.py`
- `vllm/engine/arg_utils.py`
- `vllm/model_executor/layers/fused_moe/layer.py`
- `vllm/model_executor/layers/quantization/awq_marlin.py`
- `vllm/model_executor/layers/quantization/compressed_tensors/compressed_tensors_moe.py`
- `vllm/model_executor/layers/quantization/experts_int8.py`
- `vllm/model_executor/layers/quantization/fp8.py`
- `vllm/model_executor/layers/quantization/gguf.py`
- `vllm/model_executor/layers/quantization/gptq_marlin.py`
- `vllm/model_executor/layers/quantization/modelopt.py`
- `vllm/model_executor/layers/quantization/moe_wna16.py`
- `vllm/model_executor/layers/quantization/quark/quark_moe.py`
- `vllm/model_executor/models/deepseek_v2.py`
- `vllm/model_executor/models/interfaces.py`
- `vllm/v1/worker/gpu_model_runner.py`
- `vllm/v1/worker/gpu_worker.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-18343`
