Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
0483fabc
Unverified
Commit
0483fabc
authored
Aug 22, 2025
by
Zhewen Li
Committed by
GitHub
Aug 22, 2025
Browse files
[CI/Build] add EP dependencies to docker (#21976)
Co-authored-by:
Simon Mo
<
simon.mo@hey.com
>
parent
da65bec3
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
15 additions
and
0 deletions
+15
-0
.buildkite/test-pipeline.yaml
.buildkite/test-pipeline.yaml
+7
-0
docker/Dockerfile
docker/Dockerfile
+8
-0
No files found.
.buildkite/test-pipeline.yaml
View file @
0483fabc
...
...
@@ -843,3 +843,10 @@ steps:
commands
:
-
export VLLM_WORKER_MULTIPROC_METHOD=spawn
-
pytest -s -v test_lm_eval_correctness.py --config-list-file=configs/models-large.txt --tp-size=4
-
label
:
Qwen MoE EP Test
# optional
gpu
:
h200
optional
:
true
num_gpus
:
2
commands
:
-
CUDA_VISIBLE_DEVICES=1,2 VLLM_ALL2ALL_BACKEND=deepep_high_throughput VLLM_USE_DEEP_GEMM=1 VLLM_LOGGING_LEVEL=DEBUG python3 /vllm-workspace/examples/offline_inference/data_parallel.py --model Qwen/Qwen1.5-MoE-A2.7B --tp-size=1 --dp-size=2 --max-model-len
2048
docker/Dockerfile
View file @
0483fabc
...
...
@@ -458,6 +458,14 @@ RUN --mount=type=cache,target=/root/.cache/uv bash - <<'BASH'
fi
BASH
# Install EP kernels(pplx-kernels and DeepEP), NixL
COPY
tools/ep_kernels/install_python_libraries.sh install_python_libraries.sh
COPY
tools/install_nixl.sh install_nixl.sh
ENV
CUDA_HOME=/usr/local/cuda
RUN
export
TORCH_CUDA_ARCH_LIST
=
"
${
TORCH_CUDA_ARCH_LIST
:-
9
.0a+PTX
}
"
\
&&
bash install_python_libraries.sh
\
&&
bash install_nixl.sh
--force
#################### vLLM installation IMAGE ####################
#################### TEST IMAGE ####################
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment