Unverified Commit 1891cf60 authored by bnellnm's avatar bnellnm Committed by GitHub
Browse files

[Bugfix] Fix modular kernel tests (#27707)


Signed-off-by: default avatarBill Nell <bnell@redhat.com>
parent 8df98c21
...@@ -498,6 +498,8 @@ steps: ...@@ -498,6 +498,8 @@ steps:
- tests/kernels/moe - tests/kernels/moe
- vllm/model_executor/layers/fused_moe/ - vllm/model_executor/layers/fused_moe/
- vllm/distributed/device_communicators/ - vllm/distributed/device_communicators/
- vllm/envs.py
- vllm/config
commands: commands:
- pytest -v -s kernels/moe --shard-id=$$BUILDKITE_PARALLEL_JOB --num-shards=$$BUILDKITE_PARALLEL_JOB_COUNT - pytest -v -s kernels/moe --shard-id=$$BUILDKITE_PARALLEL_JOB --num-shards=$$BUILDKITE_PARALLEL_JOB_COUNT
parallelism: 2 parallelism: 2
......
...@@ -138,6 +138,7 @@ class Config: ...@@ -138,6 +138,7 @@ class Config:
} }
backend = self.all2all_backend() backend = self.all2all_backend()
vllm_config.parallel_config.all2all_backend = backend
if backend is not None: if backend is not None:
env_dict.update({"VLLM_ALL2ALL_BACKEND": backend}) env_dict.update({"VLLM_ALL2ALL_BACKEND": backend})
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment