Skip to content

GitLab

Unverified Commit 8a63d9ce authored by Tzu-Ling Kan's avatar Tzu-Ling Kan Committed by GitHub
Browse files

feat: Add DYN_SYSTEM_ENABLED=True (#4279) 


Signed-off-by: default avatartzulingk@nvidia.com <tzulingk@nvidia.com>
parent d70d9acf
Hide whitespace changes
Inline Side-by-side
Showing with 6 additions and 0 deletions
tests/fault_tolerance/deploy/templates/vllm/moe_agg.yaml
View file @ 8a63d9ce
...@@ -27,6 +27,8 @@ spec: ...@@ -27,6 +27,8 @@ spec:
memory: "100Gi" memory: "100Gi"
gpu: "2" gpu: "2"
envs: envs:
- name: DYN_SYSTEM_ENABLED
value: "true"
# MoE-specific environment variables # MoE-specific environment variables
- name: VLLM_ALL2ALL_BACKEND - name: VLLM_ALL2ALL_BACKEND
value: "pplx" value: "pplx"
......
tests/fault_tolerance/deploy/templates/vllm/moe_disagg.yaml
View file @ 8a63d9ce
...@@ -30,6 +30,8 @@ spec: ...@@ -30,6 +30,8 @@ spec:
memory: "100Gi" memory: "100Gi"
gpu: "2" gpu: "2"
envs: envs:
- name: DYN_SYSTEM_ENABLED
value: "true"
# MoE-specific environment variables # MoE-specific environment variables
- name: VLLM_ALL2ALL_BACKEND - name: VLLM_ALL2ALL_BACKEND
value: "pplx" value: "pplx"
...@@ -95,6 +97,8 @@ spec: ...@@ -95,6 +97,8 @@ spec:
memory: "100Gi" memory: "100Gi"
gpu: "2" gpu: "2"
envs: envs:
- name: DYN_SYSTEM_ENABLED
value: "true"
# MoE-specific environment variables # MoE-specific environment variables
- name: VLLM_ALL2ALL_BACKEND - name: VLLM_ALL2ALL_BACKEND
value: "pplx" value: "pplx"
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment