Skip to content

GitLab

Unverified Commit 5128e2b4 authored by Julien Mancuso's avatar Julien Mancuso Committed by GitHub
Browse files

fix: fix pod affinity in vllm recipe (#4107) 


Signed-off-by: default avatarJulien Mancuso <jmancuso@nvidia.com>
parent ae4b08ac
Hide whitespace changes
Inline Side-by-side
Showing with 16 additions and 12 deletions
recipes/llama-3-70b/vllm/disagg-single-node/deploy.yaml
View file @ 5128e2b4
......@@ -33,13 +33,15 @@ spec:
extraPodSpec:
affinity:
podAffinity:
requiredDuringSchedulingIgnoredDuringExecution:
- labelSelector:
preferredDuringSchedulingIgnoredDuringExecution:
- weight: 100
podAffinityTerm:
labelSelector:
matchExpressions:
- key: nvidia.com/dynamo-component-type
operator: In
values:
- worker
- key: nvidia.com/dynamo-component-type
operator: In
values:
- worker
topologyKey: kubernetes.io/hostname
mainContainer:
env:
......@@ -72,13 +74,15 @@ spec:
extraPodSpec:
affinity:
podAffinity:
requiredDuringSchedulingIgnoredDuringExecution:
- labelSelector:
preferredDuringSchedulingIgnoredDuringExecution:
- weight: 100
podAffinityTerm:
labelSelector:
matchExpressions:
- key: nvidia.com/dynamo-component-type
operator: In
values:
- worker
- key: nvidia.com/dynamo-component-type
operator: In
values:
- worker
topologyKey: kubernetes.io/hostname
mainContainer:
env:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment