Skip to content

GitLab

Unverified Commit 5128e2b4 authored by Julien Mancuso's avatar Julien Mancuso Committed by GitHub
Browse files

fix: fix pod affinity in vllm recipe (#4107) 


Signed-off-by: default avatarJulien Mancuso <jmancuso@nvidia.com>
parent ae4b08ac
Hide whitespace changes
Inline Side-by-side
Showing with 16 additions and 12 deletions
recipes/llama-3-70b/vllm/disagg-single-node/deploy.yaml
View file @ 5128e2b4
...@@ -33,13 +33,15 @@ spec: ...@@ -33,13 +33,15 @@ spec:
extraPodSpec: extraPodSpec:
affinity: affinity:
podAffinity: podAffinity:
requiredDuringSchedulingIgnoredDuringExecution: preferredDuringSchedulingIgnoredDuringExecution:
- labelSelector: - weight: 100
podAffinityTerm:
labelSelector:
matchExpressions: matchExpressions:
- key: nvidia.com/dynamo-component-type - key: nvidia.com/dynamo-component-type
operator: In operator: In
values: values:
- worker - worker
topologyKey: kubernetes.io/hostname topologyKey: kubernetes.io/hostname
mainContainer: mainContainer:
env: env:
...@@ -72,13 +74,15 @@ spec: ...@@ -72,13 +74,15 @@ spec:
extraPodSpec: extraPodSpec:
affinity: affinity:
podAffinity: podAffinity:
requiredDuringSchedulingIgnoredDuringExecution: preferredDuringSchedulingIgnoredDuringExecution:
- labelSelector: - weight: 100
podAffinityTerm:
labelSelector:
matchExpressions: matchExpressions:
- key: nvidia.com/dynamo-component-type - key: nvidia.com/dynamo-component-type
operator: In operator: In
values: values:
- worker - worker
topologyKey: kubernetes.io/hostname topologyKey: kubernetes.io/hostname
mainContainer: mainContainer:
env: env:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment