Skip to content

GitLab

Unverified Commit 97390ac0 authored by ishandhanani's avatar ishandhanani Committed by GitHub
Browse files

fix(k8s): sglang disagg now uses decode worker (#2206)

parent c546b630
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 2 deletions
components/backends/sglang/deploy/disagg.yaml
View file @ 97390ac0
...@@ -83,7 +83,7 @@ spec: ...@@ -83,7 +83,7 @@ spec:
args: args:
- "python3" - "python3"
- "-m" - "-m"
- "dynamo.sglang.worker" - "dynamo.sglang.decode_worker"
- "--model-path" - "--model-path"
- "deepseek-ai/DeepSeek-R1-Distill-Llama-8B" - "deepseek-ai/DeepSeek-R1-Distill-Llama-8B"
- "--served-model-name" - "--served-model-name"
...@@ -152,4 +152,4 @@ spec: ...@@ -152,4 +152,4 @@ spec:
- "--disaggregation-mode" - "--disaggregation-mode"
- "prefill" - "prefill"
- "--disaggregation-transfer-backend" - "--disaggregation-transfer-backend"
- "nixl" - "nixl"
\ No newline at end of file
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment