Skip to content

GitLab

Unverified Commit 72b0aec1 authored by ishandhanani's avatar ishandhanani Committed by GitHub
Browse files

fix: use mc backend for disagg (#4095)

parent a2e748ac
Hide whitespace changes
Inline Side-by-side
Showing with 0 additions and 8 deletions
recipes/deepseek-r1/sglang/disagg-16gpu/deploy.yaml
View file @ 72b0aec1
...@@ -69,8 +69,6 @@ spec: ...@@ -69,8 +69,6 @@ spec:
- --skip-tokenizer-init - --skip-tokenizer-init
- --disaggregation-mode - --disaggregation-mode
- decode - decode
- --disaggregation-transfer-backend
- nixl
- --disaggregation-bootstrap-port - --disaggregation-bootstrap-port
- "30001" - "30001"
- --mem-fraction-static - --mem-fraction-static
...@@ -120,8 +118,6 @@ spec: ...@@ -120,8 +118,6 @@ spec:
- --skip-tokenizer-init - --skip-tokenizer-init
- --disaggregation-mode - --disaggregation-mode
- prefill - prefill
- --disaggregation-transfer-backend
- nixl
- --disaggregation-bootstrap-port - --disaggregation-bootstrap-port
- "30001" - "30001"
- --mem-fraction-static - --mem-fraction-static
......
recipes/deepseek-r1/sglang/disagg-8gpu/deploy.yaml
View file @ 72b0aec1
...@@ -67,8 +67,6 @@ spec: ...@@ -67,8 +67,6 @@ spec:
- --skip-tokenizer-init - --skip-tokenizer-init
- --disaggregation-mode - --disaggregation-mode
- decode - decode
- --disaggregation-transfer-backend
- nixl
- --disaggregation-bootstrap-port - --disaggregation-bootstrap-port
- "30001" - "30001"
- --host - --host
...@@ -114,8 +112,6 @@ spec: ...@@ -114,8 +112,6 @@ spec:
- --skip-tokenizer-init - --skip-tokenizer-init
- --disaggregation-mode - --disaggregation-mode
- prefill - prefill
- --disaggregation-transfer-backend
- nixl
- --disaggregation-bootstrap-port - --disaggregation-bootstrap-port
- "30001" - "30001"
- --host - --host
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment