fix: add mem frac for sglang dsr1 8gpu (#5260)

Signed-off-by: hongkuanz <hongkuanz@nvidia.com>

fix: add mem frac for sglang dsr1 8gpu (#5260)
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
bfb95df7 · Hongkuan Zhou · GitHub · 6458ef80 · bfb95df7
Unverified Commit bfb95df7 authored Jan 08, 2026 by Hongkuan Zhou Committed by GitHub Jan 08, 2026
Hide whitespace changes
Inline Side-by-side

Showing with 4 additions and 0 deletions

recipes/deepseek-r1/sglang/disagg-8gpu/deploy.yaml recipes/deepseek-r1/sglang/disagg-8gpu/deploy.yaml +4 -0

No files found.
--- a/recipes/deepseek-r1/sglang/disagg-8gpu/deploy.yaml
+++ b/recipes/deepseek-r1/sglang/disagg-8gpu/deploy.yaml
@@ -60,6 +60,8 @@ spec:
            - decode
            - --disaggregation-bootstrap-port
            - "30001"
+            - --mem-fraction-static
+            - "0.75"
            - --host
            - 0.0.0.0
            - --prefill-round-robin-balance
@@ -97,6 +99,8 @@ spec:
            - prefill
            - --disaggregation-bootstrap-port
            - "30001"
+            - --mem-fraction-static
+            - "0.75"
            - --host
            - 0.0.0.0
            - --load-balance-method