Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
dynamo
Commits
35229c74
"examples/backends/vscode:/vscode.git/clone" did not exist on "1e120ed049595195a66e3e004e404dff35239ed1"
Unverified
Commit
35229c74
authored
May 20, 2025
by
julienmancuso
Committed by
GitHub
May 20, 2025
Browse files
fix: set gpus as strings in config files (#1123)
parent
b3da9427
Changes
6
Show whitespace changes
Inline
Side-by-side
Showing
6 changed files
with
9 additions
and
9 deletions
+9
-9
examples/llm/configs/agg.yaml
examples/llm/configs/agg.yaml
+1
-1
examples/llm/configs/agg_router.yaml
examples/llm/configs/agg_router.yaml
+1
-1
examples/llm/configs/disagg_router.yaml
examples/llm/configs/disagg_router.yaml
+2
-2
examples/llm/configs/multinode-405b.yaml
examples/llm/configs/multinode-405b.yaml
+2
-2
examples/llm/configs/multinode_agg_r1.yaml
examples/llm/configs/multinode_agg_r1.yaml
+1
-1
examples/llm/configs/mutinode_disagg_r1.yaml
examples/llm/configs/mutinode_disagg_r1.yaml
+2
-2
No files found.
examples/llm/configs/agg.yaml
View file @
35229c74
...
...
@@ -34,7 +34,7 @@ VllmWorker:
ServiceArgs
:
workers
:
1
resources
:
gpu
:
1
gpu
:
'
1'
common-configs
:
[
model
,
block-size
,
max-model-len
]
Planner
:
...
...
examples/llm/configs/agg_router.yaml
View file @
35229c74
...
...
@@ -39,7 +39,7 @@ VllmWorker:
ServiceArgs
:
workers
:
1
resources
:
gpu
:
1
gpu
:
'
1'
common-configs
:
[
model
,
block-size
,
max-model-len
,
router
,
kv-transfer-config
]
Planner
:
...
...
examples/llm/configs/disagg_router.yaml
View file @
35229c74
...
...
@@ -42,7 +42,7 @@ VllmWorker:
ServiceArgs
:
workers
:
1
resources
:
gpu
:
1
gpu
:
'
1'
common-configs
:
[
model
,
block-size
,
max-model-len
,
router
,
kv-transfer-config
]
PrefillWorker
:
...
...
@@ -50,7 +50,7 @@ PrefillWorker:
ServiceArgs
:
workers
:
1
resources
:
gpu
:
1
gpu
:
'
1'
common-configs
:
[
model
,
block-size
,
max-model-len
,
kv-transfer-config
]
Planner
:
...
...
examples/llm/configs/multinode-405b.yaml
View file @
35229c74
...
...
@@ -49,7 +49,7 @@ VllmWorker:
ServiceArgs
:
workers
:
1
resources
:
gpu
:
8
gpu
:
'
8'
PrefillWorker
:
model
:
nvidia/Llama-3.1-405B-Instruct-FP8
...
...
@@ -63,4 +63,4 @@ PrefillWorker:
ServiceArgs
:
workers
:
1
resources
:
gpu
:
8
\ No newline at end of file
gpu
:
'
8'
\ No newline at end of file
examples/llm/configs/multinode_agg_r1.yaml
View file @
35229c74
...
...
@@ -35,5 +35,5 @@ VllmWorker:
ServiceArgs
:
workers
:
1
resources
:
gpu
:
1
gpu
:
'
1'
common-configs
:
[
model
,
block-size
,
max-model-len
]
examples/llm/configs/mutinode_disagg_r1.yaml
View file @
35229c74
...
...
@@ -34,7 +34,7 @@ VllmWorker:
ServiceArgs
:
workers
:
1
resources
:
gpu
:
16
gpu
:
'
16
'
common-configs
:
[
model
,
block-size
,
max-model-len
,
kv-transfer-config
,
tensor-parallel-size
]
PrefillWorker
:
...
...
@@ -42,5 +42,5 @@ PrefillWorker:
ServiceArgs
:
workers
:
1
resources
:
gpu
:
16
gpu
:
'
16
'
common-configs
:
[
model
,
block-size
,
max-model-len
,
kv-transfer-config
,
tensor-parallel-size
]
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment