Skip to content

GitLab

Unverified Commit 41f3e0e0 authored by KennyMcCormick's avatar KennyMcCormick Committed by GitHub
Browse files

chore: fix model arg name in multinode 405b example (#770) 


Signed-off-by: default avatarcormick <cormick1080@gmail.com>
parent 5ddb181c
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
examples/llm/configs/multinode-405b.yaml
View file @ 41f3e0e0
...@@ -28,7 +28,7 @@ Processor: ...@@ -28,7 +28,7 @@ Processor:
router: kv router: kv
Router: Router:
model-name: nvidia/Llama-3.1-405B-Instruct-FP8 model: nvidia/Llama-3.1-405B-Instruct-FP8
min-workers: 1 min-workers: 1
VllmWorker: VllmWorker:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment