- 30 May, 2025 3 commits
-
-
jain-ria authored
-
Alec authored
-
jthomson04 authored
-
- 29 May, 2025 2 commits
- 14 May, 2025 1 commit
-
-
Graham King authored
Router: ``` dynamo-run in=http out=dyn://dynamo.endpoint.generate --router-mode kv ``` Worker (* N): ``` dynamo-run in=dyn://dynamo.endpoint.generate out=vllm /data/llms/Qwen/Qwen3-4B ``` You need patched vllm and the C bindings `.so`. Full docs in the updated guide: `docs/guides/dynamo_run.md`. This gives us a pure-Rust ingress node: OpenAI compliant HTTP server + Pre-processor + KV-aware router.
-
- 08 May, 2025 1 commit
-
-
Hongkuan Zhou authored
-
- 21 Apr, 2025 1 commit
-
-
ishandhanani authored
-
- 17 Mar, 2025 1 commit
-
-
GuanLuo authored
-
- 09 Mar, 2025 1 commit
-
-
Alec authored
-
- 08 Mar, 2025 1 commit
-
-
Neelay Shah authored
Co-authored-by:Biswa Panda <biswa.panda@gmail.com>
-
- 05 Mar, 2025 1 commit
-
-
Neelay Shah authored
Co-authored-by:Graham King <grahamk@nvidia.com>
-
- 28 Feb, 2025 1 commit
-
-
Alec authored
Co-authored-by:Ryan McCormick <rmccormick@nvidia.com>
-
- 27 Feb, 2025 1 commit
-
-
Ryan Olson authored
-
- 25 Feb, 2025 2 commits
-
-
GuanLuo authored
Signed-off-by:
Meenakshi Sharma <163925564+nvda-mesharma@users.noreply.github.com> Signed-off-by:
Neelay Shah <neelays@nvidia.com> Co-authored-by:
Ryan Olson <ryanolson@users.noreply.github.com> Co-authored-by:
Biswa Panda <biswapanda@users.noreply.github.com> Co-authored-by:
-
Neelay Shah authored
Signed-off-by:
-
- 21 Feb, 2025 1 commit
-
-
Ryan Olson authored
Signed-off-by:
-
- 18 Feb, 2025 1 commit
-
-
GuanLuo authored
Signed-off-by:
aflowers <aflowers@nvidia.com> Co-authored-by:
hongkuanz <hongkuanz@nvidia.com> Co-authored-by:
-
