Commits · 9cbf803172f8ed4b3342c9d5237b49cb07d4d95c · OpenDAS / dynamo

02 Jul, 2025 1 commit
- feat: add dynamo components for sglang (#1721) · 9cbf8031
  ishandhanani authored Jul 02, 2025
  
  9cbf8031
27 Jun, 2025 1 commit
- docs: instructions to run DSR1 with SGLang wideep on 104+ GPUs (#1583) · 9d7624f1
  ishandhanani authored Jun 27, 2025
```
Co-authored-by: kkranen <kyle.kranen@gmail.com>
```
  9d7624f1
10 Jun, 2025 1 commit
- chore(sglang): support dp attention routing (#1415) · 47c3dad7
  ishandhanani authored Jun 09, 2025
  
  47c3dad7
05 Jun, 2025 1 commit
- fix: mismatch GAP and PA version (#1386) · a20445de
  Hongkuan Zhou authored Jun 04, 2025
  
  a20445de
04 Jun, 2025 1 commit
- feat: decouple bento dependency (#1266) · afb8495e
  Biswa Panda authored Jun 04, 2025
  
  afb8495e
03 Jun, 2025 1 commit
- chore: bump sgl and update dp attn yaml (#1362) · 8deb3ea4
  ishandhanani authored Jun 03, 2025
  
  8deb3ea4
30 May, 2025 1 commit
- fix: copy workspace as part of ci-min stage (#1291) · 6ea08301
  Anant Sharma authored May 30, 2025
  
  6ea08301
29 May, 2025 1 commit
- chore: Make llama.cpp a default engine (#1177) · b889948c
  Graham King authored May 29, 2025
  
  b889948c
28 May, 2025 3 commits
- fix: planner shutdown fix replace kantuko with appropriate circus package (#1248) · 9723d627
  Biswa Panda authored May 28, 2025
  
  9723d627
- chore: remove pa build (#1231) · 4426e937
  Neelay Shah authored May 28, 2025
  
  4426e937
- chore: bump sglang version (#1219) · 811b10a6
  ishandhanani authored May 27, 2025
  
  811b10a6
27 May, 2025 1 commit
- feat(sglang): add dockerfile/pyproject toml entry + steps to run dsr1 disagg (#1193) · 5c5cec3d
  ishandhanani authored May 27, 2025
```
Signed-off-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>
```
  5c5cec3d
23 May, 2025 1 commit
- chore: Upgrade Rust to 1.87 (#1189) · a4c49fe5
  Graham King authored May 23, 2025
  
  a4c49fe5
22 May, 2025 1 commit
- chore: vLLM arm build has verbose logging turned on to see progress (#1160) · d3b0cae1
  Kyle McGill authored May 22, 2025
  
  d3b0cae1
19 May, 2025 2 commits
- fix: Disable block manager by default in Python bindings (#1128) · 7e452a2e
  Jacky authored May 19, 2025
  
  7e452a2e
- fix: remove lib.real from LD (#1117) · ac82bcf3
  Alec authored May 19, 2025
  
  ac82bcf3
17 May, 2025 1 commit
- fix: add planner path in devcontainer (#1113) · c22315fc
  Biswa Panda authored May 16, 2025
  
  c22315fc
14 May, 2025 1 commit
- fix: downgrade CUDA image use to work around PyNccl timeout in vLLM Ray use case (#1065) · e06fd7d2
  GuanLuo authored May 13, 2025
  
  e06fd7d2
13 May, 2025 1 commit
- fix: update nixl setup for arm builds (#1061) · 1fa431c0
  Anant Sharma authored May 13, 2025
  
  1fa431c0
09 May, 2025 3 commits
- feat: kv block manager (#965) · 4564a387
  Ryan Olson authored May 09, 2025
  
  4564a387
- chore: bump versions and NIXL dependencies for 0.2.1 (#1012) · e9cb035a
  Harrison Saturley-Hall authored May 09, 2025
  
  e9cb035a
- feat: Add AWS EFA support (#999) · bdf60ca0
  Adit Ranadive authored May 08, 2025
```
NIXL uses UCX which will have support for EFA since 1.19. Explicitly
use the 1.19 branch for UCX with Dynamo.
Signed-off-by: Adit Ranadive <aranadive@nvidia.com>
```
  bdf60ca0
07 May, 2025 1 commit

chore: Remove embedded Python vllm and sglang engines (#966) · 42969800

Graham King authored May 07, 2025

vllm and sglang are now the sub-process engines from #954

Also updated docs on doing vllm and sglang multi-gpu (tensor parallel) and multi-node (pipeline parallel).

42969800

06 May, 2025 1 commit
- refactor: refactor dynamo deploy subfolder (#927) · 403344e5
  hhzhang16 authored May 06, 2025
  
  403344e5
29 Apr, 2025 4 commits
- fix: manylinux tag in ai-dynamo-vllm wheel (#884) · 97bf8184
  Anant Sharma authored Apr 29, 2025
  
  97bf8184
- fix: change environment variable to support local mount (#885) · 04ebfcb8
  Neelay Shah authored Apr 29, 2025
  
  04ebfcb8
- Revert "moving to opt foider to pick up binary even if local mounted" · bd2877a5
  nnshah1 authored Apr 29, 2025
```
This reverts commit b5f3fe10.
```
  bd2877a5
- moving to opt foider to pick up binary even if local mounted · b5f3fe10
  nnshah1 authored Apr 29, 2025
  
  b5f3fe10
28 Apr, 2025 1 commit
- feat: Add unified x86 / aarch64 (ARM) build for VLLM image (#839) · 566068dc
  Ryan McCormick authored Apr 28, 2025
  
  566068dc
25 Apr, 2025 2 commits
- feat: misc changes while deploying (#831) · 04e892d1
  hhzhang16 authored Apr 25, 2025
  
  04e892d1
- fix: add VLLM_KV_CAPI_PATH to vllm dockerfile to make kv routing working (#832) · f5e8488c
  Ziqi Fan authored Apr 25, 2025
  
  f5e8488c
23 Apr, 2025 1 commit
- build: add rust binaries in manylinux image (#783) · ea84ab11
  Anant Sharma authored Apr 23, 2025
  
  ea84ab11
21 Apr, 2025 1 commit
- fix: give the user ownership permissions of /opt/dynamo/venv (#767) · 43dc9cee
  hhzhang16 authored Apr 21, 2025
  
  43dc9cee
17 Apr, 2025 1 commit

fix: bump GAP to r25.03 (#724) · e6399307

Hongkuan Zhou authored Apr 17, 2025


Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

e6399307

16 Apr, 2025 1 commit
- feat: bump vLLM version to v0.8.4 (#690) · 00730fc6
  ptarasiewiczNV authored Apr 16, 2025
  
  00730fc6
14 Apr, 2025 2 commits

fix: devcontainer mounts and vllm c api (#663) · 2d746153
Alec authored Apr 14, 2025

2d746153

feat: add .devcontainer based off images in container/ (#497) · 0a86edc4

Alec authored Apr 14, 2025

Co-authored-by: Ubuntu <ubuntu@crusoe-prod--inst-2secxwyxeao1mi2dsqk2pl9oaz7.eu-iceland1-a.comp>
Co-authored-by: Hannah Zhang <hannahz@nvidia.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>

0a86edc4

11 Apr, 2025 1 commit
- fix: add DYNAMO_HOME env var to vLLM docker image (#629) · 6edf46c4
  Anant Sharma authored Apr 11, 2025
  
  6edf46c4
10 Apr, 2025 2 commits
- fix: wheel for api-store should not be built and installed (#584) · 75afd7c4
  mohammedabdulwahhab authored Apr 10, 2025
  
  75afd7c4
- fix: update yum install in wheel-builder image (#605) · 0ff6f53d
  Anant Sharma authored Apr 10, 2025
  
  0ff6f53d