Commits · b127d95fd6281db7c715697cd2fdf641a5bdb3de · OpenDAS / dynamo

"vscode:/vscode.git/clone" did not exist on "aff9bc405a3a6f6a96689fb3a66ad185b8e48363"

22 Jul, 2025 2 commits
- chore: Bump genai-perf to v0.0.15 (#2051) · 9cfaa7be
  ptarasiewiczNV authored Jul 22, 2025
  
  9cfaa7be
- fix: install torch distribution matching container cuda version (#2027) · 20c5daf3
  ptarasiewiczNV authored Jul 22, 2025
  
  20c5daf3
20 Jul, 2025 1 commit

chore: Install vLLM and WideEP kernels in vLLM runtime container (#2010) · cb6de94d

ptarasiewiczNV authored Jul 20, 2025

Signed-off-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: alec-flowers <aflowers@nvidia.com>

cb6de94d

17 Jul, 2025 1 commit
- refactor: replace vllm with vllm_v1 container (#1953) · 6d2be143
  Biswa Panda authored Jul 17, 2025
```
Co-authored-by: alec-flowers <aflowers@nvidia.com>
```
  6d2be143
11 Jul, 2025 1 commit
- fix: add missing av dependency in contanier for multimodal examples (#1881) · 26d7a61e
  Biswa Panda authored Jul 10, 2025
  
  26d7a61e
08 Jul, 2025 1 commit

feat: predictive active blocks for routing without load metrics (#1731) · 84e71e27

Yan Ru Pei authored Jul 08, 2025


Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>

84e71e27

07 Jul, 2025 1 commit

feat: vllm speculative decoding metrics (#1549) · 439e977d

jain-ria authored Jul 07, 2025


Signed-off-by: jain-ria <riajain@NVIDIA.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>

439e977d

30 Jun, 2025 1 commit
- feat: support sla planner in vllm_v1 example (#1680) · 2bed47eb
  Hongkuan Zhou authored Jun 30, 2025
  
  2bed47eb
24 Jun, 2025 2 commits
- fix: pin versions on docs dockerfile (#1627) · 57f5725d
  Anant Sharma authored Jun 24, 2025
  
  57f5725d
- feat: Using NIXL for KV cache transfer when using disaggregated serving in TRTLLM (#1591) · 0b7cdf55
  Tanmay Verma authored Jun 24, 2025
```
Signed-off-by: Tanmay Verma <tanmay2592@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  0b7cdf55
18 Jun, 2025 1 commit

build(deps): bump protobuf from 5.27.3 to 5.29.5 in /container/deps (#1556) · 2528ea2c

dependabot[bot] authored Jun 18, 2025


Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

2528ea2c

14 Jun, 2025 1 commit

feat: SLA-based Planner (#1420) · 3f53a78e

Hongkuan Zhou authored Jun 13, 2025

Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

3f53a78e

05 Jun, 2025 3 commits
- chore: Remove nats-py dependency (#1387) · e61f1c8a
  Kris Hung authored Jun 05, 2025
  
  e61f1c8a
- test: basic end to end (#1339) · 373f1f38
  Neelay Shah authored Jun 05, 2025
```
Signed-off-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: pvijayakrish <pvijayakrish@nvidia.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  373f1f38
- fix: mismatch GAP and PA version (#1386) · a20445de
  Hongkuan Zhou authored Jun 04, 2025
  
  a20445de
22 May, 2025 1 commit
- feat: Add TTFT and ITL Interpolation to Profiling Script (#1159) · 7860861f
  Hongkuan Zhou authored May 22, 2025
```
Co-authored-by: root <root@kkranen-dt.nvidia.com>
```
  7860861f
20 May, 2025 1 commit
- feat: SLA Profiling and Recommending Parallelization Mapping (#1114) · 93702e44
  Hongkuan Zhou authored May 20, 2025
  
  93702e44
07 May, 2025 1 commit
- fix: fix missing num_remote_prefill_groups in vLLM patch (#981) · af9ee90e
  ptarasiewiczNV authored May 07, 2025
  
  af9ee90e
02 May, 2025 1 commit
- feat: Add multimodal example with aggregated serving (#709) · 58df5aca
  Kris Hung authored May 02, 2025
  
  58df5aca
29 Apr, 2025 1 commit

fix: endless map in nixl.py (#852) · c544e8ec

wxsm authored Apr 30, 2025


Signed-off-by: wxsm <wxsms@foxmail.com>
Co-authored-by: ptarasiewiczNV <104908264+ptarasiewiczNV@users.noreply.github.com>

c544e8ec

26 Apr, 2025 1 commit

feat: local planner for 0.2.0 release (#398) · 7d5d6f8c

Hongkuan Zhou authored Apr 25, 2025

Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
Co-authored-by: ishandhanani <ishandhanani@gmail.com>
Co-authored-by: Ubuntu <ubuntu@dev-inst-2w1vokvyuts83rzn4n1k7mnzew9.us-central1-a.c.brevdevprod.internal>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>

7d5d6f8c

21 Apr, 2025 1 commit
- feat: MLA disaggregation support to vLLM patch (#745) · 2972b7ed
  ptarasiewiczNV authored Apr 21, 2025
  
  2972b7ed
16 Apr, 2025 1 commit
- feat: bump vLLM version to v0.8.4 (#690) · 00730fc6
  ptarasiewiczNV authored Apr 16, 2025
  
  00730fc6
11 Apr, 2025 1 commit
- fix: adding conversion to string for notif id comparison (#638) · 3fa35f9e
  Neelay Shah authored Apr 11, 2025
  
  3fa35f9e
26 Mar, 2025 1 commit
- feat: Decode -> Prefill cached kv transfer (#340) · 17827e1d
  ptarasiewiczNV authored Mar 26, 2025
  
  17827e1d
18 Mar, 2025 1 commit
- chore: remove dynamo from vllm whl version (#257) · 792b747c
  Anant Sharma authored Mar 18, 2025
```
Co-authored-by: Meenakshi Sharma <163925564+nvda-mesharma@users.noreply.github.com>
```
  792b747c
17 Mar, 2025 1 commit
- chore: update nixl github commit (#214) · ed83e246
  Anant Sharma authored Mar 17, 2025
```
Co-authored-by: Piotr Tarasiewicz <ptarasiewicz@nvidia.com>
```
  ed83e246
16 Mar, 2025 2 commits
- chore: update version for patched vLLM wheel (#193) · 761ff073
  Anant Sharma authored Mar 16, 2025
  
  761ff073
- chore: adding kubernetes - works for target dev (#192) · 233f782d
  Neelay Shah authored Mar 16, 2025
  
  233f782d
15 Mar, 2025 3 commits
- chore: Apply patch to vLLM wheel (#177) · a2773f3e
  ptarasiewiczNV authored Mar 15, 2025
  
  a2773f3e
- fix: Specify vLLM prebuilt wheel location (#176) · 177fb356
  ptarasiewiczNV authored Mar 15, 2025
  
  177fb356
- fix: fix helm chart deployment (#172) · ffd47bca
  julienmancuso authored Mar 14, 2025
  
  ffd47bca
12 Mar, 2025 1 commit
- test: add basic support for pytest codeblocks (#117) · fcac394a
  Neelay Shah authored Mar 12, 2025
  
  fcac394a
11 Mar, 2025 3 commits
- feat: add new metrics and simple router cost fn (#88) · 3f84cdad
  Alec authored Mar 11, 2025
  
  3f84cdad
- fix: update vLLM patch to 0aa204 (#92) · b4281383
  ptarasiewiczNV authored Mar 11, 2025
  
  b4281383
- chore: Simplify the container build instructions for LLMAPI example (#87) · f784b36a
  Tanmay Verma authored Mar 11, 2025
  
  f784b36a
10 Mar, 2025 1 commit
- build(deps): bump transformers from 4.45.2 to 4.48.3 (#58) · 7591a5cc
  Dmitry Tokarev authored Mar 10, 2025
  
  7591a5cc
09 Mar, 2025 2 commits
- feat: make block_size input for indexer, router, publisher (#66) · 989bb3d5
  Alec authored Mar 09, 2025
  
  989bb3d5
- fix: vLLM disagg fix incorrect block ids order (#63) · 7567620f
  ptarasiewiczNV authored Mar 09, 2025
```
Co-authored-by: ptarasiewicz@nvidia.com <Piotr Tarasiewicz>
```
  7567620f
08 Mar, 2025 1 commit
- chore: rename dynamo (#44) · 602352ce
  Neelay Shah authored Mar 08, 2025
```
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
```
  602352ce