Commits · afb8495e7dfba20c1b730344f59e439da5d73c97 · OpenDAS / dynamo

22 May, 2025 1 commit
- feat: Add TTFT and ITL Interpolation to Profiling Script (#1159) · 7860861f
  Hongkuan Zhou authored May 22, 2025
```
Co-authored-by: root <root@kkranen-dt.nvidia.com>
```
  7860861f
20 May, 2025 1 commit
- feat: SLA Profiling and Recommending Parallelization Mapping (#1114) · 93702e44
  Hongkuan Zhou authored May 20, 2025
  
  93702e44
07 May, 2025 1 commit
- fix: fix missing num_remote_prefill_groups in vLLM patch (#981) · af9ee90e
  ptarasiewiczNV authored May 07, 2025
  
  af9ee90e
02 May, 2025 1 commit
- feat: Add multimodal example with aggregated serving (#709) · 58df5aca
  Kris Hung authored May 02, 2025
  
  58df5aca
29 Apr, 2025 1 commit

fix: endless map in nixl.py (#852) · c544e8ec

wxsm authored Apr 30, 2025


Signed-off-by: wxsm <wxsms@foxmail.com>
Co-authored-by: ptarasiewiczNV <104908264+ptarasiewiczNV@users.noreply.github.com>

c544e8ec

26 Apr, 2025 1 commit

feat: local planner for 0.2.0 release (#398) · 7d5d6f8c

Hongkuan Zhou authored Apr 25, 2025

Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
Co-authored-by: ishandhanani <ishandhanani@gmail.com>
Co-authored-by: Ubuntu <ubuntu@dev-inst-2w1vokvyuts83rzn4n1k7mnzew9.us-central1-a.c.brevdevprod.internal>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>

7d5d6f8c

21 Apr, 2025 1 commit
- feat: MLA disaggregation support to vLLM patch (#745) · 2972b7ed
  ptarasiewiczNV authored Apr 21, 2025
  
  2972b7ed
16 Apr, 2025 1 commit
- feat: bump vLLM version to v0.8.4 (#690) · 00730fc6
  ptarasiewiczNV authored Apr 16, 2025
  
  00730fc6
11 Apr, 2025 1 commit
- fix: adding conversion to string for notif id comparison (#638) · 3fa35f9e
  Neelay Shah authored Apr 11, 2025
  
  3fa35f9e
26 Mar, 2025 1 commit
- feat: Decode -> Prefill cached kv transfer (#340) · 17827e1d
  ptarasiewiczNV authored Mar 26, 2025
  
  17827e1d
18 Mar, 2025 1 commit
- chore: remove dynamo from vllm whl version (#257) · 792b747c
  Anant Sharma authored Mar 18, 2025
```
Co-authored-by: Meenakshi Sharma <163925564+nvda-mesharma@users.noreply.github.com>
```
  792b747c
17 Mar, 2025 1 commit
- chore: update nixl github commit (#214) · ed83e246
  Anant Sharma authored Mar 17, 2025
```
Co-authored-by: Piotr Tarasiewicz <ptarasiewicz@nvidia.com>
```
  ed83e246
16 Mar, 2025 2 commits
- chore: update version for patched vLLM wheel (#193) · 761ff073
  Anant Sharma authored Mar 16, 2025
  
  761ff073
- chore: adding kubernetes - works for target dev (#192) · 233f782d
  Neelay Shah authored Mar 16, 2025
  
  233f782d
15 Mar, 2025 3 commits
- chore: Apply patch to vLLM wheel (#177) · a2773f3e
  ptarasiewiczNV authored Mar 15, 2025
  
  a2773f3e
- fix: Specify vLLM prebuilt wheel location (#176) · 177fb356
  ptarasiewiczNV authored Mar 15, 2025
  
  177fb356
- fix: fix helm chart deployment (#172) · ffd47bca
  julienmancuso authored Mar 14, 2025
  
  ffd47bca
12 Mar, 2025 1 commit
- test: add basic support for pytest codeblocks (#117) · fcac394a
  Neelay Shah authored Mar 12, 2025
  
  fcac394a
11 Mar, 2025 3 commits
- feat: add new metrics and simple router cost fn (#88) · 3f84cdad
  Alec authored Mar 11, 2025
  
  3f84cdad
- fix: update vLLM patch to 0aa204 (#92) · b4281383
  ptarasiewiczNV authored Mar 11, 2025
  
  b4281383
- chore: Simplify the container build instructions for LLMAPI example (#87) · f784b36a
  Tanmay Verma authored Mar 11, 2025
  
  f784b36a
10 Mar, 2025 1 commit
- build(deps): bump transformers from 4.45.2 to 4.48.3 (#58) · 7591a5cc
  Dmitry Tokarev authored Mar 10, 2025
  
  7591a5cc
09 Mar, 2025 2 commits
- feat: make block_size input for indexer, router, publisher (#66) · 989bb3d5
  Alec authored Mar 09, 2025
  
  989bb3d5
- fix: vLLM disagg fix incorrect block ids order (#63) · 7567620f
  ptarasiewiczNV authored Mar 09, 2025
```
Co-authored-by: ptarasiewicz@nvidia.com <Piotr Tarasiewicz>
```
  7567620f
08 Mar, 2025 1 commit
- chore: rename dynamo (#44) · 602352ce
  Neelay Shah authored Mar 08, 2025
```
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
```
  602352ce
07 Mar, 2025 2 commits
- feat: onboard dynamo-sdk basic and kv-router examples (#20) · aacc5d76
  Biswa Panda authored Mar 07, 2025
```
Co-authored-by: Neelay Shah <neelays@nvidia.com>
```
  aacc5d76
- chore: remove ucx-py from requirements and fix UCX env variable (#46) · 44bde250
  ptarasiewiczNV authored Mar 07, 2025
```
Co-authored-by: ptarasiewicz@nvidia.com <Piotr Tarasiewicz>
```
  44bde250
06 Mar, 2025 1 commit
- feat: Enable make_xfer NIXL kv transfer (#39) · bc42616e
  ptarasiewiczNV authored Mar 07, 2025
```
Co-authored-by: ptarasiewicz@nvidia.com <Piotr Tarasiewicz>
```
  bc42616e
05 Mar, 2025 4 commits
- chore: regenerate patch (#29) · ea78a424
  Neelay Shah authored Mar 05, 2025
  
  ea78a424
- refactor: updated command line arg (#26) · 3ba2b7e9
  Neelay Shah authored Mar 05, 2025
  
  3ba2b7e9
- refactor: rename triton_distributed to dynemo (#22) · 1af7433b
  Neelay Shah authored Mar 05, 2025
```
Co-authored-by: Graham King <grahamk@nvidia.com>
```
  1af7433b
- feat: OAI compatible endpoints for TRTLLM (#14) · 2791b9ea
  NVShreyas authored Mar 04, 2025
```
Co-authored-by: Tanmay Verma <tanmayv@nvidia.com>
Co-authored-by: Tanmay Verma <tanmayv@login-eos01.eos.clusters.nvidia.com>
Co-authored-by: Tanmay Verma <tanmay2592@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  2791b9ea
04 Mar, 2025 1 commit
- Update NIXL Dockerfile + vLLM patch with variable TP (#9) · fe83f8aa
  ptarasiewiczNV authored Mar 04, 2025
```
Co-authored-by: Piotr Tarasiewicz Nvidia <ptarasiewicznv@Piotrs-MacBook-Pro.local>
```
  fe83f8aa
01 Mar, 2025 1 commit
- Add lazy import to nixl.py · 5f14e467
  Piotr Marcinkiewicz authored Mar 01, 2025
  
  5f14e467
27 Feb, 2025 1 commit

feat: vLLM + NIXL example · f7a60cba

ptarasiewiczNV authored Feb 27, 2025


Co-authored-by: Piotr Tarasiewicz Nvidia <ptarasiewicznv@Piotrs-MacBook-Pro.local>
Co-authored-by: nnshah1 <neelays@nvidia.com>
Co-authored-by: alec-flowers <aflowers@nvidia.com>

f7a60cba

26 Feb, 2025 1 commit
- fix: Add TritonNcclConnector back to vllm patch (#273) · 85535ba0
  Alec authored Feb 25, 2025
  
  85535ba0
25 Feb, 2025 1 commit

feat: enable metrics polling · 861c5098

GuanLuo authored Feb 25, 2025

Signed-off-by: Meenakshi Sharma <163925564+nvda-mesharma@users.noreply.github.com>
Signed-off-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: Ryan Olson <ryanolson@users.noreply.github.com>
Co-authored-by: Meenakshi Sharma <163925564+nvda-mesharma@users.noreply.github.com>
Co-authored-by: Biswa Panda <biswapanda@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

861c5098

21 Feb, 2025 1 commit
- build: Multi-stage VLLM Build (#225) · 6e0ccccb
  Ryan McCormick authored Feb 21, 2025
  
  6e0ccccb
20 Feb, 2025 1 commit

feat: use vllm out of process engine · 60a73634

ptarasiewiczNV authored Feb 20, 2025


Signed-off-by: Piotr Marcinkiewicz <piotrm@nvidia.com>
Co-authored-by: Piotr Marcinkiewicz <piotrm@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

60a73634

18 Feb, 2025 1 commit

feat: Add KV publisher and receiver. Add KV aware routing example. · 8588e33a

GuanLuo authored Feb 18, 2025


Signed-off-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: aflowers <aflowers@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>

8588e33a