Commits · 439e977d9c751ef80f1ed72f03078dc408137a74 · OpenDAS / dynamo

07 Jul, 2025 1 commit

feat: vllm speculative decoding metrics (#1549) · 439e977d

jain-ria authored Jul 07, 2025


Signed-off-by: jain-ria <riajain@NVIDIA.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>

439e977d

07 May, 2025 1 commit
- fix: fix missing num_remote_prefill_groups in vLLM patch (#981) · af9ee90e
  ptarasiewiczNV authored May 07, 2025
  
  af9ee90e
29 Apr, 2025 1 commit

fix: endless map in nixl.py (#852) · c544e8ec

wxsm authored Apr 30, 2025


Signed-off-by: wxsm <wxsms@foxmail.com>
Co-authored-by: ptarasiewiczNV <104908264+ptarasiewiczNV@users.noreply.github.com>

c544e8ec

26 Apr, 2025 1 commit

feat: local planner for 0.2.0 release (#398) · 7d5d6f8c

Hongkuan Zhou authored Apr 25, 2025

Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
Co-authored-by: ishandhanani <ishandhanani@gmail.com>
Co-authored-by: Ubuntu <ubuntu@dev-inst-2w1vokvyuts83rzn4n1k7mnzew9.us-central1-a.c.brevdevprod.internal>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>

7d5d6f8c

21 Apr, 2025 1 commit
- feat: MLA disaggregation support to vLLM patch (#745) · 2972b7ed
  ptarasiewiczNV authored Apr 21, 2025
  
  2972b7ed
16 Apr, 2025 1 commit
- feat: bump vLLM version to v0.8.4 (#690) · 00730fc6
  ptarasiewiczNV authored Apr 16, 2025
  
  00730fc6
11 Apr, 2025 1 commit
- fix: adding conversion to string for notif id comparison (#638) · 3fa35f9e
  Neelay Shah authored Apr 11, 2025
  
  3fa35f9e
26 Mar, 2025 1 commit
- feat: Decode -> Prefill cached kv transfer (#340) · 17827e1d
  ptarasiewiczNV authored Mar 26, 2025
  
  17827e1d
17 Mar, 2025 1 commit
- chore: update nixl github commit (#214) · ed83e246
  Anant Sharma authored Mar 17, 2025
```
Co-authored-by: Piotr Tarasiewicz <ptarasiewicz@nvidia.com>
```
  ed83e246
11 Mar, 2025 2 commits
- feat: add new metrics and simple router cost fn (#88) · 3f84cdad
  Alec authored Mar 11, 2025
  
  3f84cdad
- fix: update vLLM patch to 0aa204 (#92) · b4281383
  ptarasiewiczNV authored Mar 11, 2025
  
  b4281383
09 Mar, 2025 2 commits
- feat: make block_size input for indexer, router, publisher (#66) · 989bb3d5
  Alec authored Mar 09, 2025
  
  989bb3d5
- fix: vLLM disagg fix incorrect block ids order (#63) · 7567620f
  ptarasiewiczNV authored Mar 09, 2025
```
Co-authored-by: ptarasiewicz@nvidia.com <Piotr Tarasiewicz>
```
  7567620f
08 Mar, 2025 1 commit
- chore: rename dynamo (#44) · 602352ce
  Neelay Shah authored Mar 08, 2025
```
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
```
  602352ce
06 Mar, 2025 1 commit
- feat: Enable make_xfer NIXL kv transfer (#39) · bc42616e
  ptarasiewiczNV authored Mar 07, 2025
```
Co-authored-by: ptarasiewicz@nvidia.com <Piotr Tarasiewicz>
```
  bc42616e
05 Mar, 2025 2 commits
- chore: regenerate patch (#29) · ea78a424
  Neelay Shah authored Mar 05, 2025
  
  ea78a424
- refactor: rename triton_distributed to dynemo (#22) · 1af7433b
  Neelay Shah authored Mar 05, 2025
```
Co-authored-by: Graham King <grahamk@nvidia.com>
```
  1af7433b
04 Mar, 2025 1 commit
- Update NIXL Dockerfile + vLLM patch with variable TP (#9) · fe83f8aa
  ptarasiewiczNV authored Mar 04, 2025
```
Co-authored-by: Piotr Tarasiewicz Nvidia <ptarasiewicznv@Piotrs-MacBook-Pro.local>
```
  fe83f8aa
01 Mar, 2025 1 commit
- Add lazy import to nixl.py · 5f14e467
  Piotr Marcinkiewicz authored Mar 01, 2025
  
  5f14e467
27 Feb, 2025 1 commit

feat: vLLM + NIXL example · f7a60cba

ptarasiewiczNV authored Feb 27, 2025


Co-authored-by: Piotr Tarasiewicz Nvidia <ptarasiewicznv@Piotrs-MacBook-Pro.local>
Co-authored-by: nnshah1 <neelays@nvidia.com>
Co-authored-by: alec-flowers <aflowers@nvidia.com>

f7a60cba

26 Feb, 2025 1 commit
- fix: Add TritonNcclConnector back to vllm patch (#273) · 85535ba0
  Alec authored Feb 25, 2025
  
  85535ba0
25 Feb, 2025 1 commit

feat: enable metrics polling · 861c5098

GuanLuo authored Feb 25, 2025

Signed-off-by: Meenakshi Sharma <163925564+nvda-mesharma@users.noreply.github.com>
Signed-off-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: Ryan Olson <ryanolson@users.noreply.github.com>
Co-authored-by: Meenakshi Sharma <163925564+nvda-mesharma@users.noreply.github.com>
Co-authored-by: Biswa Panda <biswapanda@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

861c5098

20 Feb, 2025 1 commit

feat: use vllm out of process engine · 60a73634

ptarasiewiczNV authored Feb 20, 2025


Signed-off-by: Piotr Marcinkiewicz <piotrm@nvidia.com>
Co-authored-by: Piotr Marcinkiewicz <piotrm@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

60a73634

18 Feb, 2025 1 commit

feat: Add KV publisher and receiver. Add KV aware routing example. · 8588e33a

GuanLuo authored Feb 18, 2025


Signed-off-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: aflowers <aflowers@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>

8588e33a

17 Feb, 2025 1 commit
- feat: disaggregation support for deepseek arch models (#196) · 9a7b506c
  ptarasiewiczNV authored Feb 17, 2025
  
  9a7b506c
13 Feb, 2025 1 commit
- feat: vLLM v0.7.2 patch supporting XpYd and heterogeneous P/D parallel configs (#167) · f38aa469
  ptarasiewiczNV authored Feb 13, 2025
```
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>
```
  f38aa469