Commits · fd79234f41a0a7fd05dc31a1866399a44703fff9 · OpenDAS / dynamo

"components/metrics/src/lib.rs" did not exist on "09656f6cc0bc9f9b694634eec03b96d74a755ab9"

11 Mar, 2025 2 commits
- refactor: rename vllm_nixl to vllm and make default (#100) · 5bcdb734
  Neelay Shah authored Mar 11, 2025
  
  5bcdb734
- feat: add new metrics and simple router cost fn (#88) · 3f84cdad
  Alec authored Mar 11, 2025
  
  3f84cdad
09 Mar, 2025 2 commits
- feat: make block_size input for indexer, router, publisher (#66) · 989bb3d5
  Alec authored Mar 09, 2025
  
  989bb3d5
- feat: make vllm baseline support both chat and completions (#70) · efe82b86
  Alec authored Mar 09, 2025
  
  efe82b86
08 Mar, 2025 2 commits
- chore: Renamed Triton Distributed to Dynamo (#56) · b4d56a57
  Dmitry Tokarev authored Mar 08, 2025
  
  b4d56a57
- chore: rename dynamo (#44) · 602352ce
  Neelay Shah authored Mar 08, 2025
```
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
```
  602352ce
05 Mar, 2025 1 commit
- refactor: rename triton_distributed to dynemo (#22) · 1af7433b
  Neelay Shah authored Mar 05, 2025
```
Co-authored-by: Graham King <grahamk@nvidia.com>
```
  1af7433b
04 Mar, 2025 1 commit
- feat: add python binding for rust llm modules (#13) · a32cdad6
  Biswa Panda authored Mar 04, 2025
  
  a32cdad6
02 Mar, 2025 1 commit
- chore: Update README.md · 3f12b570
  Neelay Shah authored Mar 01, 2025
```
Signed-off-by: Neelay Shah <neelays@nvidia.com>
```
  3f12b570
25 Feb, 2025 1 commit

GuanLuo authored Feb 25, 2025

Signed-off-by: Meenakshi Sharma <163925564+nvda-mesharma@users.noreply.github.com>
Signed-off-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: Ryan Olson <ryanolson@users.noreply.github.com>
Co-authored-by: Meenakshi Sharma <163925564+nvda-mesharma@users.noreply.github.com>
Co-authored-by: Biswa Panda <biswapanda@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

861c5098

21 Feb, 2025 1 commit

feat: Add http support to vllm kv router example (#217) · 15de1807

Alec authored Feb 21, 2025


Co-authored-by: Sean Choi <choishsean@gmail.com>
Co-authored-by: aflowers <aflowers@nvidia.com>

15de1807

20 Feb, 2025 2 commits

feat: add cli args for example http service (#221) · 73c10ae9
Biswa Panda authored Feb 20, 2025
```
Co-authored-by: Biswa Ranjan Panda <biswaranjanp@nvidia.com>
```
73c10ae9

feat: use vllm out of process engine · 60a73634

ptarasiewiczNV authored Feb 20, 2025


Signed-off-by: Piotr Marcinkiewicz <piotrm@nvidia.com>
Co-authored-by: Piotr Marcinkiewicz <piotrm@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

60a73634

18 Feb, 2025 3 commits

feat: add openai endpoint to the vllm example (#183) · 9e4a548d

ptarasiewiczNV authored Feb 18, 2025


Co-authored-by: Ryan Olson <rolson@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

9e4a548d

feat: Add KV publisher and receiver. Add KV aware routing example. · 8588e33a

GuanLuo authored Feb 18, 2025


Signed-off-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: aflowers <aflowers@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>

8588e33a

feat: Add Dockerfile.vllm (#184) · d8aada0b
ptarasiewiczNV authored Feb 18, 2025

d8aada0b

13 Feb, 2025 1 commit
- feat: vLLM v0.7.2 patch supporting XpYd and heterogeneous P/D parallel configs (#167) · f38aa469
  ptarasiewiczNV authored Feb 13, 2025
```
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>
```
  f38aa469
08 Feb, 2025 1 commit

refactor: Modify rust vllm example to use container · d2e7ae02

Ryan McCormick authored Feb 07, 2025


Co-authored-by: Piotr Tarasiewicz <ptarasiewicz@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>

d2e7ae02

07 Feb, 2025 1 commit
- feat: vLLM DistributedRuntime Monolith and Disagg Workers Example · 45bc426c
  ptarasiewiczNV authored Feb 08, 2025
```
Co-authored-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  45bc426c