Commits · d788b63ee76bee6cf5bf6dad24c4cee3421d0af3 · OpenDAS / dynamo

"lib/llm/src/preprocessor.rs" did not exist on "4f6f63cd1692d1929bafac54232f608550719aa4"

17 Mar, 2025 4 commits
- chore: move examples to top level (#220) · 4b1867c5
  Neelay Shah authored Mar 17, 2025
  
  4b1867c5
- revert: "moving examples to top level" (#218) · 21b795e8
  Anant Sharma authored Mar 17, 2025
  
  21b795e8
- moving examples to top level · 8891aa0c
  nnshah1 authored Mar 17, 2025
  
  8891aa0c
- chore: removing outdated examples (#202) · b92834c8
  Neelay Shah authored Mar 16, 2025
  
  b92834c8
14 Mar, 2025 2 commits
- fix: wrong indent -> only one worker metric (#161) · 75c249a2
  Hongkuan Zhou authored Mar 14, 2025
  
  75c249a2
- feat: LLMAPI PoC with dynamo-run launcher (#114) · e0bb5bd3
  Tanmay Verma authored Mar 14, 2025
  
  e0bb5bd3
13 Mar, 2025 1 commit
- fix: Fix TRTLLM chat to work with latest ToT (#127) · 8435b993
  Tanmay Verma authored Mar 12, 2025
```
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  8435b993
12 Mar, 2025 2 commits
- chore: Reduce conditional prefill logs (#121) · a092bcf4
  ptarasiewiczNV authored Mar 12, 2025
```
Co-authored-by: ptarasiewicz@nvidia.com <Piotr Tarasiewicz>
```
  a092bcf4
- fix: Add missing util files to vllm example (#105) · ab33729b
  Neelay Shah authored Mar 11, 2025
  
  ab33729b
11 Mar, 2025 8 commits
- refactor: rename vllm_nixl to vllm and make default (#100) · 5bcdb734
  Neelay Shah authored Mar 11, 2025
  
  5bcdb734
- feat: kv aware disagg router (#98) · a954a1c6
  Hongkuan Zhou authored Mar 11, 2025
```
Co-authored-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
```
  a954a1c6
- refactor: Move rust binaries out of examples, update nixl dockerfile (#89) · e5db9e86
  Neelay Shah authored Mar 11, 2025
```
Co-authored-by: Meenakshi Sharma <163925564+nvda-mesharma@users.noreply.github.com>
```
  e5db9e86
- feat: add new metrics and simple router cost fn (#88) · 3f84cdad
  Alec authored Mar 11, 2025
  
  3f84cdad
- fix: inconsistent router args (#94) · 2153ee81
  Hongkuan Zhou authored Mar 11, 2025
```
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
```
  2153ee81
- fix: add multi-node deployment instruction for vllm-nixl (#93) · e0571935
  Hongkuan Zhou authored Mar 11, 2025
```
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
```
  e0571935
- chore: Simplify the container build instructions for LLMAPI example (#87) · f784b36a
  Tanmay Verma authored Mar 11, 2025
  
  f784b36a
- feat: unified entry point for vllm-nixl (#83) · 30c5a79f
  Hongkuan Zhou authored Mar 10, 2025
```
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
```
  30c5a79f
10 Mar, 2025 2 commits
- chore: update wheel name and reset versions (#73) · fc4da345
  Anant Sharma authored Mar 10, 2025
  
  fc4da345
- feat: LLM API integration with smart routing bits (#55) · 11e3e188
  Tanmay Verma authored Mar 10, 2025
```
Co-authored-by: Shreyas Misra <shreyasm@nvidia.com>
```
  11e3e188
09 Mar, 2025 5 commits

feat: make block_size input for indexer, router, publisher (#66) · 989bb3d5
Alec authored Mar 09, 2025

989bb3d5
chore: stragglers rename (#69) · dd31a322
Neelay Shah authored Mar 09, 2025
```
Co-authored-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
```
dd31a322
feat: make vllm baseline support both chat and completions (#70) · efe82b86
Alec authored Mar 09, 2025

efe82b86

chore: left over renaming (#67) · 678cffb4

Neelay Shah authored Mar 09, 2025


Co-authored-by: Harrison Saturley-Hall <454891+saturley-hall@users.noreply.github.com>
Co-authored-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>

678cffb4

feat: kv aware router + disagg router + prefill queue (#11) · 19844fc0

Hongkuan Zhou authored Mar 08, 2025


Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hongkuan <hongkuanz@nvidia.com>
Co-authored-by: Piotr Tarasiewicz <ptarasiewicz@nvidia.com>
Co-authored-by: Piotr Tarasiewicz Nvidia <ptarasiewicznv@Piotrs-MacBook-Pro.local>
Co-authored-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>

19844fc0

08 Mar, 2025 5 commits
- ci: rename project to dynamo (#60) · 61abae51
  Harrison Saturley-Hall authored Mar 08, 2025
  
  61abae51
- chore: Renamed Triton Distributed to Dynamo (#56) · b4d56a57
  Dmitry Tokarev authored Mar 08, 2025
  
  b4d56a57
- chore: remove debug statements (#57) · dd7646ef
  Neelay Shah authored Mar 08, 2025
  
  dd7646ef
- chore: rename dynamo (#44) · 602352ce
  Neelay Shah authored Mar 08, 2025
```
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
```
  602352ce
- test: add tests for kv bindings (#35) · dcecc47d
  GuanLuo authored Mar 07, 2025
  
  dcecc47d
07 Mar, 2025 2 commits
- test: add gpu sanity test for ci job (#49) · 6705d483
  Anant Sharma authored Mar 07, 2025
  
  6705d483
- feat: onboard dynamo-sdk basic and kv-router examples (#20) · aacc5d76
  Biswa Panda authored Mar 07, 2025
```
Co-authored-by: Neelay Shah <neelays@nvidia.com>
```
  aacc5d76
06 Mar, 2025 3 commits
- feat: Use round robin for disagg routing (#40) · 3c60fe2a
  ptarasiewiczNV authored Mar 07, 2025
```
Co-authored-by: ptarasiewicz@nvidia.com <Piotr Tarasiewicz>
```
  3c60fe2a
- feat: Add estimated kv cache hit metric events (#30) · 09656f6c
  Ryan McCormick authored Mar 06, 2025
  
  09656f6c
- feat: expose KV routing components for easier router customization (#15) · e159e53f
  GuanLuo authored Mar 05, 2025
  
  e159e53f
05 Mar, 2025 2 commits

refactor: rename triton_distributed to dynemo (#22) · 1af7433b
Neelay Shah authored Mar 05, 2025
```
Co-authored-by: Graham King <grahamk@nvidia.com>
```
1af7433b

feat: OAI compatible endpoints for TRTLLM (#14) · 2791b9ea

NVShreyas authored Mar 04, 2025


Co-authored-by: Tanmay Verma <tanmayv@nvidia.com>
Co-authored-by: Tanmay Verma <tanmayv@login-eos01.eos.clusters.nvidia.com>
Co-authored-by: Tanmay Verma <tanmay2592@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>