Commits · 6eb10540014bc53776af9a5f8072032137dcb227 · OpenDAS / dynamo

03 Apr, 2025 1 commit
- feat: Add TensorRT-LLM example for dynamo serve/run (#456) · 6eb10540
  Tanmay Verma authored Apr 03, 2025
```
Co-authored-by: Neelay Shah <neelays@nvidia.com>
```
  6eb10540
02 Apr, 2025 1 commit
- feat: improve serve commands and expose `DYNAMO_HOME` env var (#436) · 146f2eef
  jon-chuang authored Apr 02, 2025
```
Co-authored-by: Ryan Olson <ryanolson@users.noreply.github.com>
```
  146f2eef
01 Apr, 2025 1 commit
- feat(serve): Enhance multi-node deployment and worker configuration (#457) · 5fe1f8a2
  ishandhanani authored Apr 01, 2025
```
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
```
  5fe1f8a2
31 Mar, 2025 1 commit
- fix: prefill queue handler async task should not silently error (#442) · fcdcb12f
  jon-chuang authored Mar 30, 2025
  
  fcdcb12f
26 Mar, 2025 2 commits
- feat: Decode -> Prefill cached kv transfer (#340) · 17827e1d
  ptarasiewiczNV authored Mar 26, 2025
  
  17827e1d
- chore: more Pythonic kv router cleanups in examples (#396) · a544d823
  Yan Ru Pei authored Mar 25, 2025
  
  a544d823
24 Mar, 2025 1 commit
- feat: conditional disagg based on prefill queue size (#303) · d29f7fcc
  Hongkuan Zhou authored Mar 24, 2025
  
  d29f7fcc
20 Mar, 2025 1 commit
- chore: KV router Pythonic cleanups (#324) · 43ff14ce
  Yan Ru Pei authored Mar 20, 2025
  
  43ff14ce
19 Mar, 2025 3 commits
- feat: `Frontend` component uses served_model_name instead of model (#302) · 1f6ccc7f
  ishandhanani authored Mar 19, 2025
  
  1f6ccc7f
- chore: remove older unused components (#300) · 476174f3
  ishandhanani authored Mar 19, 2025
  
  476174f3
- fix: Add __init__.py for compoments folder in llm example (#299) · ff3413be
  Piotr Marcinkiewicz authored Mar 19, 2025
  
  ff3413be
18 Mar, 2025 2 commits
- feat: add local gpu allocation (#232) · 9f0181a8
  Biswa Panda authored Mar 18, 2025
```
Co-authored-by: Meenakshi Sharma <163925564+nvda-mesharma@users.noreply.github.com>
```
  9f0181a8
- docs: fix links in docs (#256) · 548578f4
  Dmitry Tokarev authored Mar 18, 2025
```
Co-authored-by: Anant Sharma <anants@nvidia.com>
```
  548578f4
17 Mar, 2025 6 commits
- fix: propogate env vars from input cli/yaml into process (#208) · a611726e
  ishandhanani authored Mar 17, 2025
  
  a611726e
- docs: Update dynamo serve disagg example (#212) · 41ec2338
  ptarasiewiczNV authored Mar 17, 2025
```
Co-authored-by: ptarasiewicz@nvidia.com <Piotr Tarasiewicz>
```
  41ec2338
- chore: move examples to top level (#220) · 4b1867c5
  Neelay Shah authored Mar 17, 2025
  
  4b1867c5
- revert: "moving examples to top level" (#218) · 21b795e8
  Anant Sharma authored Mar 17, 2025
  
  21b795e8
- moving examples to top level · 8891aa0c
  nnshah1 authored Mar 17, 2025
  
  8891aa0c
- chore: removing outdated examples (#202) · b92834c8
  Neelay Shah authored Mar 16, 2025
  
  b92834c8
14 Mar, 2025 2 commits
- fix: wrong indent -> only one worker metric (#161) · 75c249a2
  Hongkuan Zhou authored Mar 14, 2025
  
  75c249a2
- feat: LLMAPI PoC with dynamo-run launcher (#114) · e0bb5bd3
  Tanmay Verma authored Mar 14, 2025
  
  e0bb5bd3
13 Mar, 2025 1 commit
- fix: Fix TRTLLM chat to work with latest ToT (#127) · 8435b993
  Tanmay Verma authored Mar 12, 2025
```
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  8435b993
12 Mar, 2025 2 commits
- chore: Reduce conditional prefill logs (#121) · a092bcf4
  ptarasiewiczNV authored Mar 12, 2025
```
Co-authored-by: ptarasiewicz@nvidia.com <Piotr Tarasiewicz>
```
  a092bcf4
- fix: Add missing util files to vllm example (#105) · ab33729b
  Neelay Shah authored Mar 11, 2025
  
  ab33729b
11 Mar, 2025 8 commits
- refactor: rename vllm_nixl to vllm and make default (#100) · 5bcdb734
  Neelay Shah authored Mar 11, 2025
  
  5bcdb734
- feat: kv aware disagg router (#98) · a954a1c6
  Hongkuan Zhou authored Mar 11, 2025
```
Co-authored-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
```
  a954a1c6
- refactor: Move rust binaries out of examples, update nixl dockerfile (#89) · e5db9e86
  Neelay Shah authored Mar 11, 2025
```
Co-authored-by: Meenakshi Sharma <163925564+nvda-mesharma@users.noreply.github.com>
```
  e5db9e86
- feat: add new metrics and simple router cost fn (#88) · 3f84cdad
  Alec authored Mar 11, 2025
  
  3f84cdad
- fix: inconsistent router args (#94) · 2153ee81
  Hongkuan Zhou authored Mar 11, 2025
```
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
```
  2153ee81
- fix: add multi-node deployment instruction for vllm-nixl (#93) · e0571935
  Hongkuan Zhou authored Mar 11, 2025
```
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
```
  e0571935
- chore: Simplify the container build instructions for LLMAPI example (#87) · f784b36a
  Tanmay Verma authored Mar 11, 2025
  
  f784b36a
- feat: unified entry point for vllm-nixl (#83) · 30c5a79f
  Hongkuan Zhou authored Mar 10, 2025
```
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
```
  30c5a79f
10 Mar, 2025 2 commits
- chore: update wheel name and reset versions (#73) · fc4da345
  Anant Sharma authored Mar 10, 2025
  
  fc4da345
- feat: LLM API integration with smart routing bits (#55) · 11e3e188
  Tanmay Verma authored Mar 10, 2025
```
Co-authored-by: Shreyas Misra <shreyasm@nvidia.com>
```
  11e3e188
09 Mar, 2025 5 commits

feat: make block_size input for indexer, router, publisher (#66) · 989bb3d5
Alec authored Mar 09, 2025

989bb3d5
chore: stragglers rename (#69) · dd31a322
Neelay Shah authored Mar 09, 2025
```
Co-authored-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
```
dd31a322
feat: make vllm baseline support both chat and completions (#70) · efe82b86
Alec authored Mar 09, 2025

efe82b86

chore: left over renaming (#67) · 678cffb4

Neelay Shah authored Mar 09, 2025


Co-authored-by: Harrison Saturley-Hall <454891+saturley-hall@users.noreply.github.com>
Co-authored-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>

678cffb4

feat: kv aware router + disagg router + prefill queue (#11) · 19844fc0

Hongkuan Zhou authored Mar 08, 2025


Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hongkuan <hongkuanz@nvidia.com>
Co-authored-by: Piotr Tarasiewicz <ptarasiewicz@nvidia.com>
Co-authored-by: Piotr Tarasiewicz Nvidia <ptarasiewicznv@Piotrs-MacBook-Pro.local>
Co-authored-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>

19844fc0

08 Mar, 2025 1 commit
- ci: rename project to dynamo (#60) · 61abae51
  Harrison Saturley-Hall authored Mar 08, 2025
  
  61abae51