Commits · 43b62ce21629b0ef57c28dfffdf2345c2827876d · OpenDAS / dynamo

03 Apr, 2025 1 commit
- docs: add 405b disaggregated serving documentation (#496) · 43b62ce2
  ishandhanani authored Apr 03, 2025
  
  43b62ce2
02 Apr, 2025 1 commit
- feat: improve serve commands and expose `DYNAMO_HOME` env var (#436) · 146f2eef
  jon-chuang authored Apr 02, 2025
```
Co-authored-by: Ryan Olson <ryanolson@users.noreply.github.com>
```
  146f2eef
01 Apr, 2025 1 commit
- feat(serve): Enhance multi-node deployment and worker configuration (#457) · 5fe1f8a2
  ishandhanani authored Apr 01, 2025
```
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
```
  5fe1f8a2
31 Mar, 2025 1 commit
- fix: prefill queue handler async task should not silently error (#442) · fcdcb12f
  jon-chuang authored Mar 30, 2025
  
  fcdcb12f
26 Mar, 2025 2 commits
- feat: Decode -> Prefill cached kv transfer (#340) · 17827e1d
  ptarasiewiczNV authored Mar 26, 2025
  
  17827e1d
- chore: more Pythonic kv router cleanups in examples (#396) · a544d823
  Yan Ru Pei authored Mar 25, 2025
  
  a544d823
24 Mar, 2025 1 commit
- feat: conditional disagg based on prefill queue size (#303) · d29f7fcc
  Hongkuan Zhou authored Mar 24, 2025
  
  d29f7fcc
20 Mar, 2025 1 commit
- chore: KV router Pythonic cleanups (#324) · 43ff14ce
  Yan Ru Pei authored Mar 20, 2025
  
  43ff14ce
19 Mar, 2025 3 commits
- feat: `Frontend` component uses served_model_name instead of model (#302) · 1f6ccc7f
  ishandhanani authored Mar 19, 2025
  
  1f6ccc7f
- chore: remove older unused components (#300) · 476174f3
  ishandhanani authored Mar 19, 2025
  
  476174f3
- fix: Add __init__.py for compoments folder in llm example (#299) · ff3413be
  Piotr Marcinkiewicz authored Mar 19, 2025
  
  ff3413be
18 Mar, 2025 2 commits
- feat: add local gpu allocation (#232) · 9f0181a8
  Biswa Panda authored Mar 18, 2025
```
Co-authored-by: Meenakshi Sharma <163925564+nvda-mesharma@users.noreply.github.com>
```
  9f0181a8
- docs: fix links in docs (#256) · 548578f4
  Dmitry Tokarev authored Mar 18, 2025
```
Co-authored-by: Anant Sharma <anants@nvidia.com>
```
  548578f4
17 Mar, 2025 5 commits
- fix: propogate env vars from input cli/yaml into process (#208) · a611726e
  ishandhanani authored Mar 17, 2025
  
  a611726e
- docs: Update dynamo serve disagg example (#212) · 41ec2338
  ptarasiewiczNV authored Mar 17, 2025
```
Co-authored-by: ptarasiewicz@nvidia.com <Piotr Tarasiewicz>
```
  41ec2338
- chore: move examples to top level (#220) · 4b1867c5
  Neelay Shah authored Mar 17, 2025
  
  4b1867c5
- revert: "moving examples to top level" (#218) · 21b795e8
  Anant Sharma authored Mar 17, 2025
  
  21b795e8
- moving examples to top level · 8891aa0c
  nnshah1 authored Mar 17, 2025
  
  8891aa0c
03 Feb, 2025 1 commit
- refactor: worker rename to runtime · 4017bd18
  Neelay Shah authored Feb 03, 2025
  
  4017bd18
01 Feb, 2025 4 commits
- Adjustment for multi node benchmark · 8492333b
  Piotr Marcinkiewicz authored Feb 02, 2025
```
Signed-off-by: Piotr Marcinkiewicz <piotrm@nvidia.com>
```
  8492333b
- docs: Add Llama 70B benchmark reproduction and results · 04e50aba
  ptarasiewiczNV authored Feb 01, 2025
```
Signed-off-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: Piotr Marcinkiewicz <piotrm@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  04e50aba
- refactor: Replace trtllm example prints with debug logs · 993954a6
  Ryan McCormick authored Feb 01, 2025
  
  993954a6
- feat(llm): adding initial TRTLLM disaggregation support · deb6c7e8
  ishandhanani authored Feb 01, 2025
```
Co-authored-by: nnshah1 <neelays@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  deb6c7e8
28 Jan, 2025 1 commit

Clean-up vLLM example to use Operator API (#68) · b9a0ce2c

ptarasiewiczNV authored Jan 28, 2025


Signed-off-by: ptarasiewiczNV <104908264+ptarasiewiczNV@users.noreply.github.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>

b9a0ce2c

27 Jan, 2025 1 commit
- refactor: Improve the usage of logging in worker (#29) · 022b6db5
  Tanmay Verma authored Jan 27, 2025
  
  022b6db5
25 Jan, 2025 1 commit
- chore: Update build version to v0.1.1 and add Teardown section to LLM example README (#66) · 1c1bd7da
  Ryan McCormick authored Jan 24, 2025
  
  1c1bd7da
24 Jan, 2025 2 commits
- docs: Add instructions for multi-node disaggregated deployment · 194abde3
  ptarasiewiczNV authored Jan 24, 2025
```
Signed-off-by: ptarasiewiczNV <104908264+ptarasiewiczNV@users.noreply.github.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>
```
  194abde3
- feat: Add vLLM workers to LLM example (#41) · f6d723f6
  Blazej authored Jan 24, 2025
```
Add example of LLM disaggregated serving
```
  f6d723f6
23 Jan, 2025 2 commits

vLLM example README (#52) · 8980ec37

ptarasiewiczNV authored Jan 23, 2025

Signed-off-by: ptarasiewiczNV <104908264+ptarasiewiczNV@users.noreply.github.com>
Co-authored-by: Piotr Marcinkiewicz <piotrm@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>

8980ec37

refactor: openai server skeleton · 607fac29

Neelay Shah authored Jan 22, 2025


Co-authored-by: rmccorm4 <21284872+rmccorm4@users.noreply.github.com>
Co-authored-by: piotrm-nvidia <62554872+piotrm-nvidia@users.noreply.github.com>

607fac29