Commits · 993954a6f38163a05e0a29e43d01d316ba02d349 · OpenDAS / dynamo

"deploy/examples/llm/monolith/routerless_deployment.py" did not exist on "177fb3569e517031e0135019300ca55811123257"

01 Feb, 2025 2 commits
- refactor: Replace trtllm example prints with debug logs · 993954a6
  Ryan McCormick authored Feb 01, 2025
  
  993954a6
- feat(llm): adding initial TRTLLM disaggregation support · deb6c7e8
  ishandhanani authored Feb 01, 2025
```
Co-authored-by: nnshah1 <neelays@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  deb6c7e8
28 Jan, 2025 1 commit

Clean-up vLLM example to use Operator API (#68) · b9a0ce2c

ptarasiewiczNV authored Jan 28, 2025


Signed-off-by: ptarasiewiczNV <104908264+ptarasiewiczNV@users.noreply.github.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>

b9a0ce2c

27 Jan, 2025 1 commit
- refactor: Improve the usage of logging in worker (#29) · 022b6db5
  Tanmay Verma authored Jan 27, 2025
  
  022b6db5
25 Jan, 2025 1 commit
- chore: Update build version to v0.1.1 and add Teardown section to LLM example README (#66) · 1c1bd7da
  Ryan McCormick authored Jan 24, 2025
  
  1c1bd7da
24 Jan, 2025 2 commits
- docs: Add instructions for multi-node disaggregated deployment · 194abde3
  ptarasiewiczNV authored Jan 24, 2025
```
Signed-off-by: ptarasiewiczNV <104908264+ptarasiewiczNV@users.noreply.github.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>
```
  194abde3
- feat: Add vLLM workers to LLM example (#41) · f6d723f6
  Blazej authored Jan 24, 2025
```
Add example of LLM disaggregated serving
```
  f6d723f6
23 Jan, 2025 2 commits

vLLM example README (#52) · 8980ec37

ptarasiewiczNV authored Jan 23, 2025

Signed-off-by: ptarasiewiczNV <104908264+ptarasiewiczNV@users.noreply.github.com>
Co-authored-by: Piotr Marcinkiewicz <piotrm@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>

8980ec37

refactor: openai server skeleton · 607fac29

Neelay Shah authored Jan 22, 2025


Co-authored-by: rmccorm4 <21284872+rmccorm4@users.noreply.github.com>
Co-authored-by: piotrm-nvidia <62554872+piotrm-nvidia@users.noreply.github.com>

607fac29