Commits · deb6c7e8141be5bdedf2d1ffe8d7331f6e9e4ff0 · OpenDAS / dynamo

01 Feb, 2025 1 commit

feat(llm): adding initial TRTLLM disaggregation support · deb6c7e8

ishandhanani authored Feb 01, 2025


Co-authored-by: nnshah1 <neelays@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

deb6c7e8

31 Jan, 2025 1 commit
- Increase timeouts on failing tests (#78) · 425be8ad
  glos-nv authored Jan 31, 2025
  
  425be8ad
28 Jan, 2025 1 commit

Clean-up vLLM example to use Operator API (#68) · b9a0ce2c

ptarasiewiczNV authored Jan 28, 2025


Signed-off-by: ptarasiewiczNV <104908264+ptarasiewiczNV@users.noreply.github.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>

b9a0ce2c

27 Jan, 2025 1 commit
- refactor: Improve the usage of logging in worker (#29) · 022b6db5
  Tanmay Verma authored Jan 27, 2025
  
  022b6db5
25 Jan, 2025 1 commit
- chore: Update build version to v0.1.1 and add Teardown section to LLM example README (#66) · 1c1bd7da
  Ryan McCormick authored Jan 24, 2025
  
  1c1bd7da
24 Jan, 2025 4 commits
- Add Release badge to README page · 7366d75d
  Meenakshi Sharma authored Jan 24, 2025
```
Signed-off-by: Meenakshi Sharma <163925564+nvda-mesharma@users.noreply.github.com>
```
  7366d75d
- docs: Add instructions for multi-node disaggregated deployment · 194abde3
  ptarasiewiczNV authored Jan 24, 2025
```
Signed-off-by: ptarasiewiczNV <104908264+ptarasiewiczNV@users.noreply.github.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>
```
  194abde3
- docs: Add link to LLM example in top level README (#61) · a8c5637f
  Ryan McCormick authored Jan 24, 2025
  
  a8c5637f
- feat: Add vLLM workers to LLM example (#41) · f6d723f6
  Blazej authored Jan 24, 2025
```
Add example of LLM disaggregated serving
```
  f6d723f6
23 Jan, 2025 3 commits

vLLM example README (#52) · 8980ec37

ptarasiewiczNV authored Jan 23, 2025

Signed-off-by: ptarasiewiczNV <104908264+ptarasiewiczNV@users.noreply.github.com>
Co-authored-by: Piotr Marcinkiewicz <piotrm@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>

8980ec37

fix: encoder repetition typo · 41527a81
Alec authored Jan 23, 2025
```
Co-authored-by: aflowers <aflowers@nvidia.com>
```
41527a81

refactor: openai server skeleton · 607fac29

Neelay Shah authored Jan 22, 2025


Co-authored-by: rmccorm4 <21284872+rmccorm4@users.noreply.github.com>
Co-authored-by: piotrm-nvidia <62554872+piotrm-nvidia@users.noreply.github.com>

607fac29

22 Jan, 2025 1 commit
- build: update isort known first party config (#50) · c3b84790
  Anant Sharma authored Jan 22, 2025
  
  c3b84790
18 Jan, 2025 1 commit
- docs: hello world readme · 63d178f1
  Neelay Shah authored Jan 17, 2025
```
Docs only change.
```
  63d178f1
17 Jan, 2025 3 commits
- feat: hello world · 4698c0f4
  Neelay Shah authored Jan 17, 2025
```
Co-authored-by: Piotr Marcinkiewicz <piotrm@nvidia.com>
Co-authored-by: Tanmay Verma <tanmay2592@gmail.com>
```
  4698c0f4
- test: Add remaining worker tests (#28) · e6c12674
  Tanmay Verma authored Jan 17, 2025
  
  e6c12674
- docs: Update namespace in README.md · 5a6e57c8
  Neelay Shah authored Jan 16, 2025
  
  5a6e57c8
16 Jan, 2025 3 commits
- test: Simplify e2e integration test for worker (#24) · 53712d62
  Tanmay Verma authored Jan 16, 2025
```
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  53712d62
- ci: wait for mirror sync to finish before ci trigger (#25) · ab274e74
  Anant Sharma authored Jan 16, 2025
  
  ab274e74
- test: Add sanity test for vllm.distributed patched modules · 7af0d2ef
  Ryan McCormick authored Jan 15, 2025
  
  7af0d2ef
15 Jan, 2025 4 commits
- Added CONTRIBUTING.md · a1484532
  Dmitry Tokarev authored Jan 15, 2025
```
---------
Co-authored-by: Neelay Shah <neelays@nvidia.com>
```
  a1484532
- build: Add vllm wheel patch scripts for disaggregated serving · a0e1da03
  Ryan McCormick authored Jan 15, 2025
```
---------
Co-authored-by: Piotr Marcinkiewicz <piotrm@nvidia.com>
```
  a0e1da03
- build: adding framework as environment variable. Can use to select tests. · 587addb9
  Neelay Shah authored Jan 14, 2025
  
  587addb9
- feat: initial worker · f1f29171
  Neelay Shah authored Jan 14, 2025
  
  f1f29171
14 Jan, 2025 2 commits
- Added OSS attributions file (#18) · b0195f54
  Dmitry Tokarev authored Jan 14, 2025
  
  b0195f54
- ci: updating run to enable leaving container image · 15529df7
  Neelay Shah authored Jan 13, 2025
  
  15529df7
13 Jan, 2025 1 commit
- feat: adding initial icp · fd42de29
  Neelay Shah authored Jan 13, 2025
  
  fd42de29
11 Jan, 2025 1 commit
- feat: container build and run enhancements · f753fffc
  Neelay Shah authored Jan 10, 2025
  
  f753fffc
10 Jan, 2025 1 commit
- feat: Add ICP Protos and Python Stub Generation · 1d69e2cb
  Neelay Shah authored Jan 09, 2025
  
  1d69e2cb
09 Jan, 2025 4 commits
- fix: updated with github_ref instead of github_head_ref for testing (#10) · ad94a1d5
  Neelay Shah authored Jan 09, 2025
  
  ad94a1d5
- fix: update copyright year · 70699987
  Neelay Shah authored Jan 09, 2025
```
updating to reflect correct years
```
  70699987
- chore: add pre-commit and additional boilerplate files · df90e29e
  Neelay Shah authored Jan 09, 2025
  
  df90e29e
- updating copyright and license header to match guidance · 61af664b
  nnshah1 authored Jan 08, 2025
  
  61af664b
08 Jan, 2025 3 commits
- fix: remove pinned starlette version · 65d784e8
  Neelay Shah authored Jan 08, 2025
  
  65d784e8
- build: adding in container build scripts · d39695b7
  Neelay Shah authored Jan 08, 2025
  
  d39695b7
- WIP: debugging CI failures. (#4) · 1e4ef91a
  J Wyman authored Jan 08, 2025
  
  1e4ef91a
07 Jan, 2025 2 commits
- docs: Add initial README.md · e94ace1e
  Neelay Shah authored Jan 07, 2025
```
Co-authored-by: Ryan McCormick <mccormick.codes@gmail.com>
```
  e94ace1e
- Adding Apache 2 License · 749846dd
  Neelay Shah authored Jan 06, 2025
```
Using Apache 2 License: https://github.com/apache/.github/blob/main/LICENSE
```
  749846dd
20 Dec, 2024 1 commit
- Create trigger_ci.yml · 7dd7780f
  Meenakshi Sharma authored Dec 20, 2024
  
  7dd7780f