Commits · 3d2928510c77fc6cb29c497c91a493e3d06c0cc1 · OpenDAS / dynamo

13 Mar, 2025 2 commits
- build: add top level rust workspace (#137) · 3d292851
  Anant Sharma authored Mar 13, 2025
  
  3d292851
- build: add CARGO_BUILD_JOBS argument to Dockerfiles (#132) · 3d9ade88
  Pawel Ziecina authored Mar 13, 2025
  
  3d9ade88
11 Mar, 2025 2 commits
- refactor: Move rust binaries out of examples, update nixl dockerfile (#89) · e5db9e86
  Neelay Shah authored Mar 11, 2025
```
Co-authored-by: Meenakshi Sharma <163925564+nvda-mesharma@users.noreply.github.com>
```
  e5db9e86
- chore: Simplify the container build instructions for LLMAPI example (#87) · f784b36a
  Tanmay Verma authored Mar 11, 2025
  
  f784b36a
10 Mar, 2025 1 commit
- chore: update wheel name and reset versions (#73) · fc4da345
  Anant Sharma authored Mar 10, 2025
  
  fc4da345
08 Mar, 2025 2 commits
- chore: rename dynamo (#44) · 602352ce
  Neelay Shah authored Mar 08, 2025
```
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
```
  602352ce
- test: add tests for kv bindings (#35) · dcecc47d
  GuanLuo authored Mar 07, 2025
  
  dcecc47d
07 Mar, 2025 1 commit
- feat: onboard dynamo-sdk basic and kv-router examples (#20) · aacc5d76
  Biswa Panda authored Mar 07, 2025
```
Co-authored-by: Neelay Shah <neelays@nvidia.com>
```
  aacc5d76
05 Mar, 2025 2 commits
- refactor: updated command line arg (#26) · 3ba2b7e9
  Neelay Shah authored Mar 05, 2025
  
  3ba2b7e9
- refactor: rename triton_distributed to dynemo (#22) · 1af7433b
  Neelay Shah authored Mar 05, 2025
```
Co-authored-by: Graham King <grahamk@nvidia.com>
```
  1af7433b
03 Mar, 2025 1 commit

fix: Install specific toolchain (#329) · 2d906fb4

Graham King authored Mar 03, 2025

`cargo build --locked` won't let you use "1.85.0" if you only have "stable" installed, even if those are the same thing right now.

2d906fb4

28 Feb, 2025 1 commit
- Updates to support DS R1 in TRTLLM example (#301) · 12d73a82
  NVShreyas authored Feb 28, 2025
  
  12d73a82
27 Feb, 2025 2 commits
- ci: build wheel from root directory (#274) · ea401e3b
  Anant Sharma authored Feb 27, 2025
  
  ea401e3b
- feat: LLM API example integration (#182) · 4b42b232
  Tanmay Verma authored Feb 27, 2025
```
Co-authored-by: NVShreyas <158103197+NVShreyas@users.noreply.github.com>
```
  4b42b232
26 Feb, 2025 1 commit
- Update Dockerfile to include genai-perf hot fix (#276) · 0db2e6c8
  Piotr Marcinkiewicz authored Feb 26, 2025
```
Signed-off-by: Piotr Marcinkiewicz <piotrm@nvidia.com>
```
  0db2e6c8
25 Feb, 2025 2 commits
- refactor: move libs to lib dir · 08fcd7e9
  Neelay Shah authored Feb 24, 2025
```
Signed-off-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  08fcd7e9
- refactor: remove python native runtime · 0bfd9a76
  Neelay Shah authored Feb 24, 2025
  
  0bfd9a76
24 Feb, 2025 1 commit
- feat: add rust based tokenizer · 4f6f63cd
  Biswa Panda authored Feb 24, 2025
  
  4f6f63cd
18 Feb, 2025 4 commits
- feat: add openai endpoint to the vllm example (#183) · 9e4a548d
  ptarasiewiczNV authored Feb 18, 2025
```
Co-authored-by: Ryan Olson <rolson@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  9e4a548d
- fix: Remove duplicate venv setup in Dockerfile (#205) · 94601e77
  Ryan McCormick authored Feb 18, 2025
  
  94601e77
- feat: Add KV publisher and receiver. Add KV aware routing example. · 8588e33a
  GuanLuo authored Feb 18, 2025
```
Signed-off-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: aflowers <aflowers@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>
```
  8588e33a
- feat: Add Dockerfile.vllm (#184) · d8aada0b
  ptarasiewiczNV authored Feb 18, 2025
  
  d8aada0b
13 Feb, 2025 1 commit
- feat: vLLM v0.7.2 patch supporting XpYd and heterogeneous P/D parallel configs (#167) · f38aa469
  ptarasiewiczNV authored Feb 13, 2025
```
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>
```
  f38aa469
11 Feb, 2025 2 commits
- chore: Add triton_distributed_rs wheel install to container build (#135) · 139a9a83
  Ryan McCormick authored Feb 11, 2025
  
  139a9a83
- chore: Update base from from 24.12 to 25.01 Triton version (#100) · 20b36843
  Tanmay Verma authored Feb 10, 2025
  
  20b36843
08 Feb, 2025 2 commits
- refactor: Modify rust vllm example to use container · d2e7ae02
  Ryan McCormick authored Feb 07, 2025
```
Co-authored-by: Piotr Tarasiewicz <ptarasiewicz@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>
```
  d2e7ae02
- build: Support rebuilding and replacing trtllm backend (#99) · 2cfb1b6d
  Tanmay Verma authored Feb 07, 2025
  
  2cfb1b6d
04 Feb, 2025 3 commits
- build: pip based installation of icp and runtime. Also make tritonserver optional · ccfe101e
  Neelay Shah authored Feb 04, 2025
```
Signed-off-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  ccfe101e
- ci: add rust build and pre-merge checks (#91) · 5701753a
  Anant Sharma authored Feb 04, 2025
  
  5701753a
- chore: updating to mv src directory · b34c6f77
  Neelay Shah authored Feb 03, 2025
  
  b34c6f77
03 Feb, 2025 1 commit
- refactor: worker rename to runtime · 4017bd18
  Neelay Shah authored Feb 03, 2025
  
  4017bd18
01 Feb, 2025 1 commit

feat(llm): adding initial TRTLLM disaggregation support · deb6c7e8

ishandhanani authored Feb 01, 2025


Co-authored-by: nnshah1 <neelays@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

deb6c7e8

24 Jan, 2025 1 commit
- feat: Add vLLM workers to LLM example (#41) · f6d723f6
  Blazej authored Jan 24, 2025
```
Add example of LLM disaggregated serving
```
  f6d723f6
23 Jan, 2025 1 commit

refactor: openai server skeleton · 607fac29

Neelay Shah authored Jan 22, 2025


Co-authored-by: rmccorm4 <21284872+rmccorm4@users.noreply.github.com>
Co-authored-by: piotrm-nvidia <62554872+piotrm-nvidia@users.noreply.github.com>

607fac29

17 Jan, 2025 1 commit

feat: hello world · 4698c0f4

Neelay Shah authored Jan 17, 2025


Co-authored-by: Piotr Marcinkiewicz <piotrm@nvidia.com>
Co-authored-by: Tanmay Verma <tanmay2592@gmail.com>

4698c0f4

15 Jan, 2025 3 commits
- build: Add vllm wheel patch scripts for disaggregated serving · a0e1da03
  Ryan McCormick authored Jan 15, 2025
```
---------
Co-authored-by: Piotr Marcinkiewicz <piotrm@nvidia.com>
```
  a0e1da03
- build: adding framework as environment variable. Can use to select tests. · 587addb9
  Neelay Shah authored Jan 14, 2025
  
  587addb9
- feat: initial worker · f1f29171
  Neelay Shah authored Jan 14, 2025
  
  f1f29171
11 Jan, 2025 1 commit
- feat: container build and run enhancements · f753fffc
  Neelay Shah authored Jan 10, 2025
  
  f753fffc
10 Jan, 2025 1 commit
- feat: Add ICP Protos and Python Stub Generation · 1d69e2cb
  Neelay Shah authored Jan 09, 2025
  
  1d69e2cb