Commits · e9cb035ac72b1b3f88635242db5e773da66d93b8 · OpenDAS / dynamo

09 May, 2025 1 commit
- chore: bump versions and NIXL dependencies for 0.2.1 (#1012) · e9cb035a
  Harrison Saturley-Hall authored May 09, 2025
  
  e9cb035a
07 May, 2025 1 commit

build: Cleans the TensorRTLLM + Dynamo container build (#968) · 7dd79013

Tanmay Verma authored May 07, 2025


Signed-off-by: Tanmay Verma <tanmay2592@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

7dd79013

05 May, 2025 1 commit

chore: merge in support matrix and nixl commit hash (#944) · 67fc3b8c

Harrison Saturley-Hall authored May 05, 2025


Signed-off-by: Harrison Saturley-Hall <454891+saturley-hall@users.noreply.github.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>

67fc3b8c

01 May, 2025 1 commit

feat: Add check for version info in container build script (#774) · b627894a

Abrar Shivani authored May 01, 2025

The build script currently fails on macOS due to an incompatible Bash version. This PR adds a version check to ensure the correct Bash version is being used before proceeding.

Closes GitHub issue: https://github.com/ai-dynamo/dynamo/issues/318

b627894a

28 Apr, 2025 1 commit
- feat: Add unified x86 / aarch64 (ARM) build for VLLM image (#839) · 566068dc
  Ryan McCormick authored Apr 28, 2025
  
  566068dc
25 Apr, 2025 1 commit
- chore: bump NIXL version and package versions (#836) · 0715d469
  Harrison Saturley-Hall authored Apr 25, 2025
```
Signed-off-by: Harrison Saturley-Hall <454891+saturley-hall@users.noreply.github.com>
```
  0715d469
24 Apr, 2025 2 commits
- feat: Add unified x86 / aarch64 (ARM) build for TRTLLM image (#803) · c522253b
  Ryan McCormick authored Apr 24, 2025
```
Signed-off-by: Ryan McCormick <rmccormick@nvidia.com>
```
  c522253b
- fix: Update TRTLLM version and fix disagg workflow (#804) · 197105eb
  Tanmay Verma authored Apr 23, 2025
  
  197105eb
14 Apr, 2025 1 commit

feat: add .devcontainer based off images in container/ (#497) · 0a86edc4

Alec authored Apr 14, 2025

Co-authored-by: Ubuntu <ubuntu@crusoe-prod--inst-2secxwyxeao1mi2dsqk2pl9oaz7.eu-iceland1-a.comp>
Co-authored-by: Hannah Zhang <hannahz@nvidia.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>

0a86edc4

10 Apr, 2025 2 commits
- chore: use latest nixl for docker builds (#593) · 6486dd53
  Anant Sharma authored Apr 10, 2025
  
  6486dd53
- fix: shellcheck errors (#298) · aa83c8aa
  Carsten Csiky authored Apr 10, 2025
```
Co-authored-by: Meenakshi Sharma <163925564+nvda-mesharma@users.noreply.github.com>
```
  aa83c8aa
09 Apr, 2025 1 commit
- feat: Add manylinux support for Dynamo (#536) · 5045ada4
  Pavithra Vijayakrishnan authored Apr 08, 2025
```
Signed-off-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
```
  5045ada4
03 Apr, 2025 1 commit
- feat: Add TensorRT-LLM example for dynamo serve/run (#456) · 6eb10540
  Tanmay Verma authored Apr 03, 2025
```
Co-authored-by: Neelay Shah <neelays@nvidia.com>
```
  6eb10540
28 Mar, 2025 1 commit
- feat: dynamo deploy hello world example to k8s (#205) · 8621d914
  Biswa Panda authored Mar 28, 2025
  
  8621d914
18 Mar, 2025 1 commit
- fix: update default to dev (#251) · 93a46969
  Neelay Shah authored Mar 17, 2025
  
  93a46969
17 Mar, 2025 2 commits
- ci: enable copy-pr-bot, change trigger for internal CI, and optimizations for public CI (#203) · 06c10bba
  Harrison Saturley-Hall authored Mar 17, 2025
  
  06c10bba
- chore: update nixl github commit (#214) · ed83e246
  Anant Sharma authored Mar 17, 2025
```
Co-authored-by: Piotr Tarasiewicz <ptarasiewicz@nvidia.com>
```
  ed83e246
15 Mar, 2025 1 commit
- feat: Support a small runtime container (#167) · f64e2366
  Harrison Saturley-Hall authored Mar 15, 2025
  
  f64e2366
14 Mar, 2025 2 commits
- feat: Support caching nixl build stage (#147) · 2abe926d
  Ryan McCormick authored Mar 14, 2025
  
  2abe926d
- refactor: Remove STANDARD and VLLM_NIXL choices from build/run (#148) · cd14a1c5
  Ryan McCormick authored Mar 14, 2025
  
  cd14a1c5
12 Mar, 2025 2 commits
- fix: bump nixl version (#110) · d57847b2
  Hongkuan Zhou authored Mar 11, 2025
```
Co-authored-by: hongkuan <hongkuanz@nvidia.com>
```
  d57847b2
- build: Changes to support building trtllm image in CI (#108) · 175c1762
  Tanmay Verma authored Mar 11, 2025
  
  175c1762
11 Mar, 2025 3 commits
- refactor: rename vllm_nixl to vllm and make default (#100) · 5bcdb734
  Neelay Shah authored Mar 11, 2025
  
  5bcdb734
- refactor: Move rust binaries out of examples, update nixl dockerfile (#89) · e5db9e86
  Neelay Shah authored Mar 11, 2025
```
Co-authored-by: Meenakshi Sharma <163925564+nvda-mesharma@users.noreply.github.com>
```
  e5db9e86
- chore: Simplify the container build instructions for LLMAPI example (#87) · f784b36a
  Tanmay Verma authored Mar 11, 2025
  
  f784b36a
08 Mar, 2025 1 commit
- chore: Renamed Triton Distributed to Dynamo (#56) · b4d56a57
  Dmitry Tokarev authored Mar 08, 2025
  
  b4d56a57
28 Feb, 2025 1 commit

ci: initial public ci for PRs (#241) · 37a8ebaf

Harrison Saturley-Hall authored Feb 28, 2025

Signed-off-by: Harrison Saturley-Hall <454891+saturley-hall@users.noreply.github.com>
Signed-off-by: Meenakshi Sharma <163925564+nvda-mesharma@users.noreply.github.com>
Co-authored-by: Meenakshi Sharma <163925564+nvda-mesharma@users.noreply.github.com>

37a8ebaf

27 Feb, 2025 2 commits

feat: vLLM + NIXL example · f7a60cba

ptarasiewiczNV authored Feb 27, 2025


Co-authored-by: Piotr Tarasiewicz Nvidia <ptarasiewicznv@Piotrs-MacBook-Pro.local>
Co-authored-by: nnshah1 <neelays@nvidia.com>
Co-authored-by: alec-flowers <aflowers@nvidia.com>

f7a60cba

feat: LLM API example integration (#182) · 4b42b232
Tanmay Verma authored Feb 27, 2025
```
Co-authored-by: NVShreyas <158103197+NVShreyas@users.noreply.github.com>
```
4b42b232

21 Feb, 2025 1 commit
- build: Multi-stage VLLM Build (#225) · 6e0ccccb
  Ryan McCormick authored Feb 21, 2025
  
  6e0ccccb
18 Feb, 2025 2 commits

feat: Add KV publisher and receiver. Add KV aware routing example. · 8588e33a

GuanLuo authored Feb 18, 2025


Signed-off-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: aflowers <aflowers@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>

8588e33a

feat: Add Dockerfile.vllm (#184) · d8aada0b
ptarasiewiczNV authored Feb 18, 2025

d8aada0b

13 Feb, 2025 1 commit
- feat: vLLM v0.7.2 patch supporting XpYd and heterogeneous P/D parallel configs (#167) · f38aa469
  ptarasiewiczNV authored Feb 13, 2025
```
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>
```
  f38aa469
11 Feb, 2025 1 commit
- chore: Update base from from 24.12 to 25.01 Triton version (#100) · 20b36843
  Tanmay Verma authored Feb 10, 2025
  
  20b36843
08 Feb, 2025 1 commit
- build: Support rebuilding and replacing trtllm backend (#99) · 2cfb1b6d
  Tanmay Verma authored Feb 07, 2025
  
  2cfb1b6d
06 Feb, 2025 1 commit
- fix: Set default 'latest' tag if git tags fail to get parsed (#118) · 7894967e
  Ryan McCormick authored Feb 05, 2025
  
  7894967e
04 Feb, 2025 1 commit
- build: pip based installation of icp and runtime. Also make tritonserver optional · ccfe101e
  Neelay Shah authored Feb 04, 2025
```
Signed-off-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  ccfe101e
01 Feb, 2025 1 commit

docs: Add Llama 70B benchmark reproduction and results · 04e50aba

ptarasiewiczNV authored Feb 01, 2025


Signed-off-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: Piotr Marcinkiewicz <piotrm@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

04e50aba

25 Jan, 2025 1 commit
- chore: Update build version to v0.1.1 and add Teardown section to LLM example README (#66) · 1c1bd7da
  Ryan McCormick authored Jan 24, 2025
  
  1c1bd7da
15 Jan, 2025 1 commit
- build: Add vllm wheel patch scripts for disaggregated serving · a0e1da03
  Ryan McCormick authored Jan 15, 2025
```
---------
Co-authored-by: Piotr Marcinkiewicz <piotrm@nvidia.com>
```
  a0e1da03