Commits · 6a1350c71bdf87e9062d51db5cbeffdce34d04da · OpenDAS / dynamo

14 Jul, 2025 4 commits
- build: minor improvements to sglang dockerfile (#1917) · 6a1350c7
  Tushar Sharma authored Jul 14, 2025
  
  6a1350c7
- fix: copy attributions and license to trtllm runtime container (#1916) · 3e0cb073
  Anant Sharma authored Jul 14, 2025
  
  3e0cb073
- feat: Shrink the ai-dynamo wheel by 35 MiB (#1918) · ad8ad66b
  Graham King authored Jul 14, 2025
```
Remove http and llmctl binaries. They have been unused for a while.
```
  ad8ad66b
- build: Add support for sglang runtime image (#1770) · 6cdda03b
  Tushar Sharma authored Jul 13, 2025
  
  6cdda03b
11 Jul, 2025 2 commits
- chore: update nixl to 0.4.0 release (#1860) (#1886) · d975761b
  Anant Sharma authored Jul 11, 2025
  
  d975761b
- fix: add missing av dependency in contanier for multimodal examples (#1881) · 26d7a61e
  Biswa Panda authored Jul 10, 2025
  
  26d7a61e
10 Jul, 2025 4 commits
- build: Revert "chore: update nixl to 0.4.0 release" (#1880) · 1704b126
  Tushar Sharma authored Jul 10, 2025
  
  1704b126
- refactor: vllm v1 examples (#1756) · f242b455
  Alec authored Jul 10, 2025
```
Signed-off-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: ptarasiewiczNV <104908264+ptarasiewiczNV@users.noreply.github.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
```
  f242b455
- build: Upgrade nats & etcd version in all containers (#1865) · 7183683e
  Tushar Sharma authored Jul 10, 2025
  
  7183683e
- chore: update nixl to 0.4.0 release (#1860) · 5fa4cdda
  Anant Sharma authored Jul 10, 2025
  
  5fa4cdda
09 Jul, 2025 1 commit
- chore: add info about cache flush and bump version (#1839) · 7dea77c3
  ishandhanani authored Jul 09, 2025
  
  7dea77c3
08 Jul, 2025 4 commits
- fix: update trtllm runtime build (#1810) · 789c8284
  Anant Sharma authored Jul 08, 2025
  
  789c8284
- chore: add `net-tools` to dockerfile for `ifconfig` usage in deployment (#1818) · eec49661
  ishandhanani authored Jul 08, 2025
  
  eec49661
- feat: add runtime image for trtllm container build (#1796) · 909a9a9f
  Anant Sharma authored Jul 08, 2025
  
  909a9a9f
- feat: predictive active blocks for routing without load metrics (#1731) · 84e71e27
  Yan Ru Pei authored Jul 08, 2025
```
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
```
  84e71e27
07 Jul, 2025 3 commits
- feat: vllm speculative decoding metrics (#1549) · 439e977d
  jain-ria authored Jul 07, 2025
```
Signed-off-by: jain-ria <riajain@NVIDIA.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
```
  439e977d
- chore: update versions for 0.3.2 release (#1793) · c4935b34
  Anant Sharma authored Jul 07, 2025
  
  c4935b34
- fix: Set TRTLLM_USE_UCX_KVCACHE by default in container image (#1777) · b2044566
  Tanmay Verma authored Jul 07, 2025
  
  b2044566
03 Jul, 2025 2 commits
- chore: update nixl to latest 0.3.1 commit (#1762) · a9241b61
  Anant Sharma authored Jul 03, 2025
  
  a9241b61
- chore: sgl container hash and python path bump (#1741) · 2f38e10f
  ishandhanani authored Jul 02, 2025
  
  2f38e10f
02 Jul, 2025 1 commit
- feat: add dynamo components for sglang (#1721) · 9cbf8031
  ishandhanani authored Jul 02, 2025
  
  9cbf8031
30 Jun, 2025 2 commits
- fix: bump vLLM commit and revert side channel host change for DS R1 DEP deployment (#1696) · 9cd9993d
  GuanLuo authored Jun 30, 2025
```
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
```
  9cd9993d
- feat: support sla planner in vllm_v1 example (#1680) · 2bed47eb
  Hongkuan Zhou authored Jun 30, 2025
  
  2bed47eb
27 Jun, 2025 1 commit
- docs: instructions to run DSR1 with SGLang wideep on 104+ GPUs (#1583) · 9d7624f1
  ishandhanani authored Jun 27, 2025
```
Co-authored-by: kkranen <kyle.kranen@gmail.com>
```
  9d7624f1
26 Jun, 2025 2 commits
- feat: Add experimental WideEP + EPLB aggregated example for TRTLLM (#1652) · 5fe5a950
  Ryan McCormick authored Jun 27, 2025
  
  5fe5a950
- feat: Set NIXL env vars in ci_minimum and dev images (#1662) · f11fc3f3
  jthomson04 authored Jun 26, 2025
  
  f11fc3f3
25 Jun, 2025 2 commits
- feat: support batch `/completions` (#1626) · fc16a79b
  ishandhanani authored Jun 25, 2025
```
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  fc16a79b
- fix: Disable NIXL backend for TRTLLM on ARM (#1639) · e84b1e77
  Tanmay Verma authored Jun 25, 2025
  
  e84b1e77
24 Jun, 2025 2 commits
- fix: pin versions on docs dockerfile (#1627) · 57f5725d
  Anant Sharma authored Jun 24, 2025
  
  57f5725d
- feat: Using NIXL for KV cache transfer when using disaggregated serving in TRTLLM (#1591) · 0b7cdf55
  Tanmay Verma authored Jun 24, 2025
```
Signed-off-by: Tanmay Verma <tanmay2592@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  0b7cdf55
18 Jun, 2025 2 commits

build(deps): bump protobuf from 5.27.3 to 5.29.5 in /container/deps (#1556) · 2528ea2c

dependabot[bot] authored Jun 18, 2025


Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

2528ea2c

chore: remove unneccssary line (#1582) · d2bec6f8
tlipoca9 authored Jun 18, 2025
```
Signed-off-by: tlipoca9 <160737620+tlipoca9@users.noreply.github.com>
```
d2bec6f8

17 Jun, 2025 4 commits
- fix: replace tabs with whitespaces in container/run.sh (#1553) · 44c5be7e
  sanshang-nv authored Jun 18, 2025
```
Signed-off-by: Sanshan Gao <sanshang@nvidia.com>
```
  44c5be7e
- feat(sglang): deepep sglang support in dynamo (#1120) · 64445c0a
  ishandhanani authored Jun 17, 2025
```
Co-authored-by: kkranen <kyle.kranen@gmail.com>
```
  64445c0a
- feat: add vllm_v1 framework to run command (#1550) · 9f81df28
  Biswa Panda authored Jun 16, 2025
  
  9f81df28
- fix: update nixl build and keep wheels dir in vllm container (#1544) · 7609c0dc
  Anant Sharma authored Jun 16, 2025
  
  7609c0dc
16 Jun, 2025 2 commits
- fix: remove lib.real from LD_LIBRARY_PATH (#1546) · a67e682b
  Tanmay Verma authored Jun 16, 2025
  
  a67e682b
- build: DIS-148 use the tensorrt_llm public wheel from pypi by default in container build (#1525) · 47d05d7a
  richardhuo-nv authored Jun 16, 2025
  
  47d05d7a
14 Jun, 2025 2 commits

feat: add VllmDpWorker for DP setup (#1513) · 1906b702

GuanLuo authored Jun 13, 2025


Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: ptarasiewiczNV <104908264+ptarasiewiczNV@users.noreply.github.com>

1906b702

feat: SLA-based Planner (#1420) · 3f53a78e

Hongkuan Zhou authored Jun 13, 2025

Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

3f53a78e