Commits · d4b5414a0a7aec9d6c9e31beda47771b5d583e74 · OpenDAS / dynamo

21 Jul, 2025 1 commit
- fix: mypy error (#2029) · d4b5414a
  atchernych authored Jul 21, 2025
  
  d4b5414a
17 Jul, 2025 2 commits
- chore: update cmake and gap installation and sgl in wideep container (#1991) · b8474e54
  ishandhanani authored Jul 17, 2025
  
  b8474e54
- chore: add port reservation to utils (#1980) · 4d2a31ab
  ishandhanani authored Jul 16, 2025
  
  4d2a31ab
15 Jul, 2025 1 commit
- docs: organize sglang readme (#1910) · 9e76590f
  ishandhanani authored Jul 14, 2025
  
  9e76590f
14 Jul, 2025 1 commit
- feat: receive kvmetrics from sglang scheduler (#1789) · fc36bf5b
  ishandhanani authored Jul 14, 2025
```
Co-authored-by: zixuanzhang226 <zixuanzhang@bytedance.com>
```
  fc36bf5b
09 Jul, 2025 1 commit
- chore: add info about cache flush and bump version (#1839) · 7dea77c3
  ishandhanani authored Jul 09, 2025
  
  7dea77c3
08 Jul, 2025 1 commit
- chore: multinode dsr1 doc fix (#1814) · 330e649c
  ishandhanani authored Jul 08, 2025
  
  330e649c
07 Jul, 2025 2 commits
- feat: vllm speculative decoding metrics (#1549) · 439e977d
  jain-ria authored Jul 07, 2025
```
Signed-off-by: jain-ria <riajain@NVIDIA.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
```
  439e977d
- feat: add flush_cache endpoint to sglang (#1769) · bd91dca6
  ishandhanani authored Jul 07, 2025
  
  bd91dca6
06 Jul, 2025 1 commit
- feat: automate slurm handling in sglang example. (#1730) · 1630f8ba
  fsaady authored Jul 06, 2025
```
Signed-off-by: Fadi Saady <fsaady@nvidia.com>
```
  1630f8ba
03 Jul, 2025 2 commits
- feat: graceful shutdown for sglang example (#1764) · fb213a2f
  Hongkuan Zhou authored Jul 03, 2025
  
  fb213a2f
- chore(sglang): readme and instruction fixes (#1761) · 8bfc61ac
  ishandhanani authored Jul 03, 2025
  
  8bfc61ac
02 Jul, 2025 1 commit
- feat: add dynamo components for sglang (#1721) · 9cbf8031
  ishandhanani authored Jul 02, 2025
  
  9cbf8031
28 Jun, 2025 1 commit
- feat: add kv router to sglang (#1605) · 0b47f897
  Faradawn Yang authored Jun 28, 2025
  
  0b47f897
27 Jun, 2025 2 commits
- fix: docker compose command for sglang (#1482) · ae47638b
  Faradawn Yang authored Jun 27, 2025
  
  ae47638b
- docs: instructions to run DSR1 with SGLang wideep on 104+ GPUs (#1583) · 9d7624f1
  ishandhanani authored Jun 27, 2025
```
Co-authored-by: kkranen <kyle.kranen@gmail.com>
```
  9d7624f1
25 Jun, 2025 1 commit
- feat: support batch `/completions` (#1626) · fc16a79b
  ishandhanani authored Jun 25, 2025
```
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  fc16a79b
17 Jun, 2025 1 commit
- feat(sglang): deepep sglang support in dynamo (#1120) · 64445c0a
  ishandhanani authored Jun 17, 2025
```
Co-authored-by: kkranen <kyle.kranen@gmail.com>
```
  64445c0a
11 Jun, 2025 1 commit
- docs: add message to guide users to the stable version (#1457) · e32fe675
  richardhuo-nv authored Jun 11, 2025
  
  e32fe675
10 Jun, 2025 1 commit
- chore(sglang): support dp attention routing (#1415) · 47c3dad7
  ishandhanani authored Jun 09, 2025
  
  47c3dad7
03 Jun, 2025 1 commit
- chore: bump sgl and update dp attn yaml (#1362) · 8deb3ea4
  ishandhanani authored Jun 03, 2025
  
  8deb3ea4
29 May, 2025 1 commit

feat: expose estimated kv cache hit in dynamo-run (#1246) · c9eb6a83

Hongkuan Zhou authored May 29, 2025


Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

c9eb6a83

28 May, 2025 1 commit
- chore: bump sglang version (#1219) · 811b10a6
  ishandhanani authored May 27, 2025
  
  811b10a6
27 May, 2025 1 commit
- feat(sglang): add dockerfile/pyproject toml entry + steps to run dsr1 disagg (#1193) · 5c5cec3d
  ishandhanani authored May 27, 2025
```
Signed-off-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>
```
  5c5cec3d
21 May, 2025 1 commit
- feat: rename dynamo decorator (#1133) · 6d46288c
  Biswa Panda authored May 21, 2025
  
  6d46288c
19 May, 2025 1 commit
- fix(sglang): allow for `disaggregation_bootstrap_port` for multinode deployment (#1119) · eb133e3f
  ishandhanani authored May 19, 2025
  
  eb133e3f
14 May, 2025 1 commit
- feat(sglang): disaggregated support (#976) · b43c72a5
  ishandhanani authored May 13, 2025
```
Co-authored-by: ishandhanani <ishandhananai@gmail.com>
```
  b43c72a5
09 May, 2025 3 commits
- fix(deps): sglang install must be done manually (#1019) · 8c6ab977
  ishandhanani authored May 09, 2025
```
Signed-off-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  8c6ab977
- feat: decouple dynamo sdk to support mutiple deployment targets (#905) · d675d221
  Biswa Panda authored May 08, 2025
  
  d675d221
- feat(sglang): aggregated support (#937) · 5d5235bc
  ishandhanani authored May 08, 2025
```
Co-authored-by: ishandhanani <ishandhananai@gmail.com>
```
  5d5235bc