Commits · 37bc84444e8abea7e3e765929a78b069cd538900 · OpenDAS / dynamo

23 Sep, 2025 11 commits

feat: add trtllm and vllm multinode k8s examples (#3100) · 37bc8444
Julien Mancuso authored Sep 23, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
37bc8444
fix: improve sglang multinode handling in operator (#3151) · 9b893c93
Julien Mancuso authored Sep 23, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
9b893c93
fix: fix broken links (#3186) · c1907d12
Julien Mancuso authored Sep 23, 2025

c1907d12

feat: revamp kubernetes doc (#3173) · 4a718028

Julien Mancuso authored Sep 23, 2025


Signed-off-by: Julien Mancuso <161955438+julienmancuso@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>

4a718028

fix: FullyContiguous Memory Region Size Bug (#3175) · 13a5d61b
Olga Andreeva authored Sep 23, 2025
```
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
```
13a5d61b
feat: Enable vLLM abort while engine is generating the next token (#3102) · 8bb9a555
Jacky authored Sep 23, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
8bb9a555

feat: allow in-cluster perf benchmarks with a kubectl one-liner (#3144) · ce36d9f4

hhzhang16 authored Sep 23, 2025


Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: tmontfort <tmontfort@nvidia.com>
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
Signed-off-by: oandreeva-nv <oandreeva-nv@nvidia.com>
Co-authored-by: zhongdaor-nv <zhongdaor@nvidia.com>
Co-authored-by: Thomas Montfort <61255722+tmonty12@users.noreply.github.com>
Co-authored-by: Keiven C <213854356+keivenchang@users.noreply.github.com>
Co-authored-by: Jacky <18255193+kthui@users.noreply.github.com>
Co-authored-by: Richard Huo <rihuo@nvidia.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Tzu-Ling Kan <tzulingk@nvidia.com>
Co-authored-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Olga Andreeva <124622579+oandreeva-nv@users.noreply.github.com>
Co-authored-by: Ziqi Fan <ziqif@nvidia.com>
Co-authored-by: oandreeva-nv <oandreeva-nv@nvidia.com>

ce36d9f4

feat: use bos_token_id for sglang's health check payload (#3123) · c4334471
Tzu-Ling Kan authored Sep 22, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
c4334471
feat: Trtllm health check payload use bos_token_id (#3145) · 7b43b3a5
Tzu-Ling Kan authored Sep 22, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
7b43b3a5
fix: updated dynamo_check.py for the new TensorRT-LLM tensorrt_llm virtualenv location (#3153) · 517f3024
Keiven C authored Sep 22, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
517f3024
refactor: post-create.sh DYNAMO_HOME refactor that works with the devcontainer.json … (#3167) · e3068d61
Keiven C authored Sep 22, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
e3068d61

22 Sep, 2025 6 commits
- feat: vllm prefill router (#3155) · 031590fc
  Yan Ru Pei authored Sep 22, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  031590fc
- feat: replace Earthly (#2154) · 51b4cd7e
  Julien Mancuso authored Sep 22, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  51b4cd7e
- docs: Fixing Sphinx errors casued by structural problems (#3152) · 5fc0bf92
  Kristen Kelleher authored Sep 22, 2025
```
Signed-off-by: Kristen Kelleher <kkelleher@nvidia.com>
Co-authored-by: nv-nmailhot <nmailhot@nvidia.com>
```
  5fc0bf92
- feat: vllm. Use prefill-specific health check payload and use bos as token_id (#3126) · 6a612a66
  Tzu-Ling Kan authored Sep 22, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  6a612a66
- fix: add deepep and pplx pinning commit in vllm repo checkout (#3168) · 396755eb
  Anant Sharma authored Sep 22, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  396755eb
- refactor: PyTest subprocess for cancellation unit tests (#3127) · 31c78df7
  Jacky authored Sep 22, 2025
```
Signed-off-by: michaelfeil <me@michaelfeil.eu>
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
Co-authored-by: michaelfeil <me@michaelfeil.eu>
```
  31c78df7
20 Sep, 2025 1 commit

docs: Update README.md to bypass nvidia runtime for dcgm-exporter service when... · 007b9d60

Paul Li authored Sep 19, 2025


docs: Update README.md to bypass nvidia runtime for dcgm-exporter service when deploying container for etcd and nats (#3148)
Signed-off-by: Paul Li <zhixiong2008@gmail.com>

007b9d60

19 Sep, 2025 17 commits
- chore: Upgrade Rust to 1.90 (#3147) · 7a5a0bd6
  Graham King authored Sep 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  7a5a0bd6
- ci: add broken links check (#2927) · 406c4d4e
  nv-nmailhot authored Sep 19, 2025
```
Signed-off-by: Nate Mailhot <nmailhot@nvidia.com>
Signed-off-by: nv-nmailhot <nmailhot@nvidia.com>
```
  406c4d4e
- feat: add granite class of reasoning parser (#2936) · 0e63cd9c
  nachiketb-nvidia authored Sep 19, 2025
```
Signed-off-by: nachiketb <nachiketb@nvidia.com>
```
  0e63cd9c
- feat: allow router to not track active blocks (prefill), and to not track... · 5b19a39b
  Yan Ru Pei authored Sep 19, 2025
```
feat: allow router to not track active blocks (prefill), and to not track cached blocks (decode) (#3135)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  5b19a39b
- chore: bump version number of deploy artifacts (#3139) · f78189d7
  Harrison Saturley-Hall authored Sep 19, 2025
```
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
```
  f78189d7
- fix: small planner manifest/doc fixes (#3129) · 7d2fc13e
  Thomas Montfort authored Sep 19, 2025
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
```
  7d2fc13e
- fix: SGLang component names to match worker registration patterns (#3108) · 5915a69b
  GavinZhu-GMI authored Sep 20, 2025
```
Signed-off-by: Gavin.Zhu <gavin.z@gmicloud.ai>
```
  5915a69b
- feat: Port vllm port allocator to Rust in bindings (#3125) · 3865a941
  Graham King authored Sep 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  3865a941
- feat: Add --use-ai-configurator to profile_sla.py (#3079) · 19948b7f
  Ilya Sherstyuk authored Sep 19, 2025
```
Signed-off-by: Ilya Sherstyuk <isherstyuk@nvidia.com>
Signed-off-by: Ilya Sherstyuk <46343317+ilyasher@users.noreply.github.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
```
  19948b7f
- chore(CODEOWNERS): Manage permissions by team not by individual (#3142) · 8534d170
  Graham King authored Sep 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  8534d170
- feat: KVBM connector : enabling vectorized copy from pinned memory to device... · 2d39f1b1
  Olga Andreeva authored Sep 19, 2025
```
feat: KVBM connector : enabling vectorized copy from pinned memory to device memory and vice versa (#2989)
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
Signed-off-by: oandreeva-nv <oandreeva-nv@nvidia.com>
Co-authored-by: Ziqi Fan <ziqif@nvidia.com>
Co-authored-by: oandreeva-nv <oandreeva-nv@nvidia.com>
```
  2d39f1b1
- feat: Convert message[content] from list to string. (#3067) · 5abea1be
  KrishnanPrash authored Sep 19, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  5abea1be
- feat: Sglang canary health check (#3103) · 56f423c6
  Tzu-Ling Kan authored Sep 19, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  56f423c6
- build: OPS-597, OPS-861 restructure TRT-LLM to follow container strategy... · 8c89a555
  Tushar Sharma authored Sep 19, 2025
```
build: OPS-597, OPS-861 restructure TRT-LLM to follow container strategy structure + add gating tests for public CI (#3009)
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  8c89a555
- build: update trtllm to v1.1.0rc5 to enable trtllm + KVBM integration (#3119) · fb29bd5a
  Richard Huo authored Sep 19, 2025
```
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  fb29bd5a
- feat: Request Cancellation unary request support (#3004) · a8fd1271
  Jacky authored Sep 18, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  a8fd1271
- refactor: simplify Dockerfile.vllm, enable local-dev for all frameworks (#3099) · 10bfb73a
  Keiven C authored Sep 18, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  10bfb73a
18 Sep, 2025 5 commits

feat(operator): mechanism for disabling imagePullSecrets discovery (#3092) · 70a8aa3f
Thomas Montfort authored Sep 18, 2025
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
```
70a8aa3f

feat: enhance GPT OSS frontend with improved harmony tool calling parser and... · 6675bfc8

zhongdaor-nv authored Sep 18, 2025


feat: enhance GPT OSS frontend with improved harmony tool calling parser and reasoning parser (#2999)
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>

6675bfc8

feat: remove kubectl dependencies from benchmarking (#3098) · 20b7a8ae

hhzhang16 authored Sep 18, 2025

Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

20b7a8ae

feat: Update docs to indicate need to use consistent hashing for KV events in... · 3b6dbef2

Chi McIsaac authored Sep 18, 2025

feat: Update docs to indicate need to use consistent hashing for KV events in backend engines (#2981)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>

3b6dbef2

chore: add dsr1 k8s yaml (#3101) · 00061061
Hongkuan Zhou authored Sep 18, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
00061061