Commits · 9e8f67ed0fd975bf8d9bb39fdc5e60946df34b84 · OpenDAS / dynamo

24 Sep, 2025 5 commits
- fix: update the tags for consistency and remove 0.4.1 refs (#3058) · 9e8f67ed
  Harrison Saturley-Hall authored Sep 24, 2025
```
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
```
  9e8f67ed
- feat: add NIM FE (num_request_max) + runtime config metrics with periodic polling (#3107) · 116b9b43
  Keiven C authored Sep 24, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  116b9b43
- feat: update planner manifests for Grove support (#3203) · 8bc2191e
  Thomas Montfort authored Sep 24, 2025
  
  8bc2191e
- feat: allow framework tokenization/detokenization (#3134) · f9be2e9e
  ishandhanani authored Sep 24, 2025
```
Co-authored-by: Ubuntu <ubuntu@ip-172-31-44-124.ec2.internal>
```
  f9be2e9e
- feat: support MoE model in SLA Planner Sglang (#3185) · 6243bcbe
  Hongkuan Zhou authored Sep 23, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
```
  6243bcbe
23 Sep, 2025 5 commits
- feat: add trtllm and vllm multinode k8s examples (#3100) · 37bc8444
  Julien Mancuso authored Sep 23, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  37bc8444
- feat: revamp kubernetes doc (#3173) · 4a718028
  Julien Mancuso authored Sep 23, 2025
```
Signed-off-by: Julien Mancuso <161955438+julienmancuso@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
```
  4a718028
- feat: Enable vLLM abort while engine is generating the next token (#3102) · 8bb9a555
  Jacky authored Sep 23, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  8bb9a555
- feat: use bos_token_id for sglang's health check payload (#3123) · c4334471
  Tzu-Ling Kan authored Sep 22, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  c4334471
- feat: Trtllm health check payload use bos_token_id (#3145) · 7b43b3a5
  Tzu-Ling Kan authored Sep 22, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  7b43b3a5
22 Sep, 2025 2 commits
- feat: vllm prefill router (#3155) · 031590fc
  Yan Ru Pei authored Sep 22, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  031590fc
- feat: vllm. Use prefill-specific health check payload and use bos as token_id (#3126) · 6a612a66
  Tzu-Ling Kan authored Sep 22, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  6a612a66
19 Sep, 2025 4 commits
- fix: small planner manifest/doc fixes (#3129) · 7d2fc13e
  Thomas Montfort authored Sep 19, 2025
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
```
  7d2fc13e
- fix: SGLang component names to match worker registration patterns (#3108) · 5915a69b
  GavinZhu-GMI authored Sep 20, 2025
```
Signed-off-by: Gavin.Zhu <gavin.z@gmicloud.ai>
```
  5915a69b
- feat: Port vllm port allocator to Rust in bindings (#3125) · 3865a941
  Graham King authored Sep 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  3865a941
- feat: Sglang canary health check (#3103) · 56f423c6
  Tzu-Ling Kan authored Sep 19, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  56f423c6
18 Sep, 2025 2 commits

feat: Update docs to indicate need to use consistent hashing for KV events in... · 3b6dbef2

Chi McIsaac authored Sep 18, 2025

feat: Update docs to indicate need to use consistent hashing for KV events in backend engines (#2981)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>

3b6dbef2

chore(bindings): Provide a binding to clear etcd namespace (#3094) · b6595e24
Graham King authored Sep 18, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
b6595e24

17 Sep, 2025 4 commits
- fix: Update the KVBM <> TRT-LLM integration interface to match the latest... · 86ce03f4
  Richard Huo authored Sep 17, 2025
```
fix: Update the KVBM <> TRT-LLM integration interface to match the latest TRT-LLM connector API (#2979)
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  86ce03f4
- feat: Trtllm canary health check (#3082) · 67ff181d
  Tzu-Ling Kan authored Sep 17, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
Signed-off-by: Tzu-Ling Kan <tzulingk@nvidia.com>
```
  67ff181d
- fix: resolve token loss bug in final packet (#2985) · 045b61dd
  Xuwei authored Sep 17, 2025
```
Signed-off-by: Xuwei Li <lixuwei.xy@gmail.com>
```
  045b61dd
- feat: Canary Health Check. (#2903) · 08cb08c1
  Tzu-Ling Kan authored Sep 16, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  08cb08c1
16 Sep, 2025 3 commits
- fix: move deep_update function to trtllm folder (#3070) · 2bb1b268
  Hongkuan Zhou authored Sep 16, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  2bb1b268
- fix: replace hard coded dynamo namespace with env var (#3048) · 960dc896
  Biswa Panda authored Sep 16, 2025
```
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
```
  960dc896
- chore: Remove more extended Apache headers (#3063) · 723f2da7
  Graham King authored Sep 16, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  723f2da7
10 Sep, 2025 3 commits

feat: support trtllm in sla-planner (#2980) · dcee4dbd

Hongkuan Zhou authored Sep 10, 2025


Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: ayushag <ayushag@nvidia.com>
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
Signed-off-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Signed-off-by: Harry Kim <harry_kim@live.com>
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Signed-off-by: GuanLuo <gluo@nvidia.com>
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: Graham King <grahamk@nvidia.com>
Signed-off-by: Anant Sharma <anants@nvidia.com>
Signed-off-by: Greg Clark <grclark@nvidia.com>
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
Co-authored-by: Dillon Cullinan <dcullinan92@gmail.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: julienmancuso <161955438+julienmancuso@users.noreply.github.com>
Co-authored-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Co-authored-by: Harry Kim <harry_kim@live.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Graham King <grahamk@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Greg Clark <grclark@nvidia.com>
Co-authored-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: nv-nmailhot <nmailhot@nvidia.com>

dcee4dbd

feat: sglang multiple frontend slurm deployment scripts (#2623) · 4b3a2c1a

ishandhanani authored Sep 10, 2025


Signed-off-by: ishandhanani <ishandhanani@gmail.com>
Signed-off-by: Elnifio <elnifio0519@gmail.com>
Co-authored-by: Yunzhou Liu <46603306+Elnifio@users.noreply.github.com>

4b3a2c1a

fix: dyn namespace scoping for trtllm (#2970) · 905c920b
Biswa Panda authored Sep 09, 2025
```
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
```
905c920b

09 Sep, 2025 6 commits
- chore: Update trtllm version to 1.1.0rc3 (#2930) · e8cb972e
  Indrajit Bhosale authored Sep 09, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  e8cb972e
- feat: add a virtual connector for 3rd party deployments (#2913) · 8543d0d3
  Hongkuan Zhou authored Sep 09, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  8543d0d3
- docs: fix broken links (#2965) · 3ea3d59b
  nv-nmailhot authored Sep 09, 2025
  
  3ea3d59b
- fix: no reasoning parser by default (#2939) · 939ede86
  Neal Vaidya authored Sep 09, 2025
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
```
  939ede86
- feat: update benchmarking and deploy utils (#2933) · 09c7b73c
  hhzhang16 authored Sep 08, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  09c7b73c
- feat: automatically setup and inject prometheus configuration (#2912) · 729b5fd5
  julienmancuso authored Sep 08, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  729b5fd5
08 Sep, 2025 3 commits
- refactor: standardize e2e tests across 3 frameworks (#2827) · 93208162
  Alec authored Sep 08, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  93208162
- chore: add preference logic for using tool-call and reasoning parsers for sglang (#2922) · 4a73b3c6
  Ayush Agarwal authored Sep 08, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  4a73b3c6
- fix: fix typo in multinode example (#2931) · 6441ed36
  julienmancuso authored Sep 08, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  6441ed36
05 Sep, 2025 2 commits
- feat: add trtllm example with config (#2895) · 0d9c8994
  julienmancuso authored Sep 05, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  0d9c8994
- docs: change docs to default port 8000 (#2876) · 1995ef9a
  Yan Ru Pei authored Sep 04, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1995ef9a
04 Sep, 2025 1 commit
- fix: always enable graceful shutdown as migration is not set in sglang (#2865) · eb1c9f24
  Hongkuan Zhou authored Sep 04, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  eb1c9f24