Commits · dcee4dbd17693b0db7918c92dcee9a5af9753f41 · OpenDAS / dynamo

10 Sep, 2025 11 commits

feat: support trtllm in sla-planner (#2980) · dcee4dbd

Hongkuan Zhou authored Sep 10, 2025


Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: ayushag <ayushag@nvidia.com>
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
Signed-off-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Signed-off-by: Harry Kim <harry_kim@live.com>
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Signed-off-by: GuanLuo <gluo@nvidia.com>
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: Graham King <grahamk@nvidia.com>
Signed-off-by: Anant Sharma <anants@nvidia.com>
Signed-off-by: Greg Clark <grclark@nvidia.com>
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
Co-authored-by: Dillon Cullinan <dcullinan92@gmail.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: julienmancuso <161955438+julienmancuso@users.noreply.github.com>
Co-authored-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Co-authored-by: Harry Kim <harry_kim@live.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Graham King <grahamk@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Greg Clark <grclark@nvidia.com>
Co-authored-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: nv-nmailhot <nmailhot@nvidia.com>

dcee4dbd

feat: adds kv indexer metrics (#2905) · 40000976
blarson-b10 authored Sep 10, 2025
```
Signed-off-by: Brian Larson <brian.larson@baseten.co>
```
40000976
docs: health check and structured logs (#2805) · 5d729c17
Neelay Shah authored Sep 10, 2025
```
Signed-off-by: nnshah1 <neelays@nvidia.com>
```
5d729c17
docs: Python runtime Request Cancellation examples (#2893) · de5ab2c4
Jacky authored Sep 10, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
de5ab2c4
feat: frontend, disconnect metrics (#1) (#2953) · e42746a1
Michael Feil authored Sep 10, 2025
```
Signed-off-by: michaelfeil <me@michaelfeil.eu>
```
e42746a1

feat: sglang multiple frontend slurm deployment scripts (#2623) · 4b3a2c1a

ishandhanani authored Sep 10, 2025


Signed-off-by: ishandhanani <ishandhanani@gmail.com>
Signed-off-by: Elnifio <elnifio0519@gmail.com>
Co-authored-by: Yunzhou Liu <46603306+Elnifio@users.noreply.github.com>

4b3a2c1a

feat: increase time of pvc access pod (#2991) · cfb7aed7
hhzhang16 authored Sep 10, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
cfb7aed7
docs: update feature matrix with local-dev + run.sh usage (#2977) · e176a29c
Keiven C authored Sep 10, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
e176a29c
fix: add retry for curl downloads (#2987) · 6a089b11
Anant Sharma authored Sep 10, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
6a089b11
fix: dyn namespace scoping for trtllm (#2970) · 905c920b
Biswa Panda authored Sep 09, 2025
```
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
```
905c920b
fix: devcontainer.json typo from b6b3a767 (#2976) · ae38bd43
Keiven C authored Sep 09, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
ae38bd43

09 Sep, 2025 19 commits
- feat: add init file to profiler folder (#2962) · eaa03383
  hhzhang16 authored Sep 09, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  eaa03383
- chore: Update trtllm version to 1.1.0rc3 (#2930) · e8cb972e
  Indrajit Bhosale authored Sep 09, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  e8cb972e
- docs: update how deploy util helper files are mentioned (#2957) · 241bd014
  hhzhang16 authored Sep 09, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  241bd014
- docs: Add AWS ECS deployment example for Dynamo vLLM (#2415) · 8c665c1b
  kYLe authored Sep 09, 2025
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Neal Vaidya <nealv@nvidia.com>
```
  8c665c1b
- fix: metrics test to match actual namespace sanitization behavior (#2868) · fed53137
  Keiven C authored Sep 09, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  fed53137
- feat: add a virtual connector for 3rd party deployments (#2913) · 8543d0d3
  Hongkuan Zhou authored Sep 09, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  8543d0d3
- docs: fix broken links (#2965) · 3ea3d59b
  nv-nmailhot authored Sep 09, 2025
  
  3ea3d59b
- fix: no reasoning parser by default (#2939) · 939ede86
  Neal Vaidya authored Sep 09, 2025
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
```
  939ede86
- fix: aggregate logprobs (#2928) · 8e4ae22b
  Greg Clark authored Sep 09, 2025
```
Signed-off-by: Greg Clark <grclark@nvidia.com>
```
  8e4ae22b
- ci: longer timeout, change model for l40 (#2951) · fae35432
  Alec authored Sep 09, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  fae35432
- ci: remove pre-merge ignore in github workflow (#2940) · 6104c93f
  Anant Sharma authored Sep 09, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  6104c93f
- test: remove nighlty marker in kvbm tests (#2958) · 4a27c02c
  Anant Sharma authored Sep 09, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  4a27c02c
- chore: added tool call schema validation in oai formatter (#2935) · c319aa2d
  Ayush Agarwal authored Sep 09, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  c319aa2d
- ci: Fix Dockerfile mount secrets (#2960) · be48b4cf
  Dillon Cullinan authored Sep 09, 2025
```
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
```
  be48b4cf
- feat: Add a checksum to ModelDeploymentCard fields (#2934) · 6f14e941
  Graham King authored Sep 09, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  6f14e941
- feat: update benchmarking and deploy utils (#2933) · 09c7b73c
  hhzhang16 authored Sep 08, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  09c7b73c
- ci: sglang functional tests (#2943) · 7dd872ae
  Alec authored Sep 08, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  7dd872ae
- fix: WAR DeepGemm JIT compilation errors (#2937) · 04e8a9c3
  GuanLuo authored Sep 08, 2025
```
Signed-off-by: GuanLuo <gluo@nvidia.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
```
  04e8a9c3
- feat: automatically setup and inject prometheus configuration (#2912) · 729b5fd5
  julienmancuso authored Sep 08, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  729b5fd5
08 Sep, 2025 10 commits
- refactor: standardize e2e tests across 3 frameworks (#2827) · 93208162
  Alec authored Sep 08, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  93208162
- build: OPS-597: restructure sglang to follow container strategy structure (#2803) · f0cea269
  Tushar Sharma authored Sep 08, 2025
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  f0cea269
- Update README.md (#2938) · 96064614
  Harry Kim authored Sep 08, 2025
```
Signed-off-by: Harry Kim <harry_kim@live.com>
```
  96064614
- chore: add preference logic for using tool-call and reasoning parsers for sglang (#2922) · 4a73b3c6
  Ayush Agarwal authored Sep 08, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  4a73b3c6
- chore: added utility to detect possible tool call start for a chunk (#2923) · b929e134
  Ayush Agarwal authored Sep 08, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  b929e134
- ci: Add concurrency check to auto cancel running actions. (#2438) · 5ea6b8d7
  Pavithra Vijayakrishnan authored Sep 08, 2025
```
Signed-off-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
```
  5ea6b8d7
- fix: fix typo in multinode example (#2931) · 6441ed36
  julienmancuso authored Sep 08, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  6441ed36
- fix: CI is broken with a deprecated dependency on pynvml (#2926) · fda1efe4
  Harrison Saturley-Hall authored Sep 08, 2025
```
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: alec-flowers <aflowers@nvidia.com>
```
  fda1efe4
- ci: OPS-724: Move to ARC runners (#2904) · 41dacce7
  Dillon Cullinan authored Sep 08, 2025
```
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
```
  41dacce7
- fix: fix hermes tool call config (#2915) · f93a7cad
  Ayush Agarwal authored Sep 08, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  f93a7cad