Commits · 2a61e29e27178f87e5e7ff42fa9f07ef1e5b00e1 · OpenDAS / dynamo

15 Sep, 2025 4 commits
- feat: Tool calling support stream=True (#2932) · 2a61e29e
  Elyas Mehtabuddin authored Sep 15, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: ayushag <ayushag@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
```
  2a61e29e
- fix: early stop if CPU or disk space not set when using KVBM (#2997) · 55659eae
  Ziqi Fan authored Sep 15, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  55659eae
- docs: update env setup in planner tests (#3029) · eeb94dab
  Hongkuan Zhou authored Sep 15, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  eeb94dab
- fix: change KVBM Connector build_connector_meta due to vLLM ToT change (#2887) · bd835b03
  Ziqi Fan authored Sep 15, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  bd835b03
11 Sep, 2025 3 commits
- ci: fix completions race (#3010) · c8ecc402
  Alec authored Sep 11, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  c8ecc402
- ci: remove not slow filter (#2944) · 1b2826a9
  Alec authored Sep 10, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  1b2826a9
- fix: update regex for namespace query in Grafana dashboard (#3002) · 2eced093
  mohammedabdulwahhab authored Sep 10, 2025
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  2eced093
10 Sep, 2025 11 commits

feat: support trtllm in sla-planner (#2980) · dcee4dbd

Hongkuan Zhou authored Sep 10, 2025


Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: ayushag <ayushag@nvidia.com>
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
Signed-off-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Signed-off-by: Harry Kim <harry_kim@live.com>
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Signed-off-by: GuanLuo <gluo@nvidia.com>
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: Graham King <grahamk@nvidia.com>
Signed-off-by: Anant Sharma <anants@nvidia.com>
Signed-off-by: Greg Clark <grclark@nvidia.com>
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
Co-authored-by: Dillon Cullinan <dcullinan92@gmail.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: julienmancuso <161955438+julienmancuso@users.noreply.github.com>
Co-authored-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Co-authored-by: Harry Kim <harry_kim@live.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Graham King <grahamk@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Greg Clark <grclark@nvidia.com>
Co-authored-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: nv-nmailhot <nmailhot@nvidia.com>

dcee4dbd

feat: adds kv indexer metrics (#2905) · 40000976
blarson-b10 authored Sep 10, 2025
```
Signed-off-by: Brian Larson <brian.larson@baseten.co>
```
40000976
docs: health check and structured logs (#2805) · 5d729c17
Neelay Shah authored Sep 10, 2025
```
Signed-off-by: nnshah1 <neelays@nvidia.com>
```
5d729c17
docs: Python runtime Request Cancellation examples (#2893) · de5ab2c4
Jacky authored Sep 10, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
de5ab2c4
feat: frontend, disconnect metrics (#1) (#2953) · e42746a1
Michael Feil authored Sep 10, 2025
```
Signed-off-by: michaelfeil <me@michaelfeil.eu>
```
e42746a1

feat: sglang multiple frontend slurm deployment scripts (#2623) · 4b3a2c1a

ishandhanani authored Sep 10, 2025


Signed-off-by: ishandhanani <ishandhanani@gmail.com>
Signed-off-by: Elnifio <elnifio0519@gmail.com>
Co-authored-by: Yunzhou Liu <46603306+Elnifio@users.noreply.github.com>

4b3a2c1a

feat: increase time of pvc access pod (#2991) · cfb7aed7
hhzhang16 authored Sep 10, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
cfb7aed7
docs: update feature matrix with local-dev + run.sh usage (#2977) · e176a29c
Keiven C authored Sep 10, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
e176a29c
fix: add retry for curl downloads (#2987) · 6a089b11
Anant Sharma authored Sep 10, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
6a089b11
fix: dyn namespace scoping for trtllm (#2970) · 905c920b
Biswa Panda authored Sep 09, 2025
```
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
```
905c920b
fix: devcontainer.json typo from b6b3a767 (#2976) · ae38bd43
Keiven C authored Sep 09, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
ae38bd43

09 Sep, 2025 19 commits
- feat: add init file to profiler folder (#2962) · eaa03383
  hhzhang16 authored Sep 09, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  eaa03383
- chore: Update trtllm version to 1.1.0rc3 (#2930) · e8cb972e
  Indrajit Bhosale authored Sep 09, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  e8cb972e
- docs: update how deploy util helper files are mentioned (#2957) · 241bd014
  hhzhang16 authored Sep 09, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  241bd014
- docs: Add AWS ECS deployment example for Dynamo vLLM (#2415) · 8c665c1b
  kYLe authored Sep 09, 2025
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Neal Vaidya <nealv@nvidia.com>
```
  8c665c1b
- fix: metrics test to match actual namespace sanitization behavior (#2868) · fed53137
  Keiven C authored Sep 09, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  fed53137
- feat: add a virtual connector for 3rd party deployments (#2913) · 8543d0d3
  Hongkuan Zhou authored Sep 09, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  8543d0d3
- docs: fix broken links (#2965) · 3ea3d59b
  nv-nmailhot authored Sep 09, 2025
  
  3ea3d59b
- fix: no reasoning parser by default (#2939) · 939ede86
  Neal Vaidya authored Sep 09, 2025
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
```
  939ede86
- fix: aggregate logprobs (#2928) · 8e4ae22b
  Greg Clark authored Sep 09, 2025
```
Signed-off-by: Greg Clark <grclark@nvidia.com>
```
  8e4ae22b
- ci: longer timeout, change model for l40 (#2951) · fae35432
  Alec authored Sep 09, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  fae35432
- ci: remove pre-merge ignore in github workflow (#2940) · 6104c93f
  Anant Sharma authored Sep 09, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  6104c93f
- test: remove nighlty marker in kvbm tests (#2958) · 4a27c02c
  Anant Sharma authored Sep 09, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  4a27c02c
- chore: added tool call schema validation in oai formatter (#2935) · c319aa2d
  Ayush Agarwal authored Sep 09, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  c319aa2d
- ci: Fix Dockerfile mount secrets (#2960) · be48b4cf
  Dillon Cullinan authored Sep 09, 2025
```
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
```
  be48b4cf
- feat: Add a checksum to ModelDeploymentCard fields (#2934) · 6f14e941
  Graham King authored Sep 09, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  6f14e941
- feat: update benchmarking and deploy utils (#2933) · 09c7b73c
  hhzhang16 authored Sep 08, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  09c7b73c
- ci: sglang functional tests (#2943) · 7dd872ae
  Alec authored Sep 08, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  7dd872ae
- fix: WAR DeepGemm JIT compilation errors (#2937) · 04e8a9c3
  GuanLuo authored Sep 08, 2025
```
Signed-off-by: GuanLuo <gluo@nvidia.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
```
  04e8a9c3
- feat: automatically setup and inject prometheus configuration (#2912) · 729b5fd5
  julienmancuso authored Sep 08, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  729b5fd5
08 Sep, 2025 3 commits
- refactor: standardize e2e tests across 3 frameworks (#2827) · 93208162
  Alec authored Sep 08, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  93208162
- build: OPS-597: restructure sglang to follow container strategy structure (#2803) · f0cea269
  Tushar Sharma authored Sep 08, 2025
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  f0cea269
- Update README.md (#2938) · 96064614
  Harry Kim authored Sep 08, 2025
```
Signed-off-by: Harry Kim <harry_kim@live.com>
```
  96064614