Commits · 435803ea16dbfd59244cd665368f1d01fc353622 · OpenDAS / dynamo

"docs/backends/vscode:/vscode.git/clone" did not exist on "75bf1e09930681c76586f281ccff6159a0e50449"

16 Sep, 2025 6 commits
- chore: add additional param support for multimodal models (#3042) · 435803ea
  ryan-lempka authored Sep 16, 2025
```
Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
```
  435803ea
- chore: moved asyncio import to top of the file for planner test (#3001) · fa6feee4
  Michael Shin authored Sep 16, 2025
```
Signed-off-by: Michael Shin <michaelshin@users.noreply.github.com>
```
  fa6feee4
- test: update planner docs with requirements that are needed; point users to... · 895fb216
  hhzhang16 authored Sep 16, 2025
```
test: update planner docs with requirements that are needed; point users to readme for installation (#3032)
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  895fb216
- fix: implement OpenAI-compliant usage stats for streaming responses (#3022) · aa80ac41
  Ryan Olson authored Sep 16, 2025
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  aa80ac41
- feat: add single-liner deployment and benchmarking recipe for llama3-70b models (#2792) · 23033136
  Biswa Panda authored Sep 16, 2025
```
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
```
  23033136
- chore: 400 Error Code for Bad Completion and ChatCompletion Request (#3038) · dcd331ab
  Ayush Agarwal authored Sep 15, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  dcd331ab
15 Sep, 2025 10 commits
- fix: Handle invalid JSON in config.json (#3043) · b1186aee
  Graham King authored Sep 15, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  b1186aee
- fix: disable natsBox by default (#3039) · 7af49a15
  Julien Mancuso authored Sep 15, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  7af49a15
- fix: dashboard fix (#3040) · d24b6bd7
  mohammedabdulwahhab authored Sep 15, 2025
```
Signed-off-by: furkhan324@berkeley.edu <furkhan324@berkeley.edu>
```
  d24b6bd7
- feat: decouple dynamo k8s setup from additional benchmarking requirements (#2973) · c82f477d
  hhzhang16 authored Sep 15, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  c82f477d
- feat: make DCO only required for external contributors (#3036) · b96a5a6f
  Harrison Saturley-Hall authored Sep 15, 2025
  
  b96a5a6f
- feat: use official Grove 0.1.0-alpha release (#3030) · c3820050
  Julien Mancuso authored Sep 15, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  c3820050
- feat: Tool calling support stream=True (#2932) · 2a61e29e
  Elyas Mehtabuddin authored Sep 15, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: ayushag <ayushag@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
```
  2a61e29e
- fix: early stop if CPU or disk space not set when using KVBM (#2997) · 55659eae
  Ziqi Fan authored Sep 15, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  55659eae
- docs: update env setup in planner tests (#3029) · eeb94dab
  Hongkuan Zhou authored Sep 15, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  eeb94dab
- fix: change KVBM Connector build_connector_meta due to vLLM ToT change (#2887) · bd835b03
  Ziqi Fan authored Sep 15, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  bd835b03
11 Sep, 2025 3 commits
- ci: fix completions race (#3010) · c8ecc402
  Alec authored Sep 11, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  c8ecc402
- ci: remove not slow filter (#2944) · 1b2826a9
  Alec authored Sep 10, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  1b2826a9
- fix: update regex for namespace query in Grafana dashboard (#3002) · 2eced093
  mohammedabdulwahhab authored Sep 10, 2025
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  2eced093
10 Sep, 2025 11 commits

feat: support trtllm in sla-planner (#2980) · dcee4dbd

Hongkuan Zhou authored Sep 10, 2025


Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: ayushag <ayushag@nvidia.com>
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
Signed-off-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Signed-off-by: Harry Kim <harry_kim@live.com>
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Signed-off-by: GuanLuo <gluo@nvidia.com>
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: Graham King <grahamk@nvidia.com>
Signed-off-by: Anant Sharma <anants@nvidia.com>
Signed-off-by: Greg Clark <grclark@nvidia.com>
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
Co-authored-by: Dillon Cullinan <dcullinan92@gmail.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: julienmancuso <161955438+julienmancuso@users.noreply.github.com>
Co-authored-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Co-authored-by: Harry Kim <harry_kim@live.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Graham King <grahamk@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Greg Clark <grclark@nvidia.com>
Co-authored-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: nv-nmailhot <nmailhot@nvidia.com>

dcee4dbd

feat: adds kv indexer metrics (#2905) · 40000976
blarson-b10 authored Sep 10, 2025
```
Signed-off-by: Brian Larson <brian.larson@baseten.co>
```
40000976
docs: health check and structured logs (#2805) · 5d729c17
Neelay Shah authored Sep 10, 2025
```
Signed-off-by: nnshah1 <neelays@nvidia.com>
```
5d729c17
docs: Python runtime Request Cancellation examples (#2893) · de5ab2c4
Jacky authored Sep 10, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
de5ab2c4
feat: frontend, disconnect metrics (#1) (#2953) · e42746a1
Michael Feil authored Sep 10, 2025
```
Signed-off-by: michaelfeil <me@michaelfeil.eu>
```
e42746a1

feat: sglang multiple frontend slurm deployment scripts (#2623) · 4b3a2c1a

ishandhanani authored Sep 10, 2025


Signed-off-by: ishandhanani <ishandhanani@gmail.com>
Signed-off-by: Elnifio <elnifio0519@gmail.com>
Co-authored-by: Yunzhou Liu <46603306+Elnifio@users.noreply.github.com>

4b3a2c1a

feat: increase time of pvc access pod (#2991) · cfb7aed7
hhzhang16 authored Sep 10, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
cfb7aed7
docs: update feature matrix with local-dev + run.sh usage (#2977) · e176a29c
Keiven C authored Sep 10, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
e176a29c
fix: add retry for curl downloads (#2987) · 6a089b11
Anant Sharma authored Sep 10, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
6a089b11
fix: dyn namespace scoping for trtllm (#2970) · 905c920b
Biswa Panda authored Sep 09, 2025
```
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
```
905c920b
fix: devcontainer.json typo from b6b3a767 (#2976) · ae38bd43
Keiven C authored Sep 09, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
ae38bd43

09 Sep, 2025 10 commits
- feat: add init file to profiler folder (#2962) · eaa03383
  hhzhang16 authored Sep 09, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  eaa03383
- chore: Update trtllm version to 1.1.0rc3 (#2930) · e8cb972e
  Indrajit Bhosale authored Sep 09, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  e8cb972e
- docs: update how deploy util helper files are mentioned (#2957) · 241bd014
  hhzhang16 authored Sep 09, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  241bd014
- docs: Add AWS ECS deployment example for Dynamo vLLM (#2415) · 8c665c1b
  kYLe authored Sep 09, 2025
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Neal Vaidya <nealv@nvidia.com>
```
  8c665c1b
- fix: metrics test to match actual namespace sanitization behavior (#2868) · fed53137
  Keiven C authored Sep 09, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  fed53137
- feat: add a virtual connector for 3rd party deployments (#2913) · 8543d0d3
  Hongkuan Zhou authored Sep 09, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  8543d0d3
- docs: fix broken links (#2965) · 3ea3d59b
  nv-nmailhot authored Sep 09, 2025
  
  3ea3d59b
- fix: no reasoning parser by default (#2939) · 939ede86
  Neal Vaidya authored Sep 09, 2025
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
```
  939ede86
- fix: aggregate logprobs (#2928) · 8e4ae22b
  Greg Clark authored Sep 09, 2025
```
Signed-off-by: Greg Clark <grclark@nvidia.com>
```
  8e4ae22b
- ci: longer timeout, change model for l40 (#2951) · fae35432
  Alec authored Sep 09, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  fae35432