Commits · f77511ff2cab4e3337b9d966a927ab1e13c637ab · OpenDAS / dynamo

16 Sep, 2025 15 commits
- chore: a few small benchmarking and profiling improvements (#3069) · f77511ff
  hhzhang16 authored Sep 16, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  f77511ff
- feat: update directory structure in script and simplify planner scaling test (#3049) · 65fa037d
  hhzhang16 authored Sep 16, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  65fa037d
- feat: add mooncake-style benchmarking for router (#3068) · 38300f22
  Yan Ru Pei authored Sep 16, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  38300f22
- chore(llm): Remove extra license headers (#3065) · bc0a7633
  Graham King authored Sep 16, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  bc0a7633
- chore: Remove more extended Apache headers (#3063) · 723f2da7
  Graham King authored Sep 16, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  723f2da7
- fix: Interactive inputs actually stops, does not ignore stop token (#3057) · 87e6e052
  Graham King authored Sep 16, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  87e6e052
- feat: add file permission checking to dynamo_check.py (#2899) · bc29b594
  Keiven C authored Sep 16, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  bc29b594
- feat: add HTTP queue metrics for NIM frontend request tracking (#2914) · 9fa5450c
  Keiven C authored Sep 16, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  9fa5450c
- chore(runtime): Shorten the license header (#3059) · 02a22cbc
  Graham King authored Sep 16, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  02a22cbc
- chore: add additional param support for multimodal models (#3042) · 435803ea
  ryan-lempka authored Sep 16, 2025
```
Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
```
  435803ea
- chore: moved asyncio import to top of the file for planner test (#3001) · fa6feee4
  Michael Shin authored Sep 16, 2025
```
Signed-off-by: Michael Shin <michaelshin@users.noreply.github.com>
```
  fa6feee4
- test: update planner docs with requirements that are needed; point users to... · 895fb216
  hhzhang16 authored Sep 16, 2025
```
test: update planner docs with requirements that are needed; point users to readme for installation (#3032)
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  895fb216
- fix: implement OpenAI-compliant usage stats for streaming responses (#3022) · aa80ac41
  Ryan Olson authored Sep 16, 2025
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  aa80ac41
- feat: add single-liner deployment and benchmarking recipe for llama3-70b models (#2792) · 23033136
  Biswa Panda authored Sep 16, 2025
```
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
```
  23033136
- chore: 400 Error Code for Bad Completion and ChatCompletion Request (#3038) · dcd331ab
  Ayush Agarwal authored Sep 15, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  dcd331ab
15 Sep, 2025 10 commits
- fix: Handle invalid JSON in config.json (#3043) · b1186aee
  Graham King authored Sep 15, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  b1186aee
- fix: disable natsBox by default (#3039) · 7af49a15
  Julien Mancuso authored Sep 15, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  7af49a15
- fix: dashboard fix (#3040) · d24b6bd7
  mohammedabdulwahhab authored Sep 15, 2025
```
Signed-off-by: furkhan324@berkeley.edu <furkhan324@berkeley.edu>
```
  d24b6bd7
- feat: decouple dynamo k8s setup from additional benchmarking requirements (#2973) · c82f477d
  hhzhang16 authored Sep 15, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  c82f477d
- feat: make DCO only required for external contributors (#3036) · b96a5a6f
  Harrison Saturley-Hall authored Sep 15, 2025
  
  b96a5a6f
- feat: use official Grove 0.1.0-alpha release (#3030) · c3820050
  Julien Mancuso authored Sep 15, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  c3820050
- feat: Tool calling support stream=True (#2932) · 2a61e29e
  Elyas Mehtabuddin authored Sep 15, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: ayushag <ayushag@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
```
  2a61e29e
- fix: early stop if CPU or disk space not set when using KVBM (#2997) · 55659eae
  Ziqi Fan authored Sep 15, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  55659eae
- docs: update env setup in planner tests (#3029) · eeb94dab
  Hongkuan Zhou authored Sep 15, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  eeb94dab
- fix: change KVBM Connector build_connector_meta due to vLLM ToT change (#2887) · bd835b03
  Ziqi Fan authored Sep 15, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  bd835b03
11 Sep, 2025 3 commits
- ci: fix completions race (#3010) · c8ecc402
  Alec authored Sep 11, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  c8ecc402
- ci: remove not slow filter (#2944) · 1b2826a9
  Alec authored Sep 10, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  1b2826a9
- fix: update regex for namespace query in Grafana dashboard (#3002) · 2eced093
  mohammedabdulwahhab authored Sep 10, 2025
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  2eced093
10 Sep, 2025 11 commits

feat: support trtllm in sla-planner (#2980) · dcee4dbd

Hongkuan Zhou authored Sep 10, 2025


Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: ayushag <ayushag@nvidia.com>
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
Signed-off-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Signed-off-by: Harry Kim <harry_kim@live.com>
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Signed-off-by: GuanLuo <gluo@nvidia.com>
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: Graham King <grahamk@nvidia.com>
Signed-off-by: Anant Sharma <anants@nvidia.com>
Signed-off-by: Greg Clark <grclark@nvidia.com>
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
Co-authored-by: Dillon Cullinan <dcullinan92@gmail.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: julienmancuso <161955438+julienmancuso@users.noreply.github.com>
Co-authored-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Co-authored-by: Harry Kim <harry_kim@live.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Graham King <grahamk@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Greg Clark <grclark@nvidia.com>
Co-authored-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: nv-nmailhot <nmailhot@nvidia.com>

dcee4dbd

feat: adds kv indexer metrics (#2905) · 40000976
blarson-b10 authored Sep 10, 2025
```
Signed-off-by: Brian Larson <brian.larson@baseten.co>
```
40000976
docs: health check and structured logs (#2805) · 5d729c17
Neelay Shah authored Sep 10, 2025
```
Signed-off-by: nnshah1 <neelays@nvidia.com>
```
5d729c17
docs: Python runtime Request Cancellation examples (#2893) · de5ab2c4
Jacky authored Sep 10, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
de5ab2c4
feat: frontend, disconnect metrics (#1) (#2953) · e42746a1
Michael Feil authored Sep 10, 2025
```
Signed-off-by: michaelfeil <me@michaelfeil.eu>
```
e42746a1

feat: sglang multiple frontend slurm deployment scripts (#2623) · 4b3a2c1a

ishandhanani authored Sep 10, 2025


Signed-off-by: ishandhanani <ishandhanani@gmail.com>
Signed-off-by: Elnifio <elnifio0519@gmail.com>
Co-authored-by: Yunzhou Liu <46603306+Elnifio@users.noreply.github.com>

4b3a2c1a

feat: increase time of pvc access pod (#2991) · cfb7aed7
hhzhang16 authored Sep 10, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
cfb7aed7
docs: update feature matrix with local-dev + run.sh usage (#2977) · e176a29c
Keiven C authored Sep 10, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
e176a29c
fix: add retry for curl downloads (#2987) · 6a089b11
Anant Sharma authored Sep 10, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
6a089b11
fix: dyn namespace scoping for trtllm (#2970) · 905c920b
Biswa Panda authored Sep 09, 2025
```
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
```
905c920b
fix: devcontainer.json typo from b6b3a767 (#2976) · ae38bd43
Keiven C authored Sep 09, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
ae38bd43

09 Sep, 2025 1 commit
- feat: add init file to profiler folder (#2962) · eaa03383
  hhzhang16 authored Sep 09, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  eaa03383