Commits · d05795f2bf7a9da425926572c2a6be14838a46f0 · OpenDAS / dynamo · GitLab

17 Sep, 2025 16 commits
- chore: reorder dynamo_check.py output (very minor) (#3081) · d05795f2
  Keiven C authored Sep 17, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  d05795f2
- fix: Update the KVBM <> TRT-LLM integration interface to match the latest... · 86ce03f4
  Richard Huo authored Sep 17, 2025
```
fix: Update the KVBM <> TRT-LLM integration interface to match the latest TRT-LLM connector API (#2979)
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  86ce03f4
- fix: harmony parser streaming fix (#3074) · cd814377
  Ayush Agarwal authored Sep 17, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
Signed-off-by: Graham King <grahamk@nvidia.com>
Co-authored-by: Graham King <grahamk@nvidia.com>
```
  cd814377
- fix: hook up worker removals for indexer (#3095) · 78a3feda
  Yan Ru Pei authored Sep 17, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  78a3feda
- feat: decouple existing benchmarking within docs (#3072) · 26889b09
  hhzhang16 authored Sep 17, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  26889b09
- feat: Trtllm canary health check (#3082) · 67ff181d
  Tzu-Ling Kan authored Sep 17, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
Signed-off-by: Tzu-Ling Kan <tzulingk@nvidia.com>
```
  67ff181d
- chore(bindings): Remove NatsQueue (#3086) · f88d7dc7
  Graham King authored Sep 17, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  f88d7dc7
- chore: fillout sampling params (seed, n, best_of, min_p) (#3055) · 3de04dd9
  Greg Clark authored Sep 17, 2025
```
Signed-off-by: Greg Clark <grclark@nvidia.com>
```
  3de04dd9
- fix: update golang container to remove CVE (#3088) · e2c0e8d1
  Harrison Saturley-Hall authored Sep 17, 2025
```
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
```
  e2c0e8d1
- fix: fix some trtllm tests (#3084) · 002617a9
  Richard Huo authored Sep 17, 2025
  
  002617a9
- feat: add chat_template_kwargs param to v1/chat/completion (#3016) · eb6722e3
  Chi McIsaac authored Sep 17, 2025
```
Signed-off-by: Chi McIsaac <chixie.mcisaac@gmail.com>
```
  eb6722e3
- feat: Make part of discovery re-usable (#3073) · 9060ce12
  Graham King authored Sep 17, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  9060ce12
- fix: resolve token loss bug in final packet (#2985) · 045b61dd
  Xuwei authored Sep 17, 2025
```
Signed-off-by: Xuwei Li <lixuwei.xy@gmail.com>
```
  045b61dd
- feat: Canary Health Check. (#2903) · 08cb08c1
  Tzu-Ling Kan authored Sep 16, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  08cb08c1
- feat: make connect_with_reset jetstream configurable (#3078) · 7ce8d0ef
  Michael Feil authored Sep 16, 2025
```
Signed-off-by: michaelfeil <me@michaelfeil.eu>
```
  7ce8d0ef
- fix: purge before snapshotting (#3077) · d49fc3eb
  Yan Ru Pei authored Sep 16, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d49fc3eb
16 Sep, 2025 19 commits
- feat: kv commit router (#3024) · 0373b897
  Michael Feil authored Sep 16, 2025
```
Signed-off-by: michaelfeil <me@michaelfeil.eu>
```
  0373b897
- fix: move deep_update function to trtllm folder (#3070) · 2bb1b268
  Hongkuan Zhou authored Sep 16, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  2bb1b268
- docs: add benchmark section to KVBM vLLM runbook (#3066) · 1ba53f2c
  Ziqi Fan authored Sep 16, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  1ba53f2c
- fix: replace hard coded dynamo namespace with env var (#3048) · 960dc896
  Biswa Panda authored Sep 16, 2025
```
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
```
  960dc896
- chore: a few small benchmarking and profiling improvements (#3069) · f77511ff
  hhzhang16 authored Sep 16, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  f77511ff
- feat: update directory structure in script and simplify planner scaling test (#3049) · 65fa037d
  hhzhang16 authored Sep 16, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  65fa037d
- feat: add mooncake-style benchmarking for router (#3068) · 38300f22
  Yan Ru Pei authored Sep 16, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  38300f22
- chore(llm): Remove extra license headers (#3065) · bc0a7633
  Graham King authored Sep 16, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  bc0a7633
- chore: Remove more extended Apache headers (#3063) · 723f2da7
  Graham King authored Sep 16, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  723f2da7
- fix: Interactive inputs actually stops, does not ignore stop token (#3057) · 87e6e052
  Graham King authored Sep 16, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  87e6e052
- feat: add file permission checking to dynamo_check.py (#2899) · bc29b594
  Keiven C authored Sep 16, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  bc29b594
- feat: add HTTP queue metrics for NIM frontend request tracking (#2914) · 9fa5450c
  Keiven C authored Sep 16, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  9fa5450c
- chore(runtime): Shorten the license header (#3059) · 02a22cbc
  Graham King authored Sep 16, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  02a22cbc
- chore: add additional param support for multimodal models (#3042) · 435803ea
  ryan-lempka authored Sep 16, 2025
```
Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
```
  435803ea
- chore: moved asyncio import to top of the file for planner test (#3001) · fa6feee4
  Michael Shin authored Sep 16, 2025
```
Signed-off-by: Michael Shin <michaelshin@users.noreply.github.com>
```
  fa6feee4
- test: update planner docs with requirements that are needed; point users to... · 895fb216
  hhzhang16 authored Sep 16, 2025
```
test: update planner docs with requirements that are needed; point users to readme for installation (#3032)
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  895fb216
- fix: implement OpenAI-compliant usage stats for streaming responses (#3022) · aa80ac41
  Ryan Olson authored Sep 16, 2025
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  aa80ac41
- feat: add single-liner deployment and benchmarking recipe for llama3-70b models (#2792) · 23033136
  Biswa Panda authored Sep 16, 2025
```
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
```
  23033136
- chore: 400 Error Code for Bad Completion and ChatCompletion Request (#3038) · dcd331ab
  Ayush Agarwal authored Sep 15, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  dcd331ab
15 Sep, 2025 5 commits
- fix: Handle invalid JSON in config.json (#3043) · b1186aee
  Graham King authored Sep 15, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  b1186aee
- fix: disable natsBox by default (#3039) · 7af49a15
  Julien Mancuso authored Sep 15, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  7af49a15
- fix: dashboard fix (#3040) · d24b6bd7
  mohammedabdulwahhab authored Sep 15, 2025
```
Signed-off-by: furkhan324@berkeley.edu <furkhan324@berkeley.edu>
```
  d24b6bd7
- feat: decouple dynamo k8s setup from additional benchmarking requirements (#2973) · c82f477d
  hhzhang16 authored Sep 15, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  c82f477d
- feat: make DCO only required for external contributors (#3036) · b96a5a6f
  Harrison Saturley-Hall authored Sep 15, 2025
  
  b96a5a6f