Commits · f88d7dc74bd73823101059136efbc4aa453e5f54 · OpenDAS / dynamo

"lib/bindings/python/examples/cli/trtllm_inc.py" did not exist on "429698002fe12962be0b3b59f90a725a69018667"

17 Sep, 2025 10 commits
- chore(bindings): Remove NatsQueue (#3086) · f88d7dc7
  Graham King authored Sep 17, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  f88d7dc7
- chore: fillout sampling params (seed, n, best_of, min_p) (#3055) · 3de04dd9
  Greg Clark authored Sep 17, 2025
```
Signed-off-by: Greg Clark <grclark@nvidia.com>
```
  3de04dd9
- fix: update golang container to remove CVE (#3088) · e2c0e8d1
  Harrison Saturley-Hall authored Sep 17, 2025
```
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
```
  e2c0e8d1
- fix: fix some trtllm tests (#3084) · 002617a9
  Richard Huo authored Sep 17, 2025
  
  002617a9
- feat: add chat_template_kwargs param to v1/chat/completion (#3016) · eb6722e3
  Chi McIsaac authored Sep 17, 2025
```
Signed-off-by: Chi McIsaac <chixie.mcisaac@gmail.com>
```
  eb6722e3
- feat: Make part of discovery re-usable (#3073) · 9060ce12
  Graham King authored Sep 17, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  9060ce12
- fix: resolve token loss bug in final packet (#2985) · 045b61dd
  Xuwei authored Sep 17, 2025
```
Signed-off-by: Xuwei Li <lixuwei.xy@gmail.com>
```
  045b61dd
- feat: Canary Health Check. (#2903) · 08cb08c1
  Tzu-Ling Kan authored Sep 16, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  08cb08c1
- feat: make connect_with_reset jetstream configurable (#3078) · 7ce8d0ef
  Michael Feil authored Sep 16, 2025
```
Signed-off-by: michaelfeil <me@michaelfeil.eu>
```
  7ce8d0ef
- fix: purge before snapshotting (#3077) · d49fc3eb
  Yan Ru Pei authored Sep 16, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d49fc3eb
16 Sep, 2025 19 commits
- feat: kv commit router (#3024) · 0373b897
  Michael Feil authored Sep 16, 2025
```
Signed-off-by: michaelfeil <me@michaelfeil.eu>
```
  0373b897
- fix: move deep_update function to trtllm folder (#3070) · 2bb1b268
  Hongkuan Zhou authored Sep 16, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  2bb1b268
- docs: add benchmark section to KVBM vLLM runbook (#3066) · 1ba53f2c
  Ziqi Fan authored Sep 16, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  1ba53f2c
- fix: replace hard coded dynamo namespace with env var (#3048) · 960dc896
  Biswa Panda authored Sep 16, 2025
```
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
```
  960dc896
- chore: a few small benchmarking and profiling improvements (#3069) · f77511ff
  hhzhang16 authored Sep 16, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  f77511ff
- feat: update directory structure in script and simplify planner scaling test (#3049) · 65fa037d
  hhzhang16 authored Sep 16, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  65fa037d
- feat: add mooncake-style benchmarking for router (#3068) · 38300f22
  Yan Ru Pei authored Sep 16, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  38300f22
- chore(llm): Remove extra license headers (#3065) · bc0a7633
  Graham King authored Sep 16, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  bc0a7633
- chore: Remove more extended Apache headers (#3063) · 723f2da7
  Graham King authored Sep 16, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  723f2da7
- fix: Interactive inputs actually stops, does not ignore stop token (#3057) · 87e6e052
  Graham King authored Sep 16, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  87e6e052
- feat: add file permission checking to dynamo_check.py (#2899) · bc29b594
  Keiven C authored Sep 16, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  bc29b594
- feat: add HTTP queue metrics for NIM frontend request tracking (#2914) · 9fa5450c
  Keiven C authored Sep 16, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  9fa5450c
- chore(runtime): Shorten the license header (#3059) · 02a22cbc
  Graham King authored Sep 16, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  02a22cbc
- chore: add additional param support for multimodal models (#3042) · 435803ea
  ryan-lempka authored Sep 16, 2025
```
Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
```
  435803ea
- chore: moved asyncio import to top of the file for planner test (#3001) · fa6feee4
  Michael Shin authored Sep 16, 2025
```
Signed-off-by: Michael Shin <michaelshin@users.noreply.github.com>
```
  fa6feee4
- test: update planner docs with requirements that are needed; point users to... · 895fb216
  hhzhang16 authored Sep 16, 2025
```
test: update planner docs with requirements that are needed; point users to readme for installation (#3032)
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  895fb216
- fix: implement OpenAI-compliant usage stats for streaming responses (#3022) · aa80ac41
  Ryan Olson authored Sep 16, 2025
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  aa80ac41
- feat: add single-liner deployment and benchmarking recipe for llama3-70b models (#2792) · 23033136
  Biswa Panda authored Sep 16, 2025
```
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
```
  23033136
- chore: 400 Error Code for Bad Completion and ChatCompletion Request (#3038) · dcd331ab
  Ayush Agarwal authored Sep 15, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  dcd331ab
15 Sep, 2025 10 commits
- fix: Handle invalid JSON in config.json (#3043) · b1186aee
  Graham King authored Sep 15, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  b1186aee
- fix: disable natsBox by default (#3039) · 7af49a15
  Julien Mancuso authored Sep 15, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  7af49a15
- fix: dashboard fix (#3040) · d24b6bd7
  mohammedabdulwahhab authored Sep 15, 2025
```
Signed-off-by: furkhan324@berkeley.edu <furkhan324@berkeley.edu>
```
  d24b6bd7
- feat: decouple dynamo k8s setup from additional benchmarking requirements (#2973) · c82f477d
  hhzhang16 authored Sep 15, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  c82f477d
- feat: make DCO only required for external contributors (#3036) · b96a5a6f
  Harrison Saturley-Hall authored Sep 15, 2025
  
  b96a5a6f
- feat: use official Grove 0.1.0-alpha release (#3030) · c3820050
  Julien Mancuso authored Sep 15, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  c3820050
- feat: Tool calling support stream=True (#2932) · 2a61e29e
  Elyas Mehtabuddin authored Sep 15, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: ayushag <ayushag@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
```
  2a61e29e
- fix: early stop if CPU or disk space not set when using KVBM (#2997) · 55659eae
  Ziqi Fan authored Sep 15, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  55659eae
- docs: update env setup in planner tests (#3029) · eeb94dab
  Hongkuan Zhou authored Sep 15, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  eeb94dab
- fix: change KVBM Connector build_connector_meta due to vLLM ToT change (#2887) · bd835b03
  Ziqi Fan authored Sep 15, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  bd835b03
11 Sep, 2025 1 commit
- ci: fix completions race (#3010) · c8ecc402
  Alec authored Sep 11, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  c8ecc402