Commits · 97fee50266fd537f215d998019c0168a85e8cb45 · OpenDAS / dynamo · GitLab

30 Sep, 2025 9 commits
- fix: fail fast custom template not found & more verbose vllm engine error (#3278) · 97fee502
  Chia-Wei authored Sep 30, 2025
```
Signed-off-by: Chia-Wei Chen <cchen562@wisc.edu>
```
  97fee502
- feat: add Python const for Prometheus metric names (#3244) · cacac9b9
  Keiven C authored Sep 30, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  cacac9b9
- refactor: standardize HF_CACHE to HF_HOME across codebase (use Hugging Face convention) (#3310) · 481bf395
  Keiven C authored Sep 30, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  481bf395
- chore: Move model_input, model_type from ModelEntry to ModelDeploymentCard (#3292) · 6ffd20a8
  Graham King authored Sep 30, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  6ffd20a8
- fix: fix backend in trtllm multinode example (#3311) · 50dfd3af
  Julien Mancuso authored Sep 30, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  50dfd3af
- fix: make HF cache mount point dynamic based on target (#3270) · 8c884345
  Keiven C authored Sep 30, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  8c884345
- test: create a helper function to send request directly to mocker instances (#3269) · 74a56676
  Paul Li authored Sep 29, 2025
```
Signed-off-by: Paul Li <zhixiong2008@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  74a56676
- fix: operator planner metric port injection (#3294) · 16409eef
  Thomas Montfort authored Sep 29, 2025
  
  16409eef
- test: Allow prefill cancellation tests to fail (#3300) · 44a40a0b
  Jacky authored Sep 29, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  44a40a0b
29 Sep, 2025 12 commits
- fix: more fixes for stable router benchmarking (#3264) · 3aa30778
  Yan Ru Pei authored Sep 29, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  3aa30778
- chore: Remove revision from ModelDeploymentCard (#3293) · 97a98546
  Graham King authored Sep 29, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  97a98546
- docs: remove hardcoded version in quick start (#3290) · e3df305b
  Anant Sharma authored Sep 29, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  e3df305b
- feat: use python3 in all examples (#3259) · a01b7992
  Julien Mancuso authored Sep 29, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  a01b7992
- ci: Limit cpus in docker processes (#3251) · 02209bbb
  Dillon Cullinan authored Sep 29, 2025
```
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
```
  02209bbb
- chore: add loopback as default address for network (#3250) · 1208f017
  akshaver authored Sep 29, 2025
  
  1208f017
- chore(build): Speedup rust github action job times and default cargo build time (#3220) · 65071f21
  Ryan McCormick authored Sep 29, 2025
```
Signed-off-by: Ryan McCormick <rmccormick@nvidia.com>
```
  65071f21
- fix: copy wheel from trtllm wheel stage (#3256) · f0709194
  Tushar Sharma authored Sep 29, 2025
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  f0709194
- feat: add subComponentType in DGD API and uptake in planner (#3200) · 1a5016b0
  Thomas Montfort authored Sep 29, 2025
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
```
  1a5016b0
- chore: relaxing constraints on metadata field, adding metadata field to completions API (#3240) · 13156361
  nv-nedelman-1 authored Sep 29, 2025
```
Signed-off-by: Nicholas Edelman <nedelman@nvidia.com>
```
  13156361
- feat: enable KVBM emit metrics in Dynamo TRTLLM (#3254) · e21dcf6c
  Ziqi Fan authored Sep 29, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  e21dcf6c
- feat: enable parallel tool calling and add testing (#3188) · 67e1f6ee
  Elyas Mehtabuddin authored Sep 29, 2025
```
Signed-off-by: Elyas Mehtabuddin <emehtabuddin@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  67e1f6ee
26 Sep, 2025 15 commits
- docs: Fix profile_sla command in docs (#3258) · 9d73be12
  Ilya Sherstyuk authored Sep 26, 2025
```
Signed-off-by: Ilya Sherstyuk <isherstyuk@nvidia.com>
```
  9d73be12
- feat: Add sglang k8 FT tests (#3227) · ec50db06
  Tzu-Ling Kan authored Sep 26, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  ec50db06
- chore: added more api error code validations (#3231) · d4f0d2bc
  Ayush Agarwal authored Sep 26, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  d4f0d2bc
- ci: use large runners for pre merge rust (#3236) · 19f48dba
  Anant Sharma authored Sep 26, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  19f48dba
- chore: Switch lto to from "fat"/true to "thin" (#3252) · c87d89ac
  Graham King authored Sep 26, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  c87d89ac
- docs: Add gpt-oss guide with reasoning / tool calling for vLLM and SGLang (#3219) · e2444577
  GuanLuo authored Sep 26, 2025
```
Signed-off-by: Guan Luo <gluo@nvidia.com>
```
  e2444577
- feat: Request Cancellation TRT-LLM (#3193) · 77e66ae5
  Jacky authored Sep 26, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  77e66ae5
- feat: add Rayon compute pool for CPU-intensive operations (#2969) · a13c4cb6
  Ryan Olson authored Sep 26, 2025
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  a13c4cb6
- chore: Remove etcd from python bindings (#3238) · 7ebbd001
  Graham King authored Sep 26, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  7ebbd001
- feat: replace polling with event-driven metrics updates (#3207) · 53f3d2af
  Keiven C authored Sep 26, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  53f3d2af
- docs: remove prebuilt TRT-LLM requirement in gpt-oss guide (#3234) · da7d1a33
  GuanLuo authored Sep 26, 2025
```
Signed-off-by: Guan Luo <gluo@nvidia.com>
```
  da7d1a33
- docs: mention need for H100 for gpt-oss-120b in router benchmarking docs (#3242) · 45a4b7cf
  Yan Ru Pei authored Sep 26, 2025
```
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
```
  45a4b7cf
- feat: add network isolation modes to container/run.sh script (#3237) · a0f845e3
  Keiven C authored Sep 25, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  a0f845e3
- chore: bump vllm version to 0.10.2 (#3180) · 5bb74904
  Alec authored Sep 26, 2025
```
Signed-off-by: Alec <aflowers@nvidia.com>
Signed-off-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Signed-off-by: krishung5 <krish@nvidia.com>
Co-authored-by: Kris Hung <krish@nvidia.com>
```
  5bb74904
- feat: Add distributed tracing context support to Python bindings (#3160) · f2e2e935
  Neelay Shah authored Sep 25, 2025
```
Signed-off-by: nnshah1 <neelays@nvidia.com>
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
Co-authored-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  f2e2e935
25 Sep, 2025 4 commits
- chore: Migrate planner virtual_connector internals into bindings (#3205) · c03e2f6b
  Graham King authored Sep 25, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  c03e2f6b
- feat: update how we wait for model before model is ready (#3050) · e1c7a4a4
  Yunzhou Liu authored Sep 25, 2025
```
Signed-off-by: Elnifio <elnifio0519@gmail.com>
```
  e1c7a4a4
- ci: conditional backend github workflow (#3141) · 65a1e1b4
  Anant Sharma authored Sep 25, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  65a1e1b4
- docs: some router-related doc fixes for 0.5.1 release (#3232) · a69efbd1
  Yan Ru Pei authored Sep 25, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  a69efbd1