Commits · 5744548bdfd7ffe4ec3de15b3fc3b04b038ffda3 · OpenDAS / dynamo · GitLab

14 Oct, 2025 3 commits
- fix: Add support for single element arrays for chat and completions prompts (#3482) · 3dc25129
  zhongdaor-nv authored Oct 14, 2025
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
```
  3dc25129
- feat: catch Trtllm engine exceptions (#3544) · 1ad2a3b8
  Tzu-Ling Kan authored Oct 14, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  1ad2a3b8
- fix: only log config on `debug` log level, fix trtllm warnings (#3590) · 7b0fad3f
  William Arnold authored Oct 14, 2025
```
Signed-off-by: William Arnold <7565007+Aphoh@users.noreply.github.com>
```
  7b0fad3f
11 Oct, 2025 2 commits
- feat: implement custom backend metrics for NIM (#3266) · 65cc5337
  Keiven C authored Oct 10, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  65cc5337
- feat: add SGLang and vLLM passthrough metrics on Dynamo backend worker (#3539) · 55e458d8
  Keiven C authored Oct 10, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  55e458d8
10 Oct, 2025 5 commits
- feat: Sglang Request cancellation (#3465) · 2d0dab74
  Indrajit Bhosale authored Oct 10, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  2d0dab74
- ci: TRTLLM & SGLang Unit Tests (for --custom-jinja-template) (#3472) · a3d46840
  KrishnanPrash authored Oct 10, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  a3d46840
- feat: add Rust-to-Python const code generator for prometheus_names.py (#3425) · f2ba58e5
  Keiven C authored Oct 10, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f2ba58e5
- docs: move all md files from components to docs (#3440) · 0a2a820b
  Anant Sharma authored Oct 09, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Anish <80174047+athreesh@users.noreply.github.com>
```
  0a2a820b
- fix: Send last token batch when finish_reason is set (#3531) · 111c6814
  Ryan McCormick authored Oct 09, 2025
  
  111c6814
09 Oct, 2025 8 commits
- refactor: remove sglang config and util files from components (#3467) · 03bdced9
  Anant Sharma authored Oct 09, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  03bdced9
- feat: sglang prefill router + bump to `0.5.3` (#3498) · 51f65757
  ishandhanani authored Oct 09, 2025
  
  51f65757
- refactor: remove vllm prefill worker background loop check (#3529) · 07a64744
  Yan Ru Pei authored Oct 09, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  07a64744
- docs: add vLLM KVBM 2P2D example due to a special ENV VAR to note (#3526) · 44012a24
  Ziqi Fan authored Oct 09, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  44012a24
- chore: add sample KVBM related k8s deployment manifests (#3523) · 5f7c1f7e
  Ziqi Fan authored Oct 09, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  5f7c1f7e
- chore: Remove clear_namespace script (#3519) · e9a71009
  Graham King authored Oct 09, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  e9a71009
- chore: Remove deprecated components/metrics and references (#3475) · be001a58
  Keiven C authored Oct 09, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  be001a58
- fix: fix config updates on deep copy not propagating back (#3512) · bd28e442
  Hongkuan Zhou authored Oct 08, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  bd28e442
08 Oct, 2025 8 commits
- fix: remove _version import in config_dump (#3502) · 9b5bab72
  William Arnold authored Oct 08, 2025
```
Signed-off-by: William Arnold <7565007+Aphoh@users.noreply.github.com>
```
  9b5bab72
- feat: enable KVBM to support PD disagg in Dynamo vLLM (#3352) · 9975cb9f
  Ziqi Fan authored Oct 08, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  9975cb9f
- chore: Remove llama.cpp engine (#3499) · 0aa0768f
  Graham King authored Oct 08, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  0aa0768f
- fix: update dynamo namespace env var usage (#3477) · 552146f2
  Biswa Panda authored Oct 08, 2025
  
  552146f2
- feat: prefill routing for trtllm (#3471) · f3987f6c
  Yan Ru Pei authored Oct 08, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f3987f6c
- fix: frontend component handles graceful shutdown (#3481) · 2d59861e
  Thomas Montfort authored Oct 08, 2025
  
  2d59861e
- chore: Remove GGUF support (#3488) · 1b1265e6
  Graham King authored Oct 08, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  1b1265e6
- fix: dynamo.common import failing on non-editable installs (#3478) · 8c9f3616
  William Arnold authored Oct 07, 2025
```
Signed-off-by: William Arnold <7565007+Aphoh@users.noreply.github.com>
```
  8c9f3616
07 Oct, 2025 7 commits
- feat: pre-deployment profiling automatically generates and deploys optimized... · 83e259a7
  Hongkuan Zhou authored Oct 07, 2025
```
feat: pre-deployment profiling automatically generates and deploys optimized DGD with planner (#3441)
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  83e259a7
- chore: update guide for reasoning & tool calling parser with gpt-oss on trtllm (#3262) · 55f7e637
  zhongdaor-nv authored Oct 07, 2025
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
```
  55f7e637
- feat: Connect DYN_LOG level to TLLM_LOG_LEVEL (#3451) · 68bbe8a9
  Tanmay Verma authored Oct 07, 2025
```
Signed-off-by: Tanmay Verma <tanmay2592@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  68bbe8a9
- feat: add flag for dumping dynamo engine config and environment (#3286) · 2e1f5076
  William Arnold authored Oct 07, 2025
```
Signed-off-by: William Arnold <7565007+Aphoh@users.noreply.github.com>
```
  2e1f5076
- docs: Update trtllm multinode multimodal docs (#3369) · 04aafa9a
  Indrajit Bhosale authored Oct 07, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  04aafa9a
- chore: Clean up for sglang multimodal example (#3420) · ddbb4f50
  Kris Hung authored Oct 06, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  ddbb4f50
- feat: Add embedding support to sgl backend (#3427) · d809906e
  Kris Hung authored Oct 06, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  d809906e
06 Oct, 2025 2 commits
- refactor: clean up sglang apis [1/n] (#3432) · de5c39df
  ishandhanani authored Oct 06, 2025
  
  de5c39df
- fix: vLLM engine graceful shutdown to prevent VRAM leaks on crash (#2898) · 162065fe
  Waël Boukhobza authored Oct 06, 2025
```
Signed-off-by: Wael Boukhobza <wawa_wael@live.fr>
```
  162065fe
04 Oct, 2025 1 commit
- feat: use KvPushRouter for prefill router (#3401) · 30610e73
  Yan Ru Pei authored Oct 03, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  30610e73
03 Oct, 2025 3 commits
- fix: remove VSWA user prompts, since we need a lot more updates to get it working (#3404) · c48f49a4
  Richard Huo authored Oct 03, 2025
```
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  c48f49a4
- docs: add Planner Quickstart doc (#3358) · 89cf9107
  hhzhang16 authored Oct 03, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
```
  89cf9107
- fix: Fix sglang imports for v0.5.3rc0 and update Dockerfile.sglang version to match (#3405) · 1927cb87
  Ryan McCormick authored Oct 03, 2025
```
Signed-off-by: Ryan McCormick <rmccormick@nvidia.com>
```
  1927cb87
02 Oct, 2025 1 commit
- fix: correctly parse subcomponent in sla-planner + deploy/doc update (#3363) · cfe74445
  Hongkuan Zhou authored Oct 02, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  cfe74445