Commits · 7702f49fdec164edd0a6ca5b177fbdc806d11980 · OpenDAS / dynamo

"vllm/vscode:/vscode.git/clone" did not exist on "672023877bfd17a8720ae05ed198456d9b454363"

14 Nov, 2025 16 commits
- fix: fix permission issues with volume mounts and trtllm multinode (#4341) · 7702f49f
  Julien Mancuso authored Nov 14, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  7702f49f
- fix: use release build for ucx (#4345) · 2405bac7
  Anant Sharma authored Nov 14, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  2405bac7
- fix: misnamed tensorrtllm-runtime image and incorrect tag (#4289) · a4eb4e8a
  Harrison Saturley-Hall authored Nov 14, 2025
```
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <harrison.saturley.hall@gmail.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
```
  a4eb4e8a
- fix: revert space making DGD invalid (#4349) · dce20d06
  Alec authored Nov 14, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  dce20d06
- refactor: migrate kvbm python bindings to the python directory (#4318) · 5a5bc51e
  Ryan Olson authored Nov 14, 2025
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  5a5bc51e
- fix: k8s native discovery (#4305) · 334ce551
  Thomas Montfort authored Nov 14, 2025
  
  334ce551
- feat: Use try-catch block for import to avoid error (#4339) · 9a765d6d
  Tzu-Ling Kan authored Nov 14, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  9a765d6d
- chore: use hyphens for Router-related keys (#4325) · 065296c3
  Yan Ru Pei authored Nov 14, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  065296c3
- docs: add instructions in planner tests to remove volumes/volumeMounts (#4335) · 9f0a3155
  hhzhang16 authored Nov 14, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  9f0a3155
- fix(sglang): enable metrics on multi-node setups (#4238) · 34dd7ee7
  ishandhanani authored Nov 14, 2025
  
  34dd7ee7
- docs: update readme for non root user (#4300) · 5d1ff687
  Anant Sharma authored Nov 14, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  5d1ff687
- fix: Make lmcache dependency optional for PdConnector (#4319) · b2370a97
  Olga Andreeva authored Nov 14, 2025
```
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
Signed-off-by: Olga Andreeva <124622579+oandreeva-nv@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
```
  b2370a97
- fix: add kvbm arg in trtllm runtime image build (#4337) · d6cda975
  Anant Sharma authored Nov 14, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  d6cda975
- feat: add fsgroup to ProfilingJob (#4298) · 436f08df
  hhzhang16 authored Nov 14, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  436f08df
- fix: fix namespace (#4324) · 4891e161
  atchernych authored Nov 13, 2025
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  4891e161
- fix(vllm): port allocation bugs leading to zmq error (#4321) · ecf6d48c
  Alec authored Nov 13, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  ecf6d48c
13 Nov, 2025 24 commits
- test(key_value_store): Assert entries() works correctly (#4312) · 58da7cfe
  Graham King authored Nov 13, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  58da7cfe
- fix(docs): metrics documentation that were missing 2 metrics (#4309) · 3cf67ee0
  Keiven C authored Nov 13, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  3cf67ee0
- docs: update vllm mermaid diagram (#4320) · 2fc57eb1
  Yan Ru Pei authored Nov 13, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  2fc57eb1
- chore: better error handling in prefill router (#4286) · ce833983
  Yan Ru Pei authored Nov 13, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ce833983
- feat: Add vLLM multimodal audio support (#2760) · 0f5dd2b7
  Yuekai Zhang authored Nov 14, 2025
```
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com>
Signed-off-by: krishung5 <krish@nvidia.com>
Co-authored-by: Kris Hung <krish@nvidia.com>
```
  0f5dd2b7
- docs: add details on KVBM metrics to help customer self-debug perf (#4316) · 1bec3555
  Ziqi Fan authored Nov 13, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  1bec3555
- fix: kvbm defer logging init to after tokio runtime is available (#4123) · af26a013
  Anthony Casagrande authored Nov 13, 2025
```
Signed-off-by: Anthony Casagrande <acasagrande@nvidia.com>
```
  af26a013
- fix: TRTLLM build from source not repsecting the wheel installation directory (#4241) · 02763376
  Kyle McGill authored Nov 13, 2025
```
Signed-off-by: Kyle McGill <101670481+nv-kmcgill53@users.noreply.github.com>
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  02763376
- docs: Adds Qwen3-235B-A22B-FP8 recipes for TRTLLM agg and disagg (#4179) · 956f93f6
  Yunzhou Liu authored Nov 13, 2025
```
Signed-off-by: Elnifio <elnifio0519@gmail.com>
```
  956f93f6
- feat: check for broken symlinks. add back lychee external link checker with... · 4c29d6e7
  Nate Mailhot authored Nov 13, 2025
```
feat: check for broken symlinks. add back lychee external link checker with retries to fix failure (#4125)
Signed-off-by: Nate Mailhot <nmailhot@nvidia.com>
```
  4c29d6e7
- fix: remove [all] extra from sglang wheel install to fix warning (#4294) · 9a353c5c
  Harrison Saturley-Hall authored Nov 13, 2025
```
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
```
  9a353c5c
- feat(key_value_store): FileStore entries have a lease that auto-expires (#4301) · cdc9fa77
  Graham King authored Nov 13, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  cdc9fa77
- fix: remove wideep image ref from recipes (#4302) · 1fd58e97
  Anant Sharma authored Nov 13, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  1fd58e97
- feat: transport agnostic request plane for dynamo - natless (#4246) · 06b0ebef
  Biswa Panda authored Nov 13, 2025
  
  06b0ebef
- refactor: change TensorRT-LLM metrics prefix from trtllm: to trtllm_ (#4269) · 381c428c
  Keiven C authored Nov 13, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  381c428c
- chore: llama4 multimodal disagg support migration (#4213) · 4adab52d
  Ayush Agarwal authored Nov 13, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  4adab52d
- feat: update operator installation recommendations (#4270) · 54b1cf87
  Julien Mancuso authored Nov 13, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  54b1cf87
- fix: llama3-70-b-agg recipe model download failure (#4290) · bf21cc03
  Thomas Montfort authored Nov 13, 2025
  
  bf21cc03
- docs: reorganize prometheus.md to be consistent with docs/observability/metrics.md (#4262) · f817c595
  Keiven C authored Nov 12, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f817c595
- feat: `--config` file support in sglang (#4272) · d392bbdd
  ishandhanani authored Nov 12, 2025
  
  d392bbdd
- feat: kv router should route to available instances (#4225) · 8379b0cd
  Yan Ru Pei authored Nov 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  8379b0cd
- feat: Add DYN_SYSTEM_ENABLED=True (#4279) · 8a63d9ce
  Tzu-Ling Kan authored Nov 12, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  8a63d9ce
- fix(operator): add back injection of DYN_SYSTEM_ENABLED env var (#4282) · d70d9acf
  Thomas Montfort authored Nov 12, 2025
  
  d70d9acf
- chore: enlarge default KVBM leader-worker timeout and better wording (#4283) · 3fa8448b
  Ziqi Fan authored Nov 12, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  3fa8448b