Commits · b2370a97e324c536a12609b2f16a5484193693c6 · OpenDAS / dynamo · GitLab

14 Nov, 2025 5 commits
- fix: Make lmcache dependency optional for PdConnector (#4319) · b2370a97
  Olga Andreeva authored Nov 14, 2025
```
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
Signed-off-by: Olga Andreeva <124622579+oandreeva-nv@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
```
  b2370a97
- fix: add kvbm arg in trtllm runtime image build (#4337) · d6cda975
  Anant Sharma authored Nov 14, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  d6cda975
- feat: add fsgroup to ProfilingJob (#4298) · 436f08df
  hhzhang16 authored Nov 14, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  436f08df
- fix: fix namespace (#4324) · 4891e161
  atchernych authored Nov 13, 2025
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  4891e161
- fix(vllm): port allocation bugs leading to zmq error (#4321) · ecf6d48c
  Alec authored Nov 13, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  ecf6d48c
13 Nov, 2025 25 commits
- test(key_value_store): Assert entries() works correctly (#4312) · 58da7cfe
  Graham King authored Nov 13, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  58da7cfe
- fix(docs): metrics documentation that were missing 2 metrics (#4309) · 3cf67ee0
  Keiven C authored Nov 13, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  3cf67ee0
- docs: update vllm mermaid diagram (#4320) · 2fc57eb1
  Yan Ru Pei authored Nov 13, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  2fc57eb1
- chore: better error handling in prefill router (#4286) · ce833983
  Yan Ru Pei authored Nov 13, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ce833983
- feat: Add vLLM multimodal audio support (#2760) · 0f5dd2b7
  Yuekai Zhang authored Nov 14, 2025
```
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com>
Signed-off-by: krishung5 <krish@nvidia.com>
Co-authored-by: Kris Hung <krish@nvidia.com>
```
  0f5dd2b7
- docs: add details on KVBM metrics to help customer self-debug perf (#4316) · 1bec3555
  Ziqi Fan authored Nov 13, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  1bec3555
- fix: kvbm defer logging init to after tokio runtime is available (#4123) · af26a013
  Anthony Casagrande authored Nov 13, 2025
```
Signed-off-by: Anthony Casagrande <acasagrande@nvidia.com>
```
  af26a013
- fix: TRTLLM build from source not repsecting the wheel installation directory (#4241) · 02763376
  Kyle McGill authored Nov 13, 2025
```
Signed-off-by: Kyle McGill <101670481+nv-kmcgill53@users.noreply.github.com>
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  02763376
- docs: Adds Qwen3-235B-A22B-FP8 recipes for TRTLLM agg and disagg (#4179) · 956f93f6
  Yunzhou Liu authored Nov 13, 2025
```
Signed-off-by: Elnifio <elnifio0519@gmail.com>
```
  956f93f6
- feat: check for broken symlinks. add back lychee external link checker with... · 4c29d6e7
  Nate Mailhot authored Nov 13, 2025
```
feat: check for broken symlinks. add back lychee external link checker with retries to fix failure (#4125)
Signed-off-by: Nate Mailhot <nmailhot@nvidia.com>
```
  4c29d6e7
- fix: remove [all] extra from sglang wheel install to fix warning (#4294) · 9a353c5c
  Harrison Saturley-Hall authored Nov 13, 2025
```
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
```
  9a353c5c
- feat(key_value_store): FileStore entries have a lease that auto-expires (#4301) · cdc9fa77
  Graham King authored Nov 13, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  cdc9fa77
- fix: remove wideep image ref from recipes (#4302) · 1fd58e97
  Anant Sharma authored Nov 13, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  1fd58e97
- feat: transport agnostic request plane for dynamo - natless (#4246) · 06b0ebef
  Biswa Panda authored Nov 13, 2025
  
  06b0ebef
- refactor: change TensorRT-LLM metrics prefix from trtllm: to trtllm_ (#4269) · 381c428c
  Keiven C authored Nov 13, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  381c428c
- chore: llama4 multimodal disagg support migration (#4213) · 4adab52d
  Ayush Agarwal authored Nov 13, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  4adab52d
- feat: update operator installation recommendations (#4270) · 54b1cf87
  Julien Mancuso authored Nov 13, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  54b1cf87
- fix: llama3-70-b-agg recipe model download failure (#4290) · bf21cc03
  Thomas Montfort authored Nov 13, 2025
  
  bf21cc03
- docs: reorganize prometheus.md to be consistent with docs/observability/metrics.md (#4262) · f817c595
  Keiven C authored Nov 12, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f817c595
- feat: `--config` file support in sglang (#4272) · d392bbdd
  ishandhanani authored Nov 12, 2025
  
  d392bbdd
- feat: kv router should route to available instances (#4225) · 8379b0cd
  Yan Ru Pei authored Nov 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  8379b0cd
- feat: Add DYN_SYSTEM_ENABLED=True (#4279) · 8a63d9ce
  Tzu-Ling Kan authored Nov 12, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  8a63d9ce
- fix(operator): add back injection of DYN_SYSTEM_ENABLED env var (#4282) · d70d9acf
  Thomas Montfort authored Nov 12, 2025
  
  d70d9acf
- chore: enlarge default KVBM leader-worker timeout and better wording (#4283) · 3fa8448b
  Ziqi Fan authored Nov 12, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  3fa8448b
- chore: router slot manager should not panic (#4267) · 1f44fca7
  Yan Ru Pei authored Nov 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1f44fca7
12 Nov, 2025 10 commits
- fix: add -R flag to recurse into subdir for gaie recipe (#4260) · b60132c2
  atchernych authored Nov 12, 2025
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  b60132c2
- build: OPS-810: add dynamo frontend image w/EPP support (#4150) · a38319e6
  Tushar Sharma authored Nov 12, 2025
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  a38319e6
- ci: OPS-2024: Fix concurrency on main (#4258) · f50c3861
  Dillon Cullinan authored Nov 12, 2025
```
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
```
  f50c3861
- fix: append namespace to planner pod names in tests (#4273) · bb7d203f
  hhzhang16 authored Nov 12, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  bb7d203f
- chore: make Router non-reliant on etcd (#4244) · 4d86f347
  Yan Ru Pei authored Nov 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  4d86f347
- feat: tie break on tree size when routing (#4257) · 7d604dd3
  Yan Ru Pei authored Nov 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7d604dd3
- feat: agg support + solidfy fp8 configs (#3886) · f8219b12
  ishandhanani authored Nov 12, 2025
  
  f8219b12
- docs: update KVBM runbooks on metrics due to dynamo metrics change (#4266) · 2c910b2e
  Ziqi Fan authored Nov 12, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  2c910b2e
- ci: Shorten deploy test namespaces (#4254) · 744cda65
  Dillon Cullinan authored Nov 12, 2025
```
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
```
  744cda65
- feat: KVBM V2 transfer (#4068) · 827b8c3e
  jthomson04 authored Nov 12, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  827b8c3e