Commits · ce83398366b13c8475ea4ec3872a0612ee791ede · OpenDAS / dynamo

"vscode:/vscode.git/clone" did not exist on "ca21288080882714d7d10ee8588641225b08756c"

13 Nov, 2025 22 commits
- chore: better error handling in prefill router (#4286) · ce833983
  Yan Ru Pei authored Nov 13, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ce833983
- feat: Add vLLM multimodal audio support (#2760) · 0f5dd2b7
  Yuekai Zhang authored Nov 14, 2025
```
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com>
Signed-off-by: krishung5 <krish@nvidia.com>
Co-authored-by: Kris Hung <krish@nvidia.com>
```
  0f5dd2b7
- docs: add details on KVBM metrics to help customer self-debug perf (#4316) · 1bec3555
  Ziqi Fan authored Nov 13, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  1bec3555
- fix: kvbm defer logging init to after tokio runtime is available (#4123) · af26a013
  Anthony Casagrande authored Nov 13, 2025
```
Signed-off-by: Anthony Casagrande <acasagrande@nvidia.com>
```
  af26a013
- fix: TRTLLM build from source not repsecting the wheel installation directory (#4241) · 02763376
  Kyle McGill authored Nov 13, 2025
```
Signed-off-by: Kyle McGill <101670481+nv-kmcgill53@users.noreply.github.com>
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  02763376
- docs: Adds Qwen3-235B-A22B-FP8 recipes for TRTLLM agg and disagg (#4179) · 956f93f6
  Yunzhou Liu authored Nov 13, 2025
```
Signed-off-by: Elnifio <elnifio0519@gmail.com>
```
  956f93f6
- feat: check for broken symlinks. add back lychee external link checker with... · 4c29d6e7
  Nate Mailhot authored Nov 13, 2025
```
feat: check for broken symlinks. add back lychee external link checker with retries to fix failure (#4125)
Signed-off-by: Nate Mailhot <nmailhot@nvidia.com>
```
  4c29d6e7
- fix: remove [all] extra from sglang wheel install to fix warning (#4294) · 9a353c5c
  Harrison Saturley-Hall authored Nov 13, 2025
```
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
```
  9a353c5c
- feat(key_value_store): FileStore entries have a lease that auto-expires (#4301) · cdc9fa77
  Graham King authored Nov 13, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  cdc9fa77
- fix: remove wideep image ref from recipes (#4302) · 1fd58e97
  Anant Sharma authored Nov 13, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  1fd58e97
- feat: transport agnostic request plane for dynamo - natless (#4246) · 06b0ebef
  Biswa Panda authored Nov 13, 2025
  
  06b0ebef
- refactor: change TensorRT-LLM metrics prefix from trtllm: to trtllm_ (#4269) · 381c428c
  Keiven C authored Nov 13, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  381c428c
- chore: llama4 multimodal disagg support migration (#4213) · 4adab52d
  Ayush Agarwal authored Nov 13, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  4adab52d
- feat: update operator installation recommendations (#4270) · 54b1cf87
  Julien Mancuso authored Nov 13, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  54b1cf87
- fix: llama3-70-b-agg recipe model download failure (#4290) · bf21cc03
  Thomas Montfort authored Nov 13, 2025
  
  bf21cc03
- docs: reorganize prometheus.md to be consistent with docs/observability/metrics.md (#4262) · f817c595
  Keiven C authored Nov 12, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f817c595
- feat: `--config` file support in sglang (#4272) · d392bbdd
  ishandhanani authored Nov 12, 2025
  
  d392bbdd
- feat: kv router should route to available instances (#4225) · 8379b0cd
  Yan Ru Pei authored Nov 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  8379b0cd
- feat: Add DYN_SYSTEM_ENABLED=True (#4279) · 8a63d9ce
  Tzu-Ling Kan authored Nov 12, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  8a63d9ce
- fix(operator): add back injection of DYN_SYSTEM_ENABLED env var (#4282) · d70d9acf
  Thomas Montfort authored Nov 12, 2025
  
  d70d9acf
- chore: enlarge default KVBM leader-worker timeout and better wording (#4283) · 3fa8448b
  Ziqi Fan authored Nov 12, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  3fa8448b
- chore: router slot manager should not panic (#4267) · 1f44fca7
  Yan Ru Pei authored Nov 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1f44fca7
12 Nov, 2025 14 commits
- fix: add -R flag to recurse into subdir for gaie recipe (#4260) · b60132c2
  atchernych authored Nov 12, 2025
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  b60132c2
- build: OPS-810: add dynamo frontend image w/EPP support (#4150) · a38319e6
  Tushar Sharma authored Nov 12, 2025
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  a38319e6
- ci: OPS-2024: Fix concurrency on main (#4258) · f50c3861
  Dillon Cullinan authored Nov 12, 2025
```
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
```
  f50c3861
- fix: append namespace to planner pod names in tests (#4273) · bb7d203f
  hhzhang16 authored Nov 12, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  bb7d203f
- chore: make Router non-reliant on etcd (#4244) · 4d86f347
  Yan Ru Pei authored Nov 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  4d86f347
- feat: tie break on tree size when routing (#4257) · 7d604dd3
  Yan Ru Pei authored Nov 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7d604dd3
- feat: agg support + solidfy fp8 configs (#3886) · f8219b12
  ishandhanani authored Nov 12, 2025
  
  f8219b12
- docs: update KVBM runbooks on metrics due to dynamo metrics change (#4266) · 2c910b2e
  Ziqi Fan authored Nov 12, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  2c910b2e
- ci: Shorten deploy test namespaces (#4254) · 744cda65
  Dillon Cullinan authored Nov 12, 2025
```
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
```
  744cda65
- feat: KVBM V2 transfer (#4068) · 827b8c3e
  jthomson04 authored Nov 12, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  827b8c3e
- chore: use notify instead of inotify (#4250) · 38242c8d
  Yan Ru Pei authored Nov 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  38242c8d
- feat(router): max tree size based pruning (#4057) · 3ea22fcf
  Waël Boukhobza authored Nov 12, 2025
```
Signed-off-by: Wael Boukhobza <wawa_wael@live.fr>
```
  3ea22fcf
- fix: typo from mountPoint to mountPath (#4252) · a207b4be
  hhzhang16 authored Nov 12, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  a207b4be
- feat: add --enable-otel flag to SGLang launch scripts (#4243) · 5fd96a23
  ishandhanani authored Nov 11, 2025
  
  5fd96a23
11 Nov, 2025 4 commits
- chore: Remove the python bindings for port allocation (#4237) · fbad2860
  Graham King authored Nov 11, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  fbad2860
- chore: Remove static mode (#4235) · e1af3af6
  Graham King authored Nov 11, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  e1af3af6
- feat: sglang update to `0.5.3.post4` (#4227) · d9b674b8
  ishandhanani authored Nov 11, 2025
  
  d9b674b8
- feat: Add output token counter to frontend metrics (#4202) · 8f868986
  Aryan Bagade authored Nov 10, 2025
```
Signed-off-by: Aryan Bagade <aryan@aryanbagade.com>
```
  8f868986