Commits · 8a14f9edc16923f0f885f6178260abc063cf8519 · OpenDAS / dynamo

"docs/support_matrix.md" did not exist on "63974527cac93a5f2f3c4f6b4f8f54161f032503"

20 Nov, 2025 4 commits
- chore: Remove DistributedRuntime::etcd_client (#4489) · 8a14f9ed
  Graham King authored Nov 20, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  8a14f9ed
- chore: better error handling in Router slot manager (#4496) · c0c664a9
  Yan Ru Pei authored Nov 19, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c0c664a9
- fix: same endpoint for tcp health check (#4494) · 55c66a63
  Biswa Panda authored Nov 19, 2025
  
  55c66a63
- feat: Report KVBM cache hit rate (#4333) · b2605a8e
  Kris Hung authored Nov 19, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  b2605a8e
19 Nov, 2025 11 commits
- chore: Remove unused leader_worker_barrier (#4480) · 473cb57e
  Graham King authored Nov 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  473cb57e
- fix: support multimodal models with non-standard Jinja2 tags (#4379) · f395b641
  Keiven C authored Nov 19, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f395b641
- feat(mistralrs): Upgrade to support CUDA 13 (#4474) · 2100f6aa
  Graham King authored Nov 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  2100f6aa
- feat: unregister discovery instance (#4459) · 781331c6
  Biswa Panda authored Nov 19, 2025
  
  781331c6
- fix: Revert "feat: kvbm kernels (#4356)" (#4467) · c2cc9782
  Dmitry Tokarev authored Nov 19, 2025
  
  c2cc9782
- feat: Only monitor NATS metrics if using NATS request plane (#4442) · 69797b5a
  Graham King authored Nov 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  69797b5a
- chore: Upgrade NIXL to 0.7.1 and allow KVBM to pick NIXL cuda 12 or 13 (#4281) · 0b8b7ffb
  Kyle McGill authored Nov 19, 2025
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
```
  0b8b7ffb
- feat: nvext field to OpenAI APIs and add worker_id reporting (vLLM) (#4372) · 263f99dc
  Zhongxuan (Daniel) Wang authored Nov 18, 2025
```
Signed-off-by: Zhongxuan Wang <daniewang@nvidia.com>
```
  263f99dc
- feat: generate deterministic lora id from lora name (#4457) · 684107c4
  Biswa Panda authored Nov 18, 2025
  
  684107c4
- feat: Request Cancellation when transitioning from Prefill to Decode at KV Prefill Router (#4449) · 04486c1d
  Jacky authored Nov 18, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  04486c1d
- docs: kvbm wheels doc fix (#4455) · 429ddf12
  Olga Andreeva authored Nov 18, 2025
```
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
```
  429ddf12
18 Nov, 2025 9 commits
- feat: Support toolcall parser for DeepSeek V3 and R1 (#4253) · 164b0c29
  tangcy98 authored Nov 19, 2025
```
Signed-off-by: zhangzhang <tangchenyu@xiaohongshu.com>
Co-authored-by: zhangzhang <tangchenyu@xiaohongshu.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
```
  164b0c29
- fix: guard KV-indexer against self-referential blocks (#4395) · 4f2cbec0
  Vladislav Nosivskoy authored Nov 19, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>
```
  4f2cbec0
- feat: support prompt_tokens_details in usage (#4239) · be9d6b2b
  Vladislav Nosivskoy authored Nov 19, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
```
  be9d6b2b
- fix: Set annotated_usage.event to None in the final usage chunk response (#3729) · 33d9ae78
  Shuaiyi Zhang authored Nov 19, 2025
```
Signed-off-by: Shuaiyi Zhang <zhangsy28@lenovo.com>
Co-authored-by: Shuaiyi Zhang <zhangsy28@lenovo.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  33d9ae78
- fix(storage): File store shouldn't notify on metdata changes (#4434) · 2f1778c1
  Graham King authored Nov 18, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  2f1778c1
- feat: nixl_connect: Change the way `bytes` are passed to NIXL (#4314) · 08146531
  J Wyman authored Nov 18, 2025
```
Signed-off-by: J Wyman <jwyman@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  08146531
- feat: mocker can use planner profile data (#4422) · fc2ad4eb
  Yan Ru Pei authored Nov 18, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
```
  fc2ad4eb
- fix: Move trtllm multimodal worker to use ModelInput.Token (#4373) · c3984bc2
  Indrajit Bhosale authored Nov 17, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  c3984bc2
- feat: discovery traits, systems and managers (#4070) · 4d3269cd
  Ryan Olson authored Nov 17, 2025
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  4d3269cd
17 Nov, 2025 3 commits
- feat: kvbm kernels (#4356) · 09bb1c68
  Ryan Olson authored Nov 17, 2025
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  09bb1c68
- refactor: centralize environment variable constants (#4083) · 0e77d344
  Keiven C authored Nov 17, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  0e77d344
- feat: Command line flag to set request plane mode: tcp, http or nats (#4365) · 886506c1
  Graham King authored Nov 17, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  886506c1
16 Nov, 2025 1 commit
- test: Deterministic ETCD client failover tests (#4363) · ed8cd590
  Jacky authored Nov 15, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  ed8cd590
14 Nov, 2025 6 commits
- fix(router): change prune channel to be mpsc instead of watch, increase max size (#4351) · 2cf427ed
  Waël Boukhobza authored Nov 14, 2025
```
Signed-off-by: Wael Boukhobza <wawa_wael@live.fr>
```
  2cf427ed
- fix(runtime): Handle dropping the tokio runtime in async context (#4343) · 611c213b
  Graham King authored Nov 14, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  611c213b
- refactor: migrate kvbm python bindings to the python directory (#4318) · 5a5bc51e
  Ryan Olson authored Nov 14, 2025
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  5a5bc51e
- fix: k8s native discovery (#4305) · 334ce551
  Thomas Montfort authored Nov 14, 2025
  
  334ce551
- chore: use hyphens for Router-related keys (#4325) · 065296c3
  Yan Ru Pei authored Nov 14, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  065296c3
- fix: Make lmcache dependency optional for PdConnector (#4319) · b2370a97
  Olga Andreeva authored Nov 14, 2025
```
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
Signed-off-by: Olga Andreeva <124622579+oandreeva-nv@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
```
  b2370a97
13 Nov, 2025 6 commits
- test(key_value_store): Assert entries() works correctly (#4312) · 58da7cfe
  Graham King authored Nov 13, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  58da7cfe
- chore: better error handling in prefill router (#4286) · ce833983
  Yan Ru Pei authored Nov 13, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ce833983
- feat: Add vLLM multimodal audio support (#2760) · 0f5dd2b7
  Yuekai Zhang authored Nov 14, 2025
```
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com>
Signed-off-by: krishung5 <krish@nvidia.com>
Co-authored-by: Kris Hung <krish@nvidia.com>
```
  0f5dd2b7
- fix: kvbm defer logging init to after tokio runtime is available (#4123) · af26a013
  Anthony Casagrande authored Nov 13, 2025
```
Signed-off-by: Anthony Casagrande <acasagrande@nvidia.com>
```
  af26a013
- feat(key_value_store): FileStore entries have a lease that auto-expires (#4301) · cdc9fa77
  Graham King authored Nov 13, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  cdc9fa77
- feat: transport agnostic request plane for dynamo - natless (#4246) · 06b0ebef
  Biswa Panda authored Nov 13, 2025
  
  06b0ebef