Commits · f05f7629f304d4af86f3df4484fafe2f1dfe58d6 · OpenDAS / dynamo · GitLab

21 Nov, 2025 7 commits
- chore: Make nats_client private at crate level, various tidy up (#4513) · f05f7629
  Graham King authored Nov 21, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  f05f7629
- fix(storage): Correctly encoding FileStore keys (#4539) · 27904535
  Graham King authored Nov 21, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  27904535
- chore: merge KvIndexer and ApproxKvIndexer (#4500) · c61e0dd3
  Yan Ru Pei authored Nov 21, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c61e0dd3
- fix: worker_id updates not applied (#4518) · 989e246e
  Zhongxuan (Daniel) Wang authored Nov 21, 2025
```
Signed-off-by: Zhongxuan (Daniel) Wang <daniewang@nvidia.com>
```
  989e246e
- chore: parallelize planner profile tests + bindings test cleanup (#4532) · d821a8b9
  Yan Ru Pei authored Nov 21, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d821a8b9
- feat: Xml coder tool parser (#4415) · 65f18884
  William Zhang authored Nov 21, 2025
```
This commit adds a parser implementation for Xml style
tool calls, based currently on Qwen3 coder.

Followup work needs to be done to make it more generic
and parameterizable.
```
  65f18884
- fix: missing tool calling usage (#4516) · 179ee38b
  Ayush Agarwal authored Nov 20, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  179ee38b
20 Nov, 2025 7 commits
- fix: Support for msg[content] as a list (#4485) · 6767559f
  KrishnanPrash authored Nov 20, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  6767559f
- chore: Use general engine source for KVBM KV events (#4515) · 2f18b23e
  Kris Hung authored Nov 20, 2025
  
  2f18b23e
- feat: Add metrics endpoint to kserve gRPC service (#4400) · 5fe0476e
  Tanmay Verma authored Nov 20, 2025
  
  5fe0476e
- chore: Remove DistributedRuntime::etcd_client (#4489) · 8a14f9ed
  Graham King authored Nov 20, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  8a14f9ed
- chore: better error handling in Router slot manager (#4496) · c0c664a9
  Yan Ru Pei authored Nov 19, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c0c664a9
- fix: same endpoint for tcp health check (#4494) · 55c66a63
  Biswa Panda authored Nov 19, 2025
  
  55c66a63
- feat: Report KVBM cache hit rate (#4333) · b2605a8e
  Kris Hung authored Nov 19, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  b2605a8e
19 Nov, 2025 11 commits
- chore: Remove unused leader_worker_barrier (#4480) · 473cb57e
  Graham King authored Nov 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  473cb57e
- fix: support multimodal models with non-standard Jinja2 tags (#4379) · f395b641
  Keiven C authored Nov 19, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f395b641
- feat(mistralrs): Upgrade to support CUDA 13 (#4474) · 2100f6aa
  Graham King authored Nov 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  2100f6aa
- feat: unregister discovery instance (#4459) · 781331c6
  Biswa Panda authored Nov 19, 2025
  
  781331c6
- fix: Revert "feat: kvbm kernels (#4356)" (#4467) · c2cc9782
  Dmitry Tokarev authored Nov 19, 2025
  
  c2cc9782
- feat: Only monitor NATS metrics if using NATS request plane (#4442) · 69797b5a
  Graham King authored Nov 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  69797b5a
- chore: Upgrade NIXL to 0.7.1 and allow KVBM to pick NIXL cuda 12 or 13 (#4281) · 0b8b7ffb
  Kyle McGill authored Nov 19, 2025
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
```
  0b8b7ffb
- feat: nvext field to OpenAI APIs and add worker_id reporting (vLLM) (#4372) · 263f99dc
  Zhongxuan (Daniel) Wang authored Nov 18, 2025
```
Signed-off-by: Zhongxuan Wang <daniewang@nvidia.com>
```
  263f99dc
- feat: generate deterministic lora id from lora name (#4457) · 684107c4
  Biswa Panda authored Nov 18, 2025
  
  684107c4
- feat: Request Cancellation when transitioning from Prefill to Decode at KV Prefill Router (#4449) · 04486c1d
  Jacky authored Nov 18, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  04486c1d
- docs: kvbm wheels doc fix (#4455) · 429ddf12
  Olga Andreeva authored Nov 18, 2025
```
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
```
  429ddf12
18 Nov, 2025 9 commits
- feat: Support toolcall parser for DeepSeek V3 and R1 (#4253) · 164b0c29
  tangcy98 authored Nov 19, 2025
```
Signed-off-by: zhangzhang <tangchenyu@xiaohongshu.com>
Co-authored-by: zhangzhang <tangchenyu@xiaohongshu.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
```
  164b0c29
- fix: guard KV-indexer against self-referential blocks (#4395) · 4f2cbec0
  Vladislav Nosivskoy authored Nov 19, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>
```
  4f2cbec0
- feat: support prompt_tokens_details in usage (#4239) · be9d6b2b
  Vladislav Nosivskoy authored Nov 19, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
```
  be9d6b2b
- fix: Set annotated_usage.event to None in the final usage chunk response (#3729) · 33d9ae78
  Shuaiyi Zhang authored Nov 19, 2025
```
Signed-off-by: Shuaiyi Zhang <zhangsy28@lenovo.com>
Co-authored-by: Shuaiyi Zhang <zhangsy28@lenovo.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  33d9ae78
- fix(storage): File store shouldn't notify on metdata changes (#4434) · 2f1778c1
  Graham King authored Nov 18, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  2f1778c1
- feat: nixl_connect: Change the way `bytes` are passed to NIXL (#4314) · 08146531
  J Wyman authored Nov 18, 2025
```
Signed-off-by: J Wyman <jwyman@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  08146531
- feat: mocker can use planner profile data (#4422) · fc2ad4eb
  Yan Ru Pei authored Nov 18, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
```
  fc2ad4eb
- fix: Move trtllm multimodal worker to use ModelInput.Token (#4373) · c3984bc2
  Indrajit Bhosale authored Nov 17, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  c3984bc2
- feat: discovery traits, systems and managers (#4070) · 4d3269cd
  Ryan Olson authored Nov 17, 2025
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  4d3269cd
17 Nov, 2025 3 commits
- feat: kvbm kernels (#4356) · 09bb1c68
  Ryan Olson authored Nov 17, 2025
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  09bb1c68
- refactor: centralize environment variable constants (#4083) · 0e77d344
  Keiven C authored Nov 17, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  0e77d344
- feat: Command line flag to set request plane mode: tcp, http or nats (#4365) · 886506c1
  Graham King authored Nov 17, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  886506c1
16 Nov, 2025 1 commit
- test: Deterministic ETCD client failover tests (#4363) · ed8cd590
  Jacky authored Nov 15, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  ed8cd590
14 Nov, 2025 2 commits
- fix(router): change prune channel to be mpsc instead of watch, increase max size (#4351) · 2cf427ed
  Waël Boukhobza authored Nov 14, 2025
```
Signed-off-by: Wael Boukhobza <wawa_wael@live.fr>
```
  2cf427ed
- fix(runtime): Handle dropping the tokio runtime in async context (#4343) · 611c213b
  Graham King authored Nov 14, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  611c213b