Commits · e2f5125434f9461cea4f4d19f684e2e3403f532f · OpenDAS / dynamo

"lib/bindings/c/vscode:/vscode.git/clone" did not exist on "82577b06889f1d3a77c1af2eec8153b923d2d107"

19 Nov, 2025 6 commits
- feat: Only monitor NATS metrics if using NATS request plane (#4442) · 69797b5a
  Graham King authored Nov 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  69797b5a
- chore: Upgrade NIXL to 0.7.1 and allow KVBM to pick NIXL cuda 12 or 13 (#4281) · 0b8b7ffb
  Kyle McGill authored Nov 19, 2025
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
```
  0b8b7ffb
- feat: nvext field to OpenAI APIs and add worker_id reporting (vLLM) (#4372) · 263f99dc
  Zhongxuan (Daniel) Wang authored Nov 18, 2025
```
Signed-off-by: Zhongxuan Wang <daniewang@nvidia.com>
```
  263f99dc
- feat: generate deterministic lora id from lora name (#4457) · 684107c4
  Biswa Panda authored Nov 18, 2025
  
  684107c4
- feat: Request Cancellation when transitioning from Prefill to Decode at KV Prefill Router (#4449) · 04486c1d
  Jacky authored Nov 18, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  04486c1d
- docs: kvbm wheels doc fix (#4455) · 429ddf12
  Olga Andreeva authored Nov 18, 2025
```
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
```
  429ddf12
18 Nov, 2025 9 commits
- feat: Support toolcall parser for DeepSeek V3 and R1 (#4253) · 164b0c29
  tangcy98 authored Nov 19, 2025
```
Signed-off-by: zhangzhang <tangchenyu@xiaohongshu.com>
Co-authored-by: zhangzhang <tangchenyu@xiaohongshu.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
```
  164b0c29
- fix: guard KV-indexer against self-referential blocks (#4395) · 4f2cbec0
  Vladislav Nosivskoy authored Nov 19, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>
```
  4f2cbec0
- feat: support prompt_tokens_details in usage (#4239) · be9d6b2b
  Vladislav Nosivskoy authored Nov 19, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
```
  be9d6b2b
- fix: Set annotated_usage.event to None in the final usage chunk response (#3729) · 33d9ae78
  Shuaiyi Zhang authored Nov 19, 2025
```
Signed-off-by: Shuaiyi Zhang <zhangsy28@lenovo.com>
Co-authored-by: Shuaiyi Zhang <zhangsy28@lenovo.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  33d9ae78
- fix(storage): File store shouldn't notify on metdata changes (#4434) · 2f1778c1
  Graham King authored Nov 18, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  2f1778c1
- feat: nixl_connect: Change the way `bytes` are passed to NIXL (#4314) · 08146531
  J Wyman authored Nov 18, 2025
```
Signed-off-by: J Wyman <jwyman@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  08146531
- feat: mocker can use planner profile data (#4422) · fc2ad4eb
  Yan Ru Pei authored Nov 18, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
```
  fc2ad4eb
- fix: Move trtllm multimodal worker to use ModelInput.Token (#4373) · c3984bc2
  Indrajit Bhosale authored Nov 17, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  c3984bc2
- feat: discovery traits, systems and managers (#4070) · 4d3269cd
  Ryan Olson authored Nov 17, 2025
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  4d3269cd
17 Nov, 2025 3 commits
- feat: kvbm kernels (#4356) · 09bb1c68
  Ryan Olson authored Nov 17, 2025
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  09bb1c68
- refactor: centralize environment variable constants (#4083) · 0e77d344
  Keiven C authored Nov 17, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  0e77d344
- feat: Command line flag to set request plane mode: tcp, http or nats (#4365) · 886506c1
  Graham King authored Nov 17, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  886506c1
16 Nov, 2025 1 commit
- test: Deterministic ETCD client failover tests (#4363) · ed8cd590
  Jacky authored Nov 15, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  ed8cd590
14 Nov, 2025 6 commits
- fix(router): change prune channel to be mpsc instead of watch, increase max size (#4351) · 2cf427ed
  Waël Boukhobza authored Nov 14, 2025
```
Signed-off-by: Wael Boukhobza <wawa_wael@live.fr>
```
  2cf427ed
- fix(runtime): Handle dropping the tokio runtime in async context (#4343) · 611c213b
  Graham King authored Nov 14, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  611c213b
- refactor: migrate kvbm python bindings to the python directory (#4318) · 5a5bc51e
  Ryan Olson authored Nov 14, 2025
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  5a5bc51e
- fix: k8s native discovery (#4305) · 334ce551
  Thomas Montfort authored Nov 14, 2025
  
  334ce551
- chore: use hyphens for Router-related keys (#4325) · 065296c3
  Yan Ru Pei authored Nov 14, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  065296c3
- fix: Make lmcache dependency optional for PdConnector (#4319) · b2370a97
  Olga Andreeva authored Nov 14, 2025
```
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
Signed-off-by: Olga Andreeva <124622579+oandreeva-nv@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
```
  b2370a97
13 Nov, 2025 9 commits
- test(key_value_store): Assert entries() works correctly (#4312) · 58da7cfe
  Graham King authored Nov 13, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  58da7cfe
- chore: better error handling in prefill router (#4286) · ce833983
  Yan Ru Pei authored Nov 13, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ce833983
- feat: Add vLLM multimodal audio support (#2760) · 0f5dd2b7
  Yuekai Zhang authored Nov 14, 2025
```
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com>
Signed-off-by: krishung5 <krish@nvidia.com>
Co-authored-by: Kris Hung <krish@nvidia.com>
```
  0f5dd2b7
- fix: kvbm defer logging init to after tokio runtime is available (#4123) · af26a013
  Anthony Casagrande authored Nov 13, 2025
```
Signed-off-by: Anthony Casagrande <acasagrande@nvidia.com>
```
  af26a013
- feat(key_value_store): FileStore entries have a lease that auto-expires (#4301) · cdc9fa77
  Graham King authored Nov 13, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  cdc9fa77
- feat: transport agnostic request plane for dynamo - natless (#4246) · 06b0ebef
  Biswa Panda authored Nov 13, 2025
  
  06b0ebef
- feat: kv router should route to available instances (#4225) · 8379b0cd
  Yan Ru Pei authored Nov 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  8379b0cd
- chore: enlarge default KVBM leader-worker timeout and better wording (#4283) · 3fa8448b
  Ziqi Fan authored Nov 12, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  3fa8448b
- chore: router slot manager should not panic (#4267) · 1f44fca7
  Yan Ru Pei authored Nov 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1f44fca7
12 Nov, 2025 5 commits
- chore: make Router non-reliant on etcd (#4244) · 4d86f347
  Yan Ru Pei authored Nov 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  4d86f347
- feat: tie break on tree size when routing (#4257) · 7d604dd3
  Yan Ru Pei authored Nov 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7d604dd3
- feat: KVBM V2 transfer (#4068) · 827b8c3e
  jthomson04 authored Nov 12, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  827b8c3e
- chore: use notify instead of inotify (#4250) · 38242c8d
  Yan Ru Pei authored Nov 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  38242c8d
- feat(router): max tree size based pruning (#4057) · 3ea22fcf
  Waël Boukhobza authored Nov 12, 2025
```
Signed-off-by: Wael Boukhobza <wawa_wael@live.fr>
```
  3ea22fcf
11 Nov, 2025 1 commit
- chore: Remove the python bindings for port allocation (#4237) · fbad2860
  Graham King authored Nov 11, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  fbad2860