Commits · 7a3847936672935e720d5a63be8dd61eaacde7e8 · OpenDAS / dynamo

"vscode:/vscode.git/clone" did not exist on "80e254834de9c3c34eaca02d8880e952b3daf344"

25 Nov, 2025 6 commits
- chore: make router use the discovery pattern instead of manual kv watch (#4597) · 9c5018e5
  Yan Ru Pei authored Nov 25, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  9c5018e5
- chore(runtime): Make nats_client private, refactor NATS stats scraping (#4591) · 17dcffe8
  Graham King authored Nov 25, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  17dcffe8
- feat: decoded media via NIXL (#3988) · 0a065918
  milesial authored Nov 25, 2025
```
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
Signed-off-by: Ayush Agarwal <ayushag@nvidia.com>
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
Co-authored-by: Krishnan Prashanth <kprashanth@nvidia.com>
Co-authored-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
```
  0a065918
- refactor(llm): Rename EngineConfig::Static to InProcess (#4585) · 0fc5273c
  Graham King authored Nov 25, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  0fc5273c
- chore(runtime): Tidy up component paths (#4560) · 51c1b9f1
  Graham King authored Nov 25, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  51c1b9f1
- fix: expose prefill worker id in disagg (#4563) · 57c701fb
  Yan Ru Pei authored Nov 24, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  57c701fb
24 Nov, 2025 1 commit
- fix(dynamo-run): Run without etcd/nats, HTTP port to 8000 (#4555) · e75bcf67
  Graham King authored Nov 24, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  e75bcf67
22 Nov, 2025 1 commit
- fix: health check endpoint (#4522) · b1286e7f
  Biswa Panda authored Nov 21, 2025
  
  b1286e7f
21 Nov, 2025 7 commits
- chore: Make nats_client private at crate level, various tidy up (#4513) · f05f7629
  Graham King authored Nov 21, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  f05f7629
- fix(storage): Correctly encoding FileStore keys (#4539) · 27904535
  Graham King authored Nov 21, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  27904535
- chore: merge KvIndexer and ApproxKvIndexer (#4500) · c61e0dd3
  Yan Ru Pei authored Nov 21, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c61e0dd3
- fix: worker_id updates not applied (#4518) · 989e246e
  Zhongxuan (Daniel) Wang authored Nov 21, 2025
```
Signed-off-by: Zhongxuan (Daniel) Wang <daniewang@nvidia.com>
```
  989e246e
- chore: parallelize planner profile tests + bindings test cleanup (#4532) · d821a8b9
  Yan Ru Pei authored Nov 21, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d821a8b9
- feat: Xml coder tool parser (#4415) · 65f18884
  William Zhang authored Nov 21, 2025
```
This commit adds a parser implementation for Xml style
tool calls, based currently on Qwen3 coder.

Followup work needs to be done to make it more generic
and parameterizable.
```
  65f18884
- fix: missing tool calling usage (#4516) · 179ee38b
  Ayush Agarwal authored Nov 20, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  179ee38b
20 Nov, 2025 7 commits
- fix: Support for msg[content] as a list (#4485) · 6767559f
  KrishnanPrash authored Nov 20, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  6767559f
- chore: Use general engine source for KVBM KV events (#4515) · 2f18b23e
  Kris Hung authored Nov 20, 2025
  
  2f18b23e
- feat: Add metrics endpoint to kserve gRPC service (#4400) · 5fe0476e
  Tanmay Verma authored Nov 20, 2025
  
  5fe0476e
- chore: Remove DistributedRuntime::etcd_client (#4489) · 8a14f9ed
  Graham King authored Nov 20, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  8a14f9ed
- chore: better error handling in Router slot manager (#4496) · c0c664a9
  Yan Ru Pei authored Nov 19, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c0c664a9
- fix: same endpoint for tcp health check (#4494) · 55c66a63
  Biswa Panda authored Nov 19, 2025
  
  55c66a63
- feat: Report KVBM cache hit rate (#4333) · b2605a8e
  Kris Hung authored Nov 19, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  b2605a8e
19 Nov, 2025 11 commits
- chore: Remove unused leader_worker_barrier (#4480) · 473cb57e
  Graham King authored Nov 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  473cb57e
- fix: support multimodal models with non-standard Jinja2 tags (#4379) · f395b641
  Keiven C authored Nov 19, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f395b641
- feat(mistralrs): Upgrade to support CUDA 13 (#4474) · 2100f6aa
  Graham King authored Nov 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  2100f6aa
- feat: unregister discovery instance (#4459) · 781331c6
  Biswa Panda authored Nov 19, 2025
  
  781331c6
- fix: Revert "feat: kvbm kernels (#4356)" (#4467) · c2cc9782
  Dmitry Tokarev authored Nov 19, 2025
  
  c2cc9782
- feat: Only monitor NATS metrics if using NATS request plane (#4442) · 69797b5a
  Graham King authored Nov 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  69797b5a
- chore: Upgrade NIXL to 0.7.1 and allow KVBM to pick NIXL cuda 12 or 13 (#4281) · 0b8b7ffb
  Kyle McGill authored Nov 19, 2025
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
```
  0b8b7ffb
- feat: nvext field to OpenAI APIs and add worker_id reporting (vLLM) (#4372) · 263f99dc
  Zhongxuan (Daniel) Wang authored Nov 18, 2025
```
Signed-off-by: Zhongxuan Wang <daniewang@nvidia.com>
```
  263f99dc
- feat: generate deterministic lora id from lora name (#4457) · 684107c4
  Biswa Panda authored Nov 18, 2025
  
  684107c4
- feat: Request Cancellation when transitioning from Prefill to Decode at KV Prefill Router (#4449) · 04486c1d
  Jacky authored Nov 18, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  04486c1d
- docs: kvbm wheels doc fix (#4455) · 429ddf12
  Olga Andreeva authored Nov 18, 2025
```
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
```
  429ddf12
18 Nov, 2025 7 commits

feat: Support toolcall parser for DeepSeek V3 and R1 (#4253) · 164b0c29

tangcy98 authored Nov 19, 2025


Signed-off-by: zhangzhang <tangchenyu@xiaohongshu.com>
Co-authored-by: zhangzhang <tangchenyu@xiaohongshu.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>

164b0c29

fix: guard KV-indexer against self-referential blocks (#4395) · 4f2cbec0

Vladislav Nosivskoy authored Nov 19, 2025


Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>

4f2cbec0

feat: support prompt_tokens_details in usage (#4239) · be9d6b2b
Vladislav Nosivskoy authored Nov 19, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
```
be9d6b2b

fix: Set annotated_usage.event to None in the final usage chunk response (#3729) · 33d9ae78

Shuaiyi Zhang authored Nov 19, 2025


Signed-off-by: Shuaiyi Zhang <zhangsy28@lenovo.com>
Co-authored-by: Shuaiyi Zhang <zhangsy28@lenovo.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

33d9ae78

fix(storage): File store shouldn't notify on metdata changes (#4434) · 2f1778c1
Graham King authored Nov 18, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
2f1778c1
feat: nixl_connect: Change the way `bytes` are passed to NIXL (#4314) · 08146531
J Wyman authored Nov 18, 2025
```
Signed-off-by: J Wyman <jwyman@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
08146531

feat: mocker can use planner profile data (#4422) · fc2ad4eb

Yan Ru Pei authored Nov 18, 2025


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

fc2ad4eb