Commits · b8c4a5f52f64dfa89864ad75a2814de926ced792 · OpenDAS / dynamo

04 Dec, 2025 3 commits
- fix: skip HuggingFace download for non-llms (#4686) · 118323f2
  Neal Vaidya authored Dec 04, 2025
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
```
  118323f2
- fix: parallel tool call indices in streaming (#4723) · 8601ccdb
  Vladislav Nosivskoy authored Dec 04, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
```
  8601ccdb
- chore: no need to arc wrap client (#4741) · 5b24b429
  Yan Ru Pei authored Dec 03, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  5b24b429
03 Dec, 2025 3 commits
- fix: Updates CUDA fatbin for KVBM (#4700) · 991d8c72
  Olga Andreeva authored Dec 03, 2025
```
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
```
  991d8c72
- feat: add Kserve readiness endpoint support: ServerLive / ServerReady / ModelReady (#4708) · d90dc39d
  GuanLuo authored Dec 03, 2025
```
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  d90dc39d
- test: remove redundant mocker e2e test in rust (#4720) · 77841e7b
  Yan Ru Pei authored Dec 03, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  77841e7b
02 Dec, 2025 5 commits

feat: Extend the KV Event Consolidator to support TensorRT-LLM (#4533) · 6067c59d
Kris Hung authored Dec 02, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
6067c59d

fix: ModelDeploymentCard obtains full set of eos_token_ids by taking union... · 4ace4c85

GuanLuo authored Dec 02, 2025

fix: ModelDeploymentCard obtains full set of eos_token_ids by taking union from different files (#3192)
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>

4ace4c85

refactor: New config types for tool calls (#4575) · 44e8600a

William Zhang authored Dec 02, 2025

* Why?

We would like the ability to configure different parser types. Prior to
this commit, only the JSON parser could be configured.

* What?

This commit refactors the tool parser config in the following ways:
- the `format` and `json` fields of `ToolParserConfig` are merged into
  a single `config` field that is a "discriminated union" type. Each
  parser type can declare its own configuration options.
- a `XmlParserConfig` is defined with a default factory method that
  corresponds to the Qwen3 coder configuration.
- affected calls and tests are adjusted.

44e8600a

feat: lora - centralize lora cache key, restructure folders, s3 resiliency (#4644) · 71f94eda
Biswa Panda authored Dec 02, 2025

71f94eda
feat: dynamic setting of thresholds for rejection (#4673) · 4c1bc4ee
Yan Ru Pei authored Dec 02, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
4c1bc4ee

01 Dec, 2025 1 commit
- fix: Page-align O_DIRECT writes for Lustre compatibility (#4508) · 5d9fc858
  Olga Andreeva authored Dec 01, 2025
```
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
```
  5d9fc858
26 Nov, 2025 2 commits
- fix: allow router to be registered as general transport type (#4633) · ea9d00e7
  Yan Ru Pei authored Nov 26, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ea9d00e7
- feat: add LoRA common APIs and implementation for lora management (#4464) · 6a0e67ed
  Biswa Panda authored Nov 26, 2025
  
  6a0e67ed
25 Nov, 2025 6 commits
- refactor(storage): Remove the stuttering from key_value_store. (#4604) · fcb91e4b
  Graham King authored Nov 25, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  fcb91e4b
- chore: make router use the discovery pattern instead of manual kv watch (#4597) · 9c5018e5
  Yan Ru Pei authored Nov 25, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  9c5018e5
- feat: decoded media via NIXL (#3988) · 0a065918
  milesial authored Nov 25, 2025
```
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
Signed-off-by: Ayush Agarwal <ayushag@nvidia.com>
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
Co-authored-by: Krishnan Prashanth <kprashanth@nvidia.com>
Co-authored-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
```
  0a065918
- refactor(llm): Rename EngineConfig::Static to InProcess (#4585) · 0fc5273c
  Graham King authored Nov 25, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  0fc5273c
- chore(runtime): Tidy up component paths (#4560) · 51c1b9f1
  Graham King authored Nov 25, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  51c1b9f1
- fix: expose prefill worker id in disagg (#4563) · 57c701fb
  Yan Ru Pei authored Nov 24, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  57c701fb
21 Nov, 2025 5 commits
- chore: Make nats_client private at crate level, various tidy up (#4513) · f05f7629
  Graham King authored Nov 21, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  f05f7629
- fix(storage): Correctly encoding FileStore keys (#4539) · 27904535
  Graham King authored Nov 21, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  27904535
- chore: merge KvIndexer and ApproxKvIndexer (#4500) · c61e0dd3
  Yan Ru Pei authored Nov 21, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c61e0dd3
- fix: worker_id updates not applied (#4518) · 989e246e
  Zhongxuan (Daniel) Wang authored Nov 21, 2025
```
Signed-off-by: Zhongxuan (Daniel) Wang <daniewang@nvidia.com>
```
  989e246e
- fix: missing tool calling usage (#4516) · 179ee38b
  Ayush Agarwal authored Nov 20, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  179ee38b
20 Nov, 2025 5 commits
- fix: Support for msg[content] as a list (#4485) · 6767559f
  KrishnanPrash authored Nov 20, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  6767559f
- chore: Use general engine source for KVBM KV events (#4515) · 2f18b23e
  Kris Hung authored Nov 20, 2025
  
  2f18b23e
- feat: Add metrics endpoint to kserve gRPC service (#4400) · 5fe0476e
  Tanmay Verma authored Nov 20, 2025
  
  5fe0476e
- chore: better error handling in Router slot manager (#4496) · c0c664a9
  Yan Ru Pei authored Nov 19, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c0c664a9
- feat: Report KVBM cache hit rate (#4333) · b2605a8e
  Kris Hung authored Nov 19, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  b2605a8e
19 Nov, 2025 5 commits
- fix: support multimodal models with non-standard Jinja2 tags (#4379) · f395b641
  Keiven C authored Nov 19, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f395b641
- feat: unregister discovery instance (#4459) · 781331c6
  Biswa Panda authored Nov 19, 2025
  
  781331c6
- feat: nvext field to OpenAI APIs and add worker_id reporting (vLLM) (#4372) · 263f99dc
  Zhongxuan (Daniel) Wang authored Nov 18, 2025
```
Signed-off-by: Zhongxuan Wang <daniewang@nvidia.com>
```
  263f99dc
- feat: generate deterministic lora id from lora name (#4457) · 684107c4
  Biswa Panda authored Nov 18, 2025
  
  684107c4
- feat: Request Cancellation when transitioning from Prefill to Decode at KV Prefill Router (#4449) · 04486c1d
  Jacky authored Nov 18, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  04486c1d
18 Nov, 2025 5 commits

fix: guard KV-indexer against self-referential blocks (#4395) · 4f2cbec0

Vladislav Nosivskoy authored Nov 19, 2025


Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>

4f2cbec0

feat: support prompt_tokens_details in usage (#4239) · be9d6b2b
Vladislav Nosivskoy authored Nov 19, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
```
be9d6b2b

fix: Set annotated_usage.event to None in the final usage chunk response (#3729) · 33d9ae78

Shuaiyi Zhang authored Nov 19, 2025


Signed-off-by: Shuaiyi Zhang <zhangsy28@lenovo.com>
Co-authored-by: Shuaiyi Zhang <zhangsy28@lenovo.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

33d9ae78

feat: mocker can use planner profile data (#4422) · fc2ad4eb

Yan Ru Pei authored Nov 18, 2025


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

fc2ad4eb

fix: Move trtllm multimodal worker to use ModelInput.Token (#4373) · c3984bc2
Indrajit Bhosale authored Nov 17, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
c3984bc2