Commits · 684107c461bbe1307fca302f6baf8b3bea2e057d · OpenDAS / dynamo

19 Nov, 2025 2 commits
- feat: generate deterministic lora id from lora name (#4457) · 684107c4
  Biswa Panda authored Nov 18, 2025
  
  684107c4
- feat: Request Cancellation when transitioning from Prefill to Decode at KV Prefill Router (#4449) · 04486c1d
  Jacky authored Nov 18, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  04486c1d
18 Nov, 2025 6 commits

feat: Support toolcall parser for DeepSeek V3 and R1 (#4253) · 164b0c29

tangcy98 authored Nov 19, 2025


Signed-off-by: zhangzhang <tangchenyu@xiaohongshu.com>
Co-authored-by: zhangzhang <tangchenyu@xiaohongshu.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>

164b0c29

fix: guard KV-indexer against self-referential blocks (#4395) · 4f2cbec0

Vladislav Nosivskoy authored Nov 19, 2025


Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>

4f2cbec0

feat: support prompt_tokens_details in usage (#4239) · be9d6b2b
Vladislav Nosivskoy authored Nov 19, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
```
be9d6b2b

fix: Set annotated_usage.event to None in the final usage chunk response (#3729) · 33d9ae78

Shuaiyi Zhang authored Nov 19, 2025


Signed-off-by: Shuaiyi Zhang <zhangsy28@lenovo.com>
Co-authored-by: Shuaiyi Zhang <zhangsy28@lenovo.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

33d9ae78

feat: mocker can use planner profile data (#4422) · fc2ad4eb

Yan Ru Pei authored Nov 18, 2025


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

fc2ad4eb

fix: Move trtllm multimodal worker to use ModelInput.Token (#4373) · c3984bc2
Indrajit Bhosale authored Nov 17, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
c3984bc2

17 Nov, 2025 2 commits
- refactor: centralize environment variable constants (#4083) · 0e77d344
  Keiven C authored Nov 17, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  0e77d344
- feat: Command line flag to set request plane mode: tcp, http or nats (#4365) · 886506c1
  Graham King authored Nov 17, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  886506c1
14 Nov, 2025 2 commits
- fix(router): change prune channel to be mpsc instead of watch, increase max size (#4351) · 2cf427ed
  Waël Boukhobza authored Nov 14, 2025
```
Signed-off-by: Wael Boukhobza <wawa_wael@live.fr>
```
  2cf427ed
- chore: use hyphens for Router-related keys (#4325) · 065296c3
  Yan Ru Pei authored Nov 14, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  065296c3
13 Nov, 2025 5 commits
- chore: better error handling in prefill router (#4286) · ce833983
  Yan Ru Pei authored Nov 13, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ce833983
- feat: transport agnostic request plane for dynamo - natless (#4246) · 06b0ebef
  Biswa Panda authored Nov 13, 2025
  
  06b0ebef
- feat: kv router should route to available instances (#4225) · 8379b0cd
  Yan Ru Pei authored Nov 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  8379b0cd
- chore: enlarge default KVBM leader-worker timeout and better wording (#4283) · 3fa8448b
  Ziqi Fan authored Nov 12, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  3fa8448b
- chore: router slot manager should not panic (#4267) · 1f44fca7
  Yan Ru Pei authored Nov 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1f44fca7
12 Nov, 2025 4 commits
- chore: make Router non-reliant on etcd (#4244) · 4d86f347
  Yan Ru Pei authored Nov 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  4d86f347
- feat: tie break on tree size when routing (#4257) · 7d604dd3
  Yan Ru Pei authored Nov 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7d604dd3
- feat: KVBM V2 transfer (#4068) · 827b8c3e
  jthomson04 authored Nov 12, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  827b8c3e
- feat(router): max tree size based pruning (#4057) · 3ea22fcf
  Waël Boukhobza authored Nov 12, 2025
```
Signed-off-by: Wael Boukhobza <wawa_wael@live.fr>
```
  3ea22fcf
11 Nov, 2025 2 commits
- chore: Remove static mode (#4235) · e1af3af6
  Graham King authored Nov 11, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  e1af3af6
- feat: Add output token counter to frontend metrics (#4202) · 8f868986
  Aryan Bagade authored Nov 10, 2025
```
Signed-off-by: Aryan Bagade <aryan@aryanbagade.com>
```
  8f868986
10 Nov, 2025 3 commits
- refactor: consolidate Observability files (e.g. OTEL docker-compose, md files) (#4173) · afccc9d4
  Keiven C authored Nov 10, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  afccc9d4
- chore: Improve prefill router error reporting and fix typo (#4220) · 3577b5c1
  Neelay Shah authored Nov 10, 2025
```
Co-authored-by: Claude <noreply@anthropic.com>
```
  3577b5c1
- refactor: Make the Runtime and DistributedRuntime fields private (#4193) · cf630bf7
  Graham King authored Nov 10, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  cf630bf7
08 Nov, 2025 5 commits
- fix: refactor to use service discovery (#4092) · 09b26bf6
  mohammedabdulwahhab authored Nov 08, 2025
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  09b26bf6
- fix: no more multiple finish reasons in stream (#4154) · 04f7579b
  Ayush Agarwal authored Nov 07, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  04f7579b
- fix: deserialize tool call args (#4176) · 51c4fe63
  ryan-lempka authored Nov 07, 2025
```
Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
```
  51c4fe63
- feat: Add support for skip_special_tokens parameter in v1/completions and... · 441473c3
  Ryan McCormick authored Nov 07, 2025
```
feat: Add support for skip_special_tokens parameter in v1/completions and v1/chat/completions endpoints (#4175)
```
  441473c3
- feat: Media decoder and fetcher options in the MDC (#4094) · 14af074e
  milesial authored Nov 07, 2025
```
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
```
  14af074e
07 Nov, 2025 4 commits
- feat: enable HTTP completion endpoint to accept arrays of prompts and generate... · 93ada899
  zhongdaor-nv authored Nov 07, 2025
```
feat: enable HTTP completion endpoint to accept arrays of prompts and generate multiple completions per prompt (#3953)
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
```
  93ada899
- feat(keyvalue): Filesystem backed KeyValueStore (#4138) · 794c0a44
  Graham King authored Nov 07, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  794c0a44
- fix: multi-turn bug in should_add_generation_prompt (#4168) · 3fd0ab3d
  ryan-lempka authored Nov 07, 2025
  
  3fd0ab3d
- fix: Don't trim whitespace from end of each chat completion delta in aggregator (#4152) · f5094935
  Ryan McCormick authored Nov 06, 2025
  
  f5094935
06 Nov, 2025 4 commits
- fix: Remove disagg_router.rs as it was already deleted on main (#4147) · eedfc3d4
  Jacky authored Nov 06, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  eedfc3d4
- fix: Remove constant gpt-2 token_id upper bound check (#3760) · 6336eea4
  Nathan Barry authored Nov 05, 2025
```
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  6336eea4
- feat: Reject unsupported parameters with 400 Bad Request (`/v1/completions`) (#4140) · 3d036fc4
  KrishnanPrash authored Nov 05, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  3d036fc4
- feat: ETCD high availability client failover - lease watch resilience (#3950) · 6e2b22ea
  Jacky authored Nov 05, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  6e2b22ea
05 Nov, 2025 1 commit
- feat: remove distributed locks dependency from Router (#4113) · 1ab2fe1b
  Yan Ru Pei authored Nov 05, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1ab2fe1b