Commits · 9498f016e2675d5cdd76cf846c7b680485fef404 · OpenDAS / dynamo

13 Apr, 2026 1 commit
- feat(sglang): add ephemeral KV session routing (#7665) · 9498f016
  ishandhanani authored Apr 13, 2026
```
Signed-off-by: Ishan Dhanani <ishandhanani@gmail.com>
```
  9498f016
09 Apr, 2026 1 commit
- fix(llm): preserve unresolved dp rank routing (#8000) · b579a772
  Yan Ru Pei authored Apr 09, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b579a772
08 Apr, 2026 2 commits
- fix: tool call loss under speculative decoding (#7768) · f69580b0
  Oleg Zhelezniak authored Apr 08, 2026
```
Signed-off-by: jellysnack <oleg.jellysnack@gmail.com>
```
  f69580b0
- refactor(3/3): switch dynamo-protocols to upstream async-openai types (#7625) · fd5cc288
  ishandhanani authored Apr 08, 2026
```
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  fd5cc288
07 Apr, 2026 2 commits
- feat: add I2I (image-to-image) support for SGLang diffusion backend (#7870) · 225dad4d
  KrishnanPrash authored Apr 07, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  225dad4d
- fix(parsers): parallel XML/JSON tool calls no longer drop N-1 of N calls (#7914) · 91700375
  MatejKosec authored Apr 06, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  91700375
06 Apr, 2026 1 commit

fix(sglang): use incremental streaming output for completions (#7752) · b2cafb7f

weireweire authored Apr 07, 2026


Signed-off-by: Weiliangl User <weiliangl@login-node.hosted.internal>
Co-authored-by: Weiliangl User <weiliangl@login-node.hosted.internal>

b2cafb7f

02 Apr, 2026 3 commits
- feat: enable DP for GAIE (#7741) · 2b906504
  atchernych authored Apr 02, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  2b906504
- fix: tool_choice=required bypasses format-specific parsers (#6821) (#7589) · 07af8dca
  Asad Shahid authored Apr 02, 2026
  
  07af8dca
- refactor(protocols): deprecate cache control (#7790) · c09ac697
  ishandhanani authored Apr 01, 2026
  
  c09ac697
01 Apr, 2026 2 commits
- refactor(2/3): rename dynamo-async-openai to dynamo-protocols (#7565) · b6a3b0c6
  ishandhanani authored Apr 01, 2026
  
  b6a3b0c6
- feat: unified internal request representation for lossless API conversion (#7202) · 3bfee568
  MatejKosec authored Apr 01, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
Signed-off-by: Marko Kosec <mkosec@nvidia.com>
```
  3bfee568
31 Mar, 2026 1 commit
- feat: add initial audio/TTS pipeline support for vLLM-omni backend (#7495) · cbbde3d0
  Zhongdongming Dai authored Mar 31, 2026
```
Signed-off-by: Zhongdongming Dai <zhongdongmin@nvidia.com>
```
  cbbde3d0
30 Mar, 2026 1 commit
- refactor(1/3): move `nvext` to `dynamo-llm` and move `anthropic` to `dynamo-async-openai` (#7564) · 2887cd1c
  ishandhanani authored Mar 30, 2026
  
  2887cd1c
25 Mar, 2026 1 commit
- fix(frontend): carry forward real stream metadata in JailedStream finalization (#7608) · 0adfd98d
  vvagias authored Mar 24, 2026
  
  0adfd98d
20 Mar, 2026 2 commits
- feat(mocker): add offline trace replay mode [DYN-2502] (#7543) · c3908a36
  Yan Ru Pei authored Mar 20, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c3908a36
- feat(llm): unify user-facing priority hints (#7492) · ebd06a1f
  Yan Ru Pei authored Mar 20, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ebd06a1f
13 Mar, 2026 1 commit
- fix: populate logprobs bytes and token fields in OpenAI-compatible responses (#6953) · 947939c7
  Biswa Panda authored Mar 13, 2026
  
  947939c7
12 Mar, 2026 1 commit
- feat: vllm omni image to video support (#6530) · 1182e207
  Ayush Agarwal authored Mar 12, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  1182e207
11 Mar, 2026 1 commit
- feat: streaming tool call and reasoning dispatch SSE events (#7114) · 5178a4a4
  MatejKosec authored Mar 11, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  5178a4a4
06 Mar, 2026 1 commit

fix(responses): accept assistant output_text messages without id/status in input (#6599) · 9b2b44e3

MatejKosec authored Mar 06, 2026


Signed-off-by: Marko Kosec <mkosec@nvidia.com>
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
Signed-off-by: Vasilis Vagias <vvagias@nvidia.com>
Co-authored-by: vvagias <vasilis.n.vagias@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

9b2b44e3

05 Mar, 2026 1 commit
- fix(llm): preserve reasoning content when tool-call starts mid-chunk (#6902) · 57e6a79f
  Graham King authored Mar 05, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  57e6a79f
03 Mar, 2026 1 commit
- feat: upgrade rust to v1.93.0 (#6802) · 57bdbdf1
  Ryan Olson authored Mar 03, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  57bdbdf1
02 Mar, 2026 1 commit

feat: Full Anthropic Messages API cache_control support (top-level, per-block,... · 4d3e1ae3

MatejKosec authored Mar 02, 2026


feat: Full Anthropic Messages API cache_control support (top-level, per-block, system block arrays) (#6629)
Signed-off-by: Matej Kosec <mkosec@nvidia.com>

4d3e1ae3

27 Feb, 2026 1 commit
- feat: wire nvext.cache_control TTL-based pinning through Dynamo router (#6213) · f1d5c95a
  ishandhanani authored Feb 26, 2026
```
Co-authored-by: Claude <noreply@anthropic.com>
```
  f1d5c95a
26 Feb, 2026 1 commit
- feat: enable returning routed experts info up through sglang (#6137) · 4960dbb3
  William Arnold authored Feb 25, 2026
```
Signed-off-by: William Arnold <7565007+Aphoh@users.noreply.github.com>
```
  4960dbb3
24 Feb, 2026 1 commit
- feat: Standardized Dynamo Error Type (#6303) · c8276cd2
  Jacky authored Feb 23, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  c8276cd2
18 Feb, 2026 2 commits
- feat: add MiniMax-M2 reasoning parser and fix tool call parsing (#6294) · 8245633a
  ishandhanani authored Feb 18, 2026
```
Co-authored-by: Claude <noreply@anthropic.com>
```
  8245633a
- feat: plumb request priority through sglang and vllm handlers (#6348) · ee0218b5
  Yan Ru Pei authored Feb 17, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
```
  ee0218b5
15 Feb, 2026 1 commit

feat: speculative prefill (#6230) · 4ede59a2

Yan Ru Pei authored Feb 15, 2026


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Janelle Cai <jcai18@mit.edu>

4ede59a2

14 Feb, 2026 1 commit
- fix: tool call validation and stop words. (#5504) · 0e55e821
  Michael Feil authored Feb 13, 2026
```
Signed-off-by: Michael Feil <63565275+michaelfeil@users.noreply.github.com>
```
  0e55e821
13 Feb, 2026 3 commits
- feat: add video generation support (T2V) (#5793) · 2be83be2
  ishandhanani authored Feb 13, 2026
  
  2be83be2
- feat: Decomposed pipeline for EPP integration [DEP-730] (#5446) · 52271760
  atchernych authored Feb 12, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  52271760
- feat: router priority queue (#6010) · bc514fbe
  Yan Ru Pei authored Feb 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
```
  bc514fbe
12 Feb, 2026 1 commit
- feat: responses API compliance with upstream type alignment (#6089) · 8cb47d04
  MatejKosec authored Feb 11, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
```
  8cb47d04
11 Feb, 2026 1 commit
- feat: add router-level Prometheus metrics and centralize request tracking (#6146) · f46720c9
  Yan Ru Pei authored Feb 10, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
```
  f46720c9
09 Feb, 2026 1 commit
- feat: text to image vLLM Omni (#5912) · 9f76d060
  Ayush Agarwal authored Feb 09, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  9f76d060
05 Feb, 2026 1 commit

chore: remove unused NIM specific code (part 2) (#5893) · cb7ebdd7

Keiven C authored Feb 05, 2026


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

cb7ebdd7

04 Feb, 2026 1 commit
- feat: Add per-worker Prometheus metrics for router load monitoring (#5842) · 0c0336e6
  Hongkuan Zhou authored Feb 04, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  0c0336e6
03 Feb, 2026 1 commit

feat: image diffusion with SGLang diffusion (#5609) · 7e970d44

Konrad Nowicki authored Feb 03, 2026


Signed-off-by: Konrad Nowicki <knowicki@nvidia.com>
Co-authored-by: dagil-nvidia <dagil@nvidia.com>

7e970d44