Commits · 9b2b44e39d270a623bf4ab4b8e672de4017b2a87 · OpenDAS / dynamo

06 Mar, 2026 1 commit

fix(responses): accept assistant output_text messages without id/status in input (#6599) · 9b2b44e3

MatejKosec authored Mar 06, 2026


Signed-off-by: Marko Kosec <mkosec@nvidia.com>
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
Signed-off-by: Vasilis Vagias <vvagias@nvidia.com>
Co-authored-by: vvagias <vasilis.n.vagias@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

9b2b44e3

05 Mar, 2026 1 commit
- fix(llm): preserve reasoning content when tool-call starts mid-chunk (#6902) · 57e6a79f
  Graham King authored Mar 05, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  57e6a79f
03 Mar, 2026 1 commit
- feat: upgrade rust to v1.93.0 (#6802) · 57bdbdf1
  Ryan Olson authored Mar 03, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  57bdbdf1
02 Mar, 2026 1 commit

feat: Full Anthropic Messages API cache_control support (top-level, per-block,... · 4d3e1ae3

MatejKosec authored Mar 02, 2026


feat: Full Anthropic Messages API cache_control support (top-level, per-block, system block arrays) (#6629)
Signed-off-by: Matej Kosec <mkosec@nvidia.com>

4d3e1ae3

27 Feb, 2026 1 commit
- feat: wire nvext.cache_control TTL-based pinning through Dynamo router (#6213) · f1d5c95a
  ishandhanani authored Feb 26, 2026
```
Co-authored-by: Claude <noreply@anthropic.com>
```
  f1d5c95a
26 Feb, 2026 1 commit
- feat: enable returning routed experts info up through sglang (#6137) · 4960dbb3
  William Arnold authored Feb 25, 2026
```
Signed-off-by: William Arnold <7565007+Aphoh@users.noreply.github.com>
```
  4960dbb3
24 Feb, 2026 1 commit
- feat: Standardized Dynamo Error Type (#6303) · c8276cd2
  Jacky authored Feb 23, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  c8276cd2
18 Feb, 2026 2 commits
- feat: add MiniMax-M2 reasoning parser and fix tool call parsing (#6294) · 8245633a
  ishandhanani authored Feb 18, 2026
```
Co-authored-by: Claude <noreply@anthropic.com>
```
  8245633a
- feat: plumb request priority through sglang and vllm handlers (#6348) · ee0218b5
  Yan Ru Pei authored Feb 17, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
```
  ee0218b5
15 Feb, 2026 1 commit

feat: speculative prefill (#6230) · 4ede59a2

Yan Ru Pei authored Feb 15, 2026


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Janelle Cai <jcai18@mit.edu>

4ede59a2

14 Feb, 2026 1 commit
- fix: tool call validation and stop words. (#5504) · 0e55e821
  Michael Feil authored Feb 13, 2026
```
Signed-off-by: Michael Feil <63565275+michaelfeil@users.noreply.github.com>
```
  0e55e821
13 Feb, 2026 3 commits
- feat: add video generation support (T2V) (#5793) · 2be83be2
  ishandhanani authored Feb 13, 2026
  
  2be83be2
- feat: Decomposed pipeline for EPP integration [DEP-730] (#5446) · 52271760
  atchernych authored Feb 12, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  52271760
- feat: router priority queue (#6010) · bc514fbe
  Yan Ru Pei authored Feb 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
```
  bc514fbe
12 Feb, 2026 1 commit
- feat: responses API compliance with upstream type alignment (#6089) · 8cb47d04
  MatejKosec authored Feb 11, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
```
  8cb47d04
11 Feb, 2026 1 commit
- feat: add router-level Prometheus metrics and centralize request tracking (#6146) · f46720c9
  Yan Ru Pei authored Feb 10, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
```
  f46720c9
09 Feb, 2026 1 commit
- feat: text to image vLLM Omni (#5912) · 9f76d060
  Ayush Agarwal authored Feb 09, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  9f76d060
05 Feb, 2026 1 commit

chore: remove unused NIM specific code (part 2) (#5893) · cb7ebdd7

Keiven C authored Feb 05, 2026


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

cb7ebdd7

04 Feb, 2026 1 commit
- feat: Add per-worker Prometheus metrics for router load monitoring (#5842) · 0c0336e6
  Hongkuan Zhou authored Feb 04, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  0c0336e6
03 Feb, 2026 1 commit

feat: image diffusion with SGLang diffusion (#5609) · 7e970d44

Konrad Nowicki authored Feb 03, 2026


Signed-off-by: Konrad Nowicki <knowicki@nvidia.com>
Co-authored-by: dagil-nvidia <dagil@nvidia.com>

7e970d44

26 Jan, 2026 1 commit
- feat: handle PrefillComplete in the Dynamo EPP Scorer Plugin [DEP-728] (#5592) · 2a2e63a0
  atchernych authored Jan 26, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  2a2e63a0
22 Jan, 2026 1 commit
- feat: Support the reading of routing hints from the headers (#5502) · cb352d95
  atchernych authored Jan 22, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  cb352d95
08 Jan, 2026 1 commit
- feat(vllm): Add prompt embeds support for pre-computed inference inputs (#4739) · 6f9619a2
  Wenqi Glantz authored Jan 08, 2026
```
Signed-off-by: Wenqi Glantz <wglantz@nvidia.com>
```
  6f9619a2
07 Jan, 2026 1 commit
- feat: Adding support for `response_format` field (#5127) · e994caeb
  KrishnanPrash authored Jan 07, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  e994caeb
06 Jan, 2026 1 commit
- feat: expected output tokens plumbing (#5181) · d9cc6f6b
  Yan Ru Pei authored Jan 05, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d9cc6f6b
03 Jan, 2026 2 commits
- feat: add continuous_usage_stats option for per-chunk usage (#5139) · 6bfb41de
  GuanLuo authored Jan 03, 2026
```
Signed-off-by: Guan Luo <gluo@nvidia.com>
```
  6bfb41de
- feat: mockers with bootstrap optimization (sglang testing) + CI test (#5121) · 0980b27f
  Yan Ru Pei authored Jan 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  0980b27f
02 Jan, 2026 1 commit
- chore: update all copyright headers in repo to 2026 (#5130) · cf433e68
  Tushar Sharma authored Jan 02, 2026
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  cf433e68
31 Dec, 2025 1 commit
- fix: add chat_template_kwargs alias for compatibility (#5112) · cceeb8e3
  Neelay Shah authored Dec 30, 2025
```
Co-authored-by: Claude <noreply@anthropic.com>
```
  cceeb8e3
22 Dec, 2025 1 commit
- feat: add auto-generated frontend OpenAPI spec and helper binary (#4802) · f63e273c
  smatta-star authored Dec 22, 2025
```
Signed-off-by: Satvik Matta <smatta@nvidia.com>
```
  f63e273c
19 Dec, 2025 1 commit
- feat: Runtime media decoder config (#5011) · d2faf0e6
  milesial authored Dec 18, 2025
```
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
```
  d2faf0e6
18 Dec, 2025 2 commits
- feat: unify per-request metric tracking (#5004) · 85b5c808
  Yan Ru Pei authored Dec 18, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  85b5c808
- feat: support disag serving in GAIE [DEP-659] (#4756) · 15b49818
  atchernych authored Dec 18, 2025
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  15b49818
17 Dec, 2025 1 commit
- feat: Pass tool definitions to parsers (#4948) · ff7aea54
  William Zhang authored Dec 16, 2025
```
Signed-off-by: William Zhang <133824995+2ez4bz@users.noreply.github.com>
```
  ff7aea54
13 Dec, 2025 1 commit
- feat: Support for field include_stop_str_in_output (#4924) · 45e881d3
  KrishnanPrash authored Dec 12, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  45e881d3
11 Dec, 2025 2 commits

feat: add cached tokens prometheus metric (#4534) · f8bb53c0

Vladislav Nosivskoy authored Dec 11, 2025


Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

f8bb53c0

feat: include ttft and total request time in nvext (engine-agnostic) (#4880) · 2845aa1f

Yan Ru Pei authored Dec 10, 2025


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Keiven C <213854356+keivenchang@users.noreply.github.com>

2845aa1f

09 Dec, 2025 3 commits
- chore: cleanups of passing around prefill and decode worker ids (#4829) · 1e5b20b2
  Yan Ru Pei authored Dec 09, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1e5b20b2
- feat: add tool_choice support (#4722) · 5585f803
  Vladislav Nosivskoy authored Dec 09, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
```
  5585f803
- fix: have frontend populate "stop" field in OpenAI request (#4782) · e6de33f8
  Page authored Dec 08, 2025
  
  e6de33f8