Commits · e24b25f8448067c7ea0fc07e31d2a9e368f04733 · OpenDAS / dynamo

07 Apr, 2026 1 commit
- feat: Request Rejection Frontend metrics (#7644) · 3205e7db
  Jacky authored Apr 06, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  3205e7db
03 Apr, 2026 2 commits
- fix: reuse elapsed duration in InflightGuard::Drop [DIS-1643] (#7869) · 63915ef5
  Neelay Shah authored Apr 03, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  63915ef5
- feat: request lifecycle logging + metrics capture [DIS-1643] (#7840) · 679d9f14
  Neelay Shah authored Apr 02, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  679d9f14
02 Apr, 2026 2 commits
- refactor: unify on_response, rename request_id fields, deprecate x-dynamo-request-id (#7834) · c376655f
  Neelay Shah authored Apr 02, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  c376655f
- feat: trace infrastructure — spans + request ID propagation [DIS-1643] (#7733) · 13058cbd
  Neelay Shah authored Apr 02, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  13058cbd
01 Apr, 2026 2 commits
- refactor(2/3): rename dynamo-async-openai to dynamo-protocols (#7565) · b6a3b0c6
  ishandhanani authored Apr 01, 2026
  
  b6a3b0c6
- feat: unified internal request representation for lossless API conversion (#7202) · 3bfee568
  MatejKosec authored Apr 01, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
Signed-off-by: Marko Kosec <mkosec@nvidia.com>
```
  3bfee568
31 Mar, 2026 1 commit
- feat: add initial audio/TTS pipeline support for vLLM-omni backend (#7495) · cbbde3d0
  Zhongdongming Dai authored Mar 31, 2026
```
Signed-off-by: Zhongdongming Dai <zhongdongmin@nvidia.com>
```
  cbbde3d0
30 Mar, 2026 2 commits
- fix: Anthropic streaming double-parsing + reasoning_content roundtrip (#7358) · f0d3ce63
  MatejKosec authored Mar 30, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  f0d3ce63
- refactor(1/3): move `nvext` to `dynamo-llm` and move `anthropic` to `dynamo-async-openai` (#7564) · 2887cd1c
  ishandhanani authored Mar 30, 2026
  
  2887cd1c
23 Mar, 2026 2 commits
- feat: Frontend and Runtime Request Cancellation Metrics (#7493) · e252f82d
  Jacky authored Mar 23, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  e252f82d
- feat(perf): add pipeline instrumentation and feature gated NVTX markers (#6746) · 82794761
  Biswa Panda authored Mar 23, 2026
  
  82794761
11 Mar, 2026 2 commits
- feat: streaming tool call and reasoning dispatch SSE events (#7114) · 5178a4a4
  MatejKosec authored Mar 11, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  5178a4a4
- feat(anthropic): add thinking block support and preamble stripping to /v1/messages (#7137) · 012236ee
  MatejKosec authored Mar 10, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  012236ee
06 Mar, 2026 2 commits

fix(responses): accept assistant output_text messages without id/status in input (#6599) · 9b2b44e3

MatejKosec authored Mar 06, 2026


Signed-off-by: Marko Kosec <mkosec@nvidia.com>
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
Signed-off-by: Vasilis Vagias <vvagias@nvidia.com>
Co-authored-by: vvagias <vasilis.n.vagias@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

9b2b44e3

fix: reject prompts exceeding max_seq_len with HTTP 400 (#6635) · 124ecd98

Yuewei Na authored Mar 05, 2026


Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>

124ecd98

03 Mar, 2026 1 commit
- feat(kv-router): add router queue depth Prometheus metric and nvext field (#6786) · 073fb437
  Yan Ru Pei authored Mar 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  073fb437
25 Feb, 2026 2 commits

fix: guarantee RouterRequestMetrics availability & documentation updates (#6558) · ff06b17e

Keiven C authored Feb 25, 2026


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>

ff06b17e

feat: MJPEG video streaming via /v1/videos/stream (experimental) (#6487) · 44d43d0c

John Pohl authored Feb 25, 2026

Signed-off-by: Ryan McCormick <mccormick.codes@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

44d43d0c

24 Feb, 2026 3 commits

feat: router metrics with dynamo_router_* {worker_id=...}. Update docs (#6227) · 1df620b4

Keiven C authored Feb 24, 2026


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>

1df620b4

feat: add error_type label to reqs metric for fine-grained error classification (#5568) · 432fae67

Vladislav Nosivskoy authored Feb 24, 2026


Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>

432fae67

feat: Standardized Dynamo Error Type (#6303) · c8276cd2
Jacky authored Feb 23, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
c8276cd2

23 Feb, 2026 1 commit
- feat(runtime): add hierarchical Model/WorkerSet architecture for multi-namespace support (#6054) · cb55766c
  Thomas Montfort authored Feb 23, 2026
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
```
  cb55766c
18 Feb, 2026 4 commits
- chore: standardizes Rust-side Dynamo environment variable names (#6358) · 56379dd5
  jh-nv authored Feb 18, 2026
  
  56379dd5
- fix: Remove http temp cancel token, use real one (#6344) · 9a93eb75
  Graham King authored Feb 18, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  9a93eb75
- chore: multimodal endpoint registration via cli modality (#6270) · 2ace5a4a
  Ayush Agarwal authored Feb 17, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  2ace5a4a
- feat: add Anthropic Messages API endpoint (/v1/messages) (#6231) · b6603d90
  ishandhanani authored Feb 18, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
Signed-off-by: Marko Kosec <mkosec@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Matej Kosec <mkosec@nvidia.com>
```
  b6603d90
13 Feb, 2026 2 commits
- fix: consolidate dyn_discovery_backend and dyn_kv_store (#6167) · a289695c
  mohammedabdulwahhab authored Feb 13, 2026
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  a289695c
- feat: add video generation support (T2V) (#5793) · 2be83be2
  ishandhanani authored Feb 13, 2026
  
  2be83be2
12 Feb, 2026 1 commit
- feat: responses API compliance with upstream type alignment (#6089) · 8cb47d04
  MatejKosec authored Feb 11, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
```
  8cb47d04
11 Feb, 2026 2 commits
- feat: Metric for detokenization latency (#6160) · adaf1a39
  Graham King authored Feb 11, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  adaf1a39
- feat: add router-level Prometheus metrics and centralize request tracking (#6146) · f46720c9
  Yan Ru Pei authored Feb 10, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
```
  f46720c9
10 Feb, 2026 1 commit
- feat: Add metric tokenizer_latency_ms (#6092) · f1bcb175
  Graham King authored Feb 10, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  f1bcb175
05 Feb, 2026 1 commit

chore: remove unused NIM specific code (part 2) (#5893) · cb7ebdd7

Keiven C authored Feb 05, 2026


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

cb7ebdd7

04 Feb, 2026 1 commit
- feat: Add per-worker Prometheus metrics for router load monitoring (#5842) · 0c0336e6
  Hongkuan Zhou authored Feb 04, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  0c0336e6
03 Feb, 2026 2 commits
- feat: image diffusion with SGLang diffusion (#5609) · 7e970d44
  Konrad Nowicki authored Feb 03, 2026
```
Signed-off-by: Konrad Nowicki <knowicki@nvidia.com>
Co-authored-by: dagil-nvidia <dagil@nvidia.com>
```
  7e970d44
- feat: prefill tokens threshold based on max num batched tokens frac (#5867) · a337113a
  Yan Ru Pei authored Feb 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  a337113a
22 Jan, 2026 1 commit
- feat: Support the reading of routing hints from the headers (#5502) · cb352d95
  atchernych authored Jan 22, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  cb352d95
11 Jan, 2026 1 commit
- fix: get_body_limit() body limit size for response middleware. (#5268) · c94d097a
  Michael Feil authored Jan 11, 2026
```
Signed-off-by: michaelfeil <me@michaelfeil.eu>
```
  c94d097a
05 Jan, 2026 1 commit

fix: record cached_tokens metric for non-streaming requests (#5193) · e7918716

Keiven C authored Jan 05, 2026


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

e7918716