Commits · 1df620b4d0121970c5b85ee91fa34c0bb89a9aae · OpenDAS / dynamo

"components/vscode:/vscode.git/clone" did not exist on "fe718fd29545dfdaf971c73ffafe3ccb06a25899"

24 Feb, 2026 3 commits

feat: router metrics with dynamo_router_* {worker_id=...}. Update docs (#6227) · 1df620b4

Keiven C authored Feb 24, 2026


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>

1df620b4

feat: add error_type label to reqs metric for fine-grained error classification (#5568) · 432fae67

Vladislav Nosivskoy authored Feb 24, 2026


Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>

432fae67

feat: Standardized Dynamo Error Type (#6303) · c8276cd2
Jacky authored Feb 23, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
c8276cd2

23 Feb, 2026 1 commit
- feat(runtime): add hierarchical Model/WorkerSet architecture for multi-namespace support (#6054) · cb55766c
  Thomas Montfort authored Feb 23, 2026
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
```
  cb55766c
18 Feb, 2026 4 commits
- chore: standardizes Rust-side Dynamo environment variable names (#6358) · 56379dd5
  jh-nv authored Feb 18, 2026
  
  56379dd5
- fix: Remove http temp cancel token, use real one (#6344) · 9a93eb75
  Graham King authored Feb 18, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  9a93eb75
- chore: multimodal endpoint registration via cli modality (#6270) · 2ace5a4a
  Ayush Agarwal authored Feb 17, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  2ace5a4a
- feat: add Anthropic Messages API endpoint (/v1/messages) (#6231) · b6603d90
  ishandhanani authored Feb 18, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
Signed-off-by: Marko Kosec <mkosec@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Matej Kosec <mkosec@nvidia.com>
```
  b6603d90
13 Feb, 2026 2 commits
- fix: consolidate dyn_discovery_backend and dyn_kv_store (#6167) · a289695c
  mohammedabdulwahhab authored Feb 13, 2026
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  a289695c
- feat: add video generation support (T2V) (#5793) · 2be83be2
  ishandhanani authored Feb 13, 2026
  
  2be83be2
12 Feb, 2026 1 commit
- feat: responses API compliance with upstream type alignment (#6089) · 8cb47d04
  MatejKosec authored Feb 11, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
```
  8cb47d04
11 Feb, 2026 2 commits
- feat: Metric for detokenization latency (#6160) · adaf1a39
  Graham King authored Feb 11, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  adaf1a39
- feat: add router-level Prometheus metrics and centralize request tracking (#6146) · f46720c9
  Yan Ru Pei authored Feb 10, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
```
  f46720c9
10 Feb, 2026 1 commit
- feat: Add metric tokenizer_latency_ms (#6092) · f1bcb175
  Graham King authored Feb 10, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  f1bcb175
05 Feb, 2026 1 commit

chore: remove unused NIM specific code (part 2) (#5893) · cb7ebdd7

Keiven C authored Feb 05, 2026


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

cb7ebdd7

04 Feb, 2026 1 commit
- feat: Add per-worker Prometheus metrics for router load monitoring (#5842) · 0c0336e6
  Hongkuan Zhou authored Feb 04, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  0c0336e6
03 Feb, 2026 2 commits
- feat: image diffusion with SGLang diffusion (#5609) · 7e970d44
  Konrad Nowicki authored Feb 03, 2026
```
Signed-off-by: Konrad Nowicki <knowicki@nvidia.com>
Co-authored-by: dagil-nvidia <dagil@nvidia.com>
```
  7e970d44
- feat: prefill tokens threshold based on max num batched tokens frac (#5867) · a337113a
  Yan Ru Pei authored Feb 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  a337113a
22 Jan, 2026 1 commit
- feat: Support the reading of routing hints from the headers (#5502) · cb352d95
  atchernych authored Jan 22, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  cb352d95
11 Jan, 2026 1 commit
- fix: get_body_limit() body limit size for response middleware. (#5268) · c94d097a
  Michael Feil authored Jan 11, 2026
```
Signed-off-by: michaelfeil <me@michaelfeil.eu>
```
  c94d097a
05 Jan, 2026 1 commit

fix: record cached_tokens metric for non-streaming requests (#5193) · e7918716

Keiven C authored Jan 05, 2026


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

e7918716

02 Jan, 2026 1 commit
- chore: update all copyright headers in repo to 2026 (#5130) · cf433e68
  Tushar Sharma authored Jan 02, 2026
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  cf433e68
31 Dec, 2025 1 commit
- fix: add chat_template_kwargs alias for compatibility (#5112) · cceeb8e3
  Neelay Shah authored Dec 30, 2025
```
Co-authored-by: Claude <noreply@anthropic.com>
```
  cceeb8e3
22 Dec, 2025 1 commit
- feat: add auto-generated frontend OpenAPI spec and helper binary (#4802) · f63e273c
  smatta-star authored Dec 22, 2025
```
Signed-off-by: Satvik Matta <smatta@nvidia.com>
```
  f63e273c
19 Dec, 2025 2 commits
- feat: Request Migration Metrics (#5029) · e6a6a1f2
  Jacky authored Dec 19, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  e6a6a1f2
- feat: Runtime media decoder config (#5011) · d2faf0e6
  milesial authored Dec 18, 2025
```
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
```
  d2faf0e6
18 Dec, 2025 1 commit
- chore: add frontend per-request logging via on_response callback (#4965) · aaed4f3b
  nv-nedelman-1 authored Dec 18, 2025
```
Signed-off-by: Nicholas Edelman <nedelman@nvidia.com>
```
  aaed4f3b
16 Dec, 2025 2 commits
- feat(frontend): Well-known prefix for validation errors (#4984) · 7043707e
  Graham King authored Dec 16, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  7043707e
- feat: graceful exit leading to 500 and connection errors -... · 54dcf3ad
  Michael Feil authored Dec 16, 2025
```
feat: graceful exit leading to 500 and connection errors - liveness-return-false if-cancelled (#4914)
Signed-off-by: michaelfeil <me@michaelfeil.eu>
```
  54dcf3ad
11 Dec, 2025 2 commits
- feat: early rejection based on active prefill tokens (#4837) · 10b01b45
  Yan Ru Pei authored Dec 11, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  10b01b45
- feat: add cached tokens prometheus metric (#4534) · f8bb53c0
  Vladislav Nosivskoy authored Dec 11, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  f8bb53c0
09 Dec, 2025 1 commit
- fix: backend error serialization and add HTTP status code detection (#4786) · 065f466e
  Tzu-Ling Kan authored Dec 09, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  065f466e
02 Dec, 2025 1 commit
- feat: dynamic setting of thresholds for rejection (#4673) · 4c1bc4ee
  Yan Ru Pei authored Dec 02, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  4c1bc4ee
25 Nov, 2025 1 commit
- refactor(storage): Remove the stuttering from key_value_store. (#4604) · fcb91e4b
  Graham King authored Nov 25, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  fcb91e4b
17 Nov, 2025 1 commit

refactor: centralize environment variable constants (#4083) · 0e77d344

Keiven C authored Nov 17, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

0e77d344

11 Nov, 2025 2 commits
- chore: Remove static mode (#4235) · e1af3af6
  Graham King authored Nov 11, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  e1af3af6
- feat: Add output token counter to frontend metrics (#4202) · 8f868986
  Aryan Bagade authored Nov 10, 2025
```
Signed-off-by: Aryan Bagade <aryan@aryanbagade.com>
```
  8f868986
08 Nov, 2025 1 commit
- fix: refactor to use service discovery (#4092) · 09b26bf6
  mohammedabdulwahhab authored Nov 08, 2025
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  09b26bf6
07 Nov, 2025 1 commit

feat: enable HTTP completion endpoint to accept arrays of prompts and generate... · 93ada899

zhongdaor-nv authored Nov 07, 2025


feat: enable HTTP completion endpoint to accept arrays of prompts and generate multiple completions per prompt (#3953)
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>

93ada899

06 Nov, 2025 1 commit
- feat: Reject unsupported parameters with 400 Bad Request (`/v1/completions`) (#4140) · 3d036fc4
  KrishnanPrash authored Nov 05, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  3d036fc4