Commits · cc22114d7825b2be78b2790373bd47582dbae46f · OpenDAS / dynamo

01 Apr, 2026 2 commits

feat: add least-loaded router (#6314) · cc22114d

kornelcsernai-harmonic authored Mar 31, 2026


Signed-off-by: Kornel Csernai <239206175+kornelcsernai-harmonic@users.noreply.github.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>

cc22114d

fix(backend): Reject conflicting model registrations on the same endpoint (#7686) · 21ba0c4b
Graham King authored Mar 31, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
21ba0c4b

31 Mar, 2026 1 commit
- feat: Add standardized Dynamo error types as Python exceptions (#7136) · 8ff0b6e7
  Tanmay Verma authored Mar 31, 2026
  
  8ff0b6e7
27 Mar, 2026 1 commit
- chore(mocker): batch live output signal sends (#7647) · a2154ba5
  Yan Ru Pei authored Mar 26, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  a2154ba5
25 Mar, 2026 1 commit
- feat: add power-of-two-choices router mode (#7614) · db49dfd2
  Aaron Batilo authored Mar 24, 2026
```
Signed-off-by: Aaron Batilo <abatilo@coreweave.com>
```
  db49dfd2
24 Mar, 2026 1 commit

feat(vllm): elastic EP scaling — ray.nodes() patch, scale_elastic_ep route,... · daa4fb04

Tzu-Ling Kan authored Mar 24, 2026


feat(vllm): elastic EP scaling — ray.nodes() patch, scale_elastic_ep route, null-tolerant discovery (#7481)
Signed-off-by: tzulingk <tzulingk@nvidia.com>

daa4fb04

23 Mar, 2026 3 commits
- feat: Frontend and Runtime Request Cancellation Metrics (#7493) · e252f82d
  Jacky authored Mar 23, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  e252f82d
- feat(mocker): add multi-worker replay and router startup fixes (#7553) · b7fe46b1
  Yan Ru Pei authored Mar 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b7fe46b1
- feat(perf): add pipeline instrumentation and feature gated NVTX markers (#6746) · 82794761
  Biswa Panda authored Mar 23, 2026
  
  82794761
17 Mar, 2026 1 commit
- feat: Enable EPP worker discovery mode (#6592) · a441aaf8
  atchernych authored Mar 16, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  a441aaf8
15 Mar, 2026 1 commit
- feat(kv-indexer): add python launcher follow-up [DYN-2459] (#7395) · 56b448a6
  Yan Ru Pei authored Mar 15, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  56b448a6
14 Mar, 2026 1 commit
- feat(perf): add request-plane, transport, and work-handler metric definitions (#6735) · cec19d4d
  Biswa Panda authored Mar 14, 2026
  
  cec19d4d
13 Mar, 2026 2 commits
- feat(kv-router): add Prometheus metrics to standalone indexer (#7339) · 5aa2f53f
  Yan Ru Pei authored Mar 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  5aa2f53f
- feat(kv-router): pluggable scheduling policy for router queue [DYN-2454] (#7260) · bddaaa26
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  bddaaa26
11 Mar, 2026 4 commits
- feat: follow up of optinal, batching-of-client-side-events (#6741) · fca0a801
  Michael Feil authored Mar 11, 2026
```
Signed-off-by: michaelfeil <63565275+michaelfeil@users.noreply.github.com>
Signed-off-by: Michael Feil <michaelfeil@users.noreply.github.com>
Signed-off-by: Michael Feil <63565275+michaelfeil@users.noreply.github.com>
```
  fca0a801
- feat: streaming tool call and reasoning dispatch SSE events (#7114) · 5178a4a4
  MatejKosec authored Mar 11, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  5178a4a4
- fix: Fix mocker+router segfaults + reliability fixes (#7162) · 761e848b
  jthomson04 authored Mar 10, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  761e848b
- feat(anthropic): add thinking block support and preamble stripping to /v1/messages (#7137) · 012236ee
  MatejKosec authored Mar 10, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  012236ee
10 Mar, 2026 5 commits
- chore: set velo crates to initial v0.1.0 (#7156) · 72e849e7
  Ryan Olson authored Mar 10, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
```
  72e849e7
- feat: Add Loki log aggregation, and enable unified OTLP ingestion for both... · 734c0b8b
  jh-nv authored Mar 10, 2026
```
feat: Add Loki log aggregation, and enable unified OTLP ingestion for both traces and logs through a single endpoint (#6974)
```
  734c0b8b
- feat(perf): add frontend pipeline and tokio runtime perf metric definitions (#6731) · 3c44b88e
  Biswa Panda authored Mar 10, 2026
  
  3c44b88e
- chore: Enable "multipart" feature of reqwest (#7084) · 5265787b
  Graham King authored Mar 10, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  5265787b
- fix: resolve HTTP port collisions when multiple workers share a process (#7063) · b407b419
  Biswa Panda authored Mar 09, 2026
  
  b407b419
09 Mar, 2026 1 commit
- feat: velo-backend (#6547) · 63d7c01c
  Ryan Olson authored Mar 09, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  63d7c01c
06 Mar, 2026 4 commits
- feat(trtllm): add additional metrics for dynamo-trtllm (#6668) · 10081929
  Yifan Jiang authored Mar 06, 2026
```
Signed-off-by: Yifan Jiang <19356972+yifjiang@users.noreply.github.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  10081929
- fix: use checked arithmetic in TwoPartCodec to prevent integer overflow (#6959) · 64ae47fd
  Shounak Ray authored Mar 06, 2026
```
Signed-off-by: ShounakRay <shounak@stanford.edu>
```
  64ae47fd
- chore(UX): Log full endpoint name when registering TCP endpoint (#6964) · 2f15f334
  Ryan McCormick authored Mar 06, 2026
  
  2f15f334
- fix: reject prompts exceeding max_seq_len with HTTP 400 (#6635) · 124ecd98
  Yuewei Na authored Mar 05, 2026
```
Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>
```
  124ecd98
05 Mar, 2026 1 commit
- fix: validate initial uptime metric parsing in integration test (#6943) · c24882ff
  Keiven C authored Mar 05, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  c24882ff
03 Mar, 2026 3 commits
- feat: upgrade rust to v1.93.0 (#6802) · 57bdbdf1
  Ryan Olson authored Mar 03, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  57bdbdf1
- feat(kvbm): add testing utilities to kvbm-logical and kvbm-physical (#6691) · 76042959
  Ryan Olson authored Mar 02, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  76042959
- feat(kv-router): add router queue depth Prometheus metric and nvext field (#6786) · 073fb437
  Yan Ru Pei authored Mar 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  073fb437
02 Mar, 2026 1 commit
- chore(style): Log with {var} style in lib/runtime (#6757) · 9e6a84af
  Ryan McCormick authored Mar 02, 2026
  
  9e6a84af
01 Mar, 2026 1 commit
- feat: kvbm-physical (#6490) · 9ab148dc
  Ryan Olson authored Mar 01, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  9ab148dc
26 Feb, 2026 1 commit
- chore: bump versions to 1.0.0 (#6613) · db88c953
  Harrison Saturley-Hall authored Feb 25, 2026
```
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
```
  db88c953
25 Feb, 2026 3 commits
- feat: throughput-metrics-source for SLA planner + GlobalPlanner disagg scaling (#6500) · 651ef5b5
  daiyaanarfeen authored Feb 25, 2026
```
Signed-off-by: Daiyaan <darfeen@nvidia.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
```
  651ef5b5
- fix: guarantee RouterRequestMetrics availability & documentation updates (#6558) · ff06b17e
  Keiven C authored Feb 25, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
```
  ff06b17e
- feat: Log discovery backend type (#6559) · 4bd4c165
  Ryan McCormick authored Feb 24, 2026
  
  4bd4c165
24 Feb, 2026 2 commits

feat: router metrics with dynamo_router_* {worker_id=...}. Update docs (#6227) · 1df620b4

Keiven C authored Feb 24, 2026


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>

1df620b4

feat: add error_type label to reqs metric for fine-grained error classification (#5568) · 432fae67

Vladislav Nosivskoy authored Feb 24, 2026


Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>

432fae67