Commits · 59d18d8e9c02231067897035b7654feec54a17ec · OpenDAS / dynamo

16 Apr, 2026 1 commit
- fix(runtime): lock-free TCP connection pool for OOM prevention and... · 6633be54
  Biswa Panda authored Apr 15, 2026
```
fix(runtime): lock-free TCP connection pool for OOM prevention and inflight/resource-leak fixes (#7806)
```
  6633be54
15 Apr, 2026 3 commits

fix(discovery): spawn handle_put tasks concurrently to prevent replay wedging (#7931) · 470bb48f
MatejKosec authored Apr 15, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
470bb48f

fix(metrics): widen histogram buckets for request duration and router overhead (#8087) · bba26d55

Thomas Montfort authored Apr 15, 2026


Signed-off-by: tmontfort <tmontfort@nvidia.com>
Signed-off-by: Thomas Montfort <tmontfort@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

bba26d55

feat(metrics): auto-inject worker_id label into metrics (#8089) · cabdaebd

Thomas Montfort authored Apr 14, 2026


Signed-off-by: tmontfort <tmontfort@nvidia.com>
Signed-off-by: Thomas Montfort <tmontfort@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

cabdaebd

14 Apr, 2026 2 commits
- feat: remove enable_nats usage (#7265) · af0ff07c
  Biswa Panda authored Apr 14, 2026
  
  af0ff07c
- feat: per-container kube discovery for multi-engine pods (#8067) · 2f658327
  mohammedabdulwahhab authored Apr 14, 2026
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  2f658327
13 Apr, 2026 3 commits
- feat: add KV cache transfer estimated latency metric for disaggregated serving (#7590) · 1ebe7060
  Jonathan Tong authored Apr 13, 2026
```
Signed-off-by: Jont828 <jt572@cornell.edu>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
```
  1ebe7060
- feat(runtime): add DYN_TCP_RESPONSE_STREAM_PORT/HOST env vars for configurable... · 3acdc0f8
  Biswa Panda authored Apr 13, 2026
```
feat(runtime): add DYN_TCP_RESPONSE_STREAM_PORT/HOST env vars for configurable response stream server port
```
  3acdc0f8
- feat: route requests by device type and load for sglang epd (#7215) · a7d51b39
  Wang, Yi authored Apr 14, 2026
```
Signed-off-by: Wang, Yi <yi.a.wang@intel.com>
```
  a7d51b39
11 Apr, 2026 2 commits
- fix: LoRA unregister drops all the LoRA variants that share the same ID (#8053) · 9efa460c
  Keiven C authored Apr 10, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  9efa460c
- feat: Request Migration disable on max seq len exceeded (#8020) · f6976e7f
  Jacky authored Apr 10, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  f6976e7f
10 Apr, 2026 1 commit
- feat(frontend): ResponseTimeout error type with request-plane worker quarantine (#8011) · 7f8e88fb
  MatejKosec authored Apr 10, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  7f8e88fb
08 Apr, 2026 3 commits
- fix(runtime): handle instance disappearance in push router transport resolution (#8007) · 8f9c9998
  jthomson04 authored Apr 08, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  8f9c9998
- feat: adding kvbm-engine (#6773) · 008683d6
  Ryan Olson authored Apr 08, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  008683d6
- feat(kv-router): split Dynamo-native remote indexer [DYN-2593] (#7973) · 49eb397a
  Yan Ru Pei authored Apr 07, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  49eb397a
07 Apr, 2026 2 commits
- test: e2e JSONL log verification for request tracing (#7817) · 73f8557a
  Neelay Shah authored Apr 07, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  73f8557a
- feat: Request Rejection Frontend metrics (#7644) · 3205e7db
  Jacky authored Apr 06, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  3205e7db
04 Apr, 2026 1 commit
- fix(kv-router): migrate raw zmq paths to libzmq and refresh lockfiles (#7871) · f849e1a6
  Yan Ru Pei authored Apr 04, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f849e1a6
03 Apr, 2026 1 commit
- feat: request lifecycle logging + metrics capture [DIS-1643] (#7840) · 679d9f14
  Neelay Shah authored Apr 02, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  679d9f14
02 Apr, 2026 2 commits
- refactor: unify on_response, rename request_id fields, deprecate x-dynamo-request-id (#7834) · c376655f
  Neelay Shah authored Apr 02, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  c376655f
- feat: trace infrastructure — spans + request ID propagation [DIS-1643] (#7733) · 13058cbd
  Neelay Shah authored Apr 02, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  13058cbd
01 Apr, 2026 2 commits

feat: add least-loaded router (#6314) · cc22114d

kornelcsernai-harmonic authored Mar 31, 2026


Signed-off-by: Kornel Csernai <239206175+kornelcsernai-harmonic@users.noreply.github.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>

cc22114d

fix(backend): Reject conflicting model registrations on the same endpoint (#7686) · 21ba0c4b
Graham King authored Mar 31, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
21ba0c4b

31 Mar, 2026 1 commit
- feat: Add standardized Dynamo error types as Python exceptions (#7136) · 8ff0b6e7
  Tanmay Verma authored Mar 31, 2026
  
  8ff0b6e7
27 Mar, 2026 1 commit
- chore(mocker): batch live output signal sends (#7647) · a2154ba5
  Yan Ru Pei authored Mar 26, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  a2154ba5
25 Mar, 2026 1 commit
- feat: add power-of-two-choices router mode (#7614) · db49dfd2
  Aaron Batilo authored Mar 24, 2026
```
Signed-off-by: Aaron Batilo <abatilo@coreweave.com>
```
  db49dfd2
24 Mar, 2026 1 commit

feat(vllm): elastic EP scaling — ray.nodes() patch, scale_elastic_ep route,... · daa4fb04

Tzu-Ling Kan authored Mar 24, 2026


feat(vllm): elastic EP scaling — ray.nodes() patch, scale_elastic_ep route, null-tolerant discovery (#7481)
Signed-off-by: tzulingk <tzulingk@nvidia.com>

daa4fb04

23 Mar, 2026 3 commits
- feat: Frontend and Runtime Request Cancellation Metrics (#7493) · e252f82d
  Jacky authored Mar 23, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  e252f82d
- feat(mocker): add multi-worker replay and router startup fixes (#7553) · b7fe46b1
  Yan Ru Pei authored Mar 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b7fe46b1
- feat(perf): add pipeline instrumentation and feature gated NVTX markers (#6746) · 82794761
  Biswa Panda authored Mar 23, 2026
  
  82794761
17 Mar, 2026 1 commit
- feat: Enable EPP worker discovery mode (#6592) · a441aaf8
  atchernych authored Mar 16, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  a441aaf8
14 Mar, 2026 1 commit
- feat(perf): add request-plane, transport, and work-handler metric definitions (#6735) · cec19d4d
  Biswa Panda authored Mar 14, 2026
  
  cec19d4d
13 Mar, 2026 2 commits
- feat(kv-router): add Prometheus metrics to standalone indexer (#7339) · 5aa2f53f
  Yan Ru Pei authored Mar 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  5aa2f53f
- feat(kv-router): pluggable scheduling policy for router queue [DYN-2454] (#7260) · bddaaa26
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  bddaaa26
11 Mar, 2026 4 commits
- feat: follow up of optinal, batching-of-client-side-events (#6741) · fca0a801
  Michael Feil authored Mar 11, 2026
```
Signed-off-by: michaelfeil <63565275+michaelfeil@users.noreply.github.com>
Signed-off-by: Michael Feil <michaelfeil@users.noreply.github.com>
Signed-off-by: Michael Feil <63565275+michaelfeil@users.noreply.github.com>
```
  fca0a801
- feat: streaming tool call and reasoning dispatch SSE events (#7114) · 5178a4a4
  MatejKosec authored Mar 11, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  5178a4a4
- fix: Fix mocker+router segfaults + reliability fixes (#7162) · 761e848b
  jthomson04 authored Mar 10, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  761e848b
- feat(anthropic): add thinking block support and preamble stripping to /v1/messages (#7137) · 012236ee
  MatejKosec authored Mar 10, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  012236ee
10 Mar, 2026 2 commits
- feat: Add Loki log aggregation, and enable unified OTLP ingestion for both... · 734c0b8b
  jh-nv authored Mar 10, 2026
```
feat: Add Loki log aggregation, and enable unified OTLP ingestion for both traces and logs through a single endpoint (#6974)
```
  734c0b8b
- feat(perf): add frontend pipeline and tokio runtime perf metric definitions (#6731) · 3c44b88e
  Biswa Panda authored Mar 10, 2026
  
  3c44b88e