Commits · 73e0a2f2ef86df194a704125d6f7f4d0688d363b · OpenDAS / dynamo · GitLab

20 Apr, 2026 2 commits
- feat: (Router) Guard threshold-based rejection logic when CLI thresholds are unset (#8333) · adfc02d5
  Karen Chung authored Apr 20, 2026
  
  adfc02d5
- feat: add staged frontend gauges (#8162) · 0c98d9a1
  Jie Hao authored Apr 20, 2026
  
  0c98d9a1
17 Apr, 2026 1 commit
- fix(health): make canary sole authority on endpoint readiness when enabled (#8165) · 61d4674c
  Neelay Shah authored Apr 17, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  61d4674c
16 Apr, 2026 1 commit
- fix(runtime): lock-free TCP connection pool for OOM prevention and... · 6633be54
  Biswa Panda authored Apr 15, 2026
```
fix(runtime): lock-free TCP connection pool for OOM prevention and inflight/resource-leak fixes (#7806)
```
  6633be54
15 Apr, 2026 1 commit

fix(metrics): widen histogram buckets for request duration and router overhead (#8087) · bba26d55

Thomas Montfort authored Apr 15, 2026


Signed-off-by: tmontfort <tmontfort@nvidia.com>
Signed-off-by: Thomas Montfort <tmontfort@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

bba26d55

13 Apr, 2026 1 commit
- feat: route requests by device type and load for sglang epd (#7215) · a7d51b39
  Wang, Yi authored Apr 14, 2026
```
Signed-off-by: Wang, Yi <yi.a.wang@intel.com>
```
  a7d51b39
10 Apr, 2026 1 commit
- feat(frontend): ResponseTimeout error type with request-plane worker quarantine (#8011) · 7f8e88fb
  MatejKosec authored Apr 10, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  7f8e88fb
08 Apr, 2026 1 commit
- fix(runtime): handle instance disappearance in push router transport resolution (#8007) · 8f9c9998
  jthomson04 authored Apr 08, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  8f9c9998
07 Apr, 2026 1 commit
- feat: Request Rejection Frontend metrics (#7644) · 3205e7db
  Jacky authored Apr 06, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  3205e7db
03 Apr, 2026 1 commit
- feat: request lifecycle logging + metrics capture [DIS-1643] (#7840) · 679d9f14
  Neelay Shah authored Apr 02, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  679d9f14
02 Apr, 2026 2 commits
- refactor: unify on_response, rename request_id fields, deprecate x-dynamo-request-id (#7834) · c376655f
  Neelay Shah authored Apr 02, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  c376655f
- feat: trace infrastructure — spans + request ID propagation [DIS-1643] (#7733) · 13058cbd
  Neelay Shah authored Apr 02, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  13058cbd
01 Apr, 2026 1 commit

feat: add least-loaded router (#6314) · cc22114d

kornelcsernai-harmonic authored Mar 31, 2026


Signed-off-by: Kornel Csernai <239206175+kornelcsernai-harmonic@users.noreply.github.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>

cc22114d

25 Mar, 2026 1 commit
- feat: add power-of-two-choices router mode (#7614) · db49dfd2
  Aaron Batilo authored Mar 24, 2026
```
Signed-off-by: Aaron Batilo <abatilo@coreweave.com>
```
  db49dfd2
23 Mar, 2026 2 commits
- feat: Frontend and Runtime Request Cancellation Metrics (#7493) · e252f82d
  Jacky authored Mar 23, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  e252f82d
- feat(perf): add pipeline instrumentation and feature gated NVTX markers (#6746) · 82794761
  Biswa Panda authored Mar 23, 2026
  
  82794761
17 Mar, 2026 1 commit
- feat: Enable EPP worker discovery mode (#6592) · a441aaf8
  atchernych authored Mar 16, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  a441aaf8
10 Mar, 2026 1 commit
- fix: resolve HTTP port collisions when multiple workers share a process (#7063) · b407b419
  Biswa Panda authored Mar 09, 2026
  
  b407b419
06 Mar, 2026 2 commits
- fix: use checked arithmetic in TwoPartCodec to prevent integer overflow (#6959) · 64ae47fd
  Shounak Ray authored Mar 06, 2026
```
Signed-off-by: ShounakRay <shounak@stanford.edu>
```
  64ae47fd
- chore(UX): Log full endpoint name when registering TCP endpoint (#6964) · 2f15f334
  Ryan McCormick authored Mar 06, 2026
  
  2f15f334
03 Mar, 2026 1 commit
- feat: upgrade rust to v1.93.0 (#6802) · 57bdbdf1
  Ryan Olson authored Mar 03, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  57bdbdf1
02 Mar, 2026 1 commit
- chore(style): Log with {var} style in lib/runtime (#6757) · 9e6a84af
  Ryan McCormick authored Mar 02, 2026
  
  9e6a84af
24 Feb, 2026 1 commit
- feat: Standardized Dynamo Error Type (#6303) · c8276cd2
  Jacky authored Feb 23, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  c8276cd2
23 Feb, 2026 1 commit
- feat: add standalone KV indexer with query endpoint [DYN-2164] (#6446) · 038b50d2
  Yan Ru Pei authored Feb 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  038b50d2
13 Feb, 2026 2 commits
- chore: otel tracings for routing overheads and metrics (#6194) · f6c34e07
  Yan Ru Pei authored Feb 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f6c34e07
- feat: Decomposed pipeline for EPP integration [DEP-730] (#5446) · 52271760
  atchernych authored Feb 12, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  52271760
12 Feb, 2026 1 commit
- chore: warn out request rejection (#6222) · 7b16480a
  Yan Ru Pei authored Feb 11, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7b16480a
08 Feb, 2026 1 commit

chore: enable local indexers by default, and use normal event plane by default... · 6783bdca

Yan Ru Pei authored Feb 08, 2026


chore: enable local indexers by default, and use normal event plane by default (not jetstream) (#5941)
Signed-off-by: PeaBrane <yanrpei@gmail.com>

6783bdca

27 Jan, 2026 1 commit
- chore: Fix tests logging setup (#5693) · 90b07594
  Graham King authored Jan 27, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  90b07594
26 Jan, 2026 1 commit
- test: unit test TCP client handle_reader [2/n] (#5056) · 2a2ad756
  Qi Wang authored Jan 25, 2026
  
  2a2ad756
14 Jan, 2026 1 commit
- fix: fix worker's push_handler non-blocking error upon stop word (#5157) · 31189eea
  Qi Wang authored Jan 14, 2026
  
  31189eea
13 Jan, 2026 2 commits
- fix: use zero copy decoder for handling high concurrency / request bursts for tcp ingress (#5376) · bbb79afb
  Biswa Panda authored Jan 13, 2026
  
  bbb79afb
- test: unit test tcp/client.rs handle_writer [1/n] (#5055) · e47457e4
  Qi Wang authored Jan 13, 2026
  
  e47457e4
09 Jan, 2026 2 commits
- perf: Fix prefill router round robin (#5313) · b39aa54f
  jthomson04 authored Jan 09, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  b39aa54f
- fix: distributed tracing propagation for TCP transport (#5283) · ace35a8e
  jh-nv authored Jan 08, 2026
```
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
```
  ace35a8e
03 Jan, 2026 1 commit
- feat: mockers with bootstrap optimization (sglang testing) + CI test (#5121) · 0980b27f
  Yan Ru Pei authored Jan 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  0980b27f
02 Jan, 2026 1 commit
- chore: update all copyright headers in repo to 2026 (#5130) · cf433e68
  Tushar Sharma authored Jan 02, 2026
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  cf433e68
31 Dec, 2025 1 commit

fix: sglang disagg routing fixes and optimizations [DYN-1692] (#5106) · 0b33c1df

Yan Ru Pei authored Dec 31, 2025


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
Co-authored-by: Sean SH Choi <sechoi@nvidia.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

0b33c1df

13 Dec, 2025 1 commit
- feat: Support for field include_stop_str_in_output (#4924) · 45e881d3
  KrishnanPrash authored Dec 12, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  45e881d3
11 Dec, 2025 1 commit
- feat: use os assigned free port for tcp rpc (#4891) · 64a30d3d
  Biswa Panda authored Dec 11, 2025
  
  64a30d3d