Commits · e232bec07ceea0b18c94dacc7c052a6ee1daaaf3 · OpenDAS / dynamo · GitLab

14 Apr, 2026 1 commit
- fix(runtime): graceful removal of disagg model from /v1/models when prefill engine dies (#7131) · d2aad651
  Biswa Panda authored Apr 14, 2026
  
  d2aad651
13 Apr, 2026 1 commit
- feat: route requests by device type and load for sglang epd (#7215) · a7d51b39
  Wang, Yi authored Apr 14, 2026
```
Signed-off-by: Wang, Yi <yi.a.wang@intel.com>
```
  a7d51b39
11 Apr, 2026 1 commit
- feat: Request Migration disable on max seq len exceeded (#8020) · f6976e7f
  Jacky authored Apr 10, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  f6976e7f
06 Apr, 2026 2 commits
- chore(replay): refactor offline components into cleaner lanes (#7866) · 95a750f4
  Yan Ru Pei authored Apr 06, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  95a750f4
- chore: Missed cleanup, delete batch mode (#7873) · ac60a0e1
  Graham King authored Apr 06, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  ac60a0e1
01 Apr, 2026 2 commits
- refactor(2/3): rename dynamo-async-openai to dynamo-protocols (#7565) · b6a3b0c6
  ishandhanani authored Apr 01, 2026
  
  b6a3b0c6
- feat: add least-loaded router (#6314) · cc22114d
  kornelcsernai-harmonic authored Mar 31, 2026
```
Signed-off-by: Kornel Csernai <239206175+kornelcsernai-harmonic@users.noreply.github.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>
```
  cc22114d
30 Mar, 2026 1 commit
- refactor(1/3): move `nvext` to `dynamo-llm` and move `anthropic` to `dynamo-async-openai` (#7564) · 2887cd1c
  ishandhanani authored Mar 30, 2026
  
  2887cd1c
27 Mar, 2026 1 commit
- chore(mocker): batch live output signal sends (#7647) · a2154ba5
  Yan Ru Pei authored Mar 26, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  a2154ba5
25 Mar, 2026 1 commit
- feat: add power-of-two-choices router mode (#7614) · db49dfd2
  Aaron Batilo authored Mar 24, 2026
```
Signed-off-by: Aaron Batilo <abatilo@coreweave.com>
```
  db49dfd2
23 Mar, 2026 1 commit
- feat(perf): add pipeline instrumentation and feature gated NVTX markers (#6746) · 82794761
  Biswa Panda authored Mar 23, 2026
  
  82794761
06 Mar, 2026 1 commit
- fix: restore --enforce-disagg to reject requests before prefill router activates (#6957) · f934744f
  Yan Ru Pei authored Mar 05, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f934744f
03 Mar, 2026 1 commit
- feat: upgrade rust to v1.93.0 (#6802) · 57bdbdf1
  Ryan Olson authored Mar 03, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  57bdbdf1
25 Feb, 2026 2 commits

feat: Tiktoken support (#6460) · 21fce9ba
Nikita authored Feb 25, 2026
```
Signed-off-by: Nikita Sukharev <kaonael@gmail.com>
```
21fce9ba

fix: guarantee RouterRequestMetrics availability & documentation updates (#6558) · ff06b17e

Keiven C authored Feb 25, 2026


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>

ff06b17e

24 Feb, 2026 3 commits
- feat: router metrics with dynamo_router_* {worker_id=...}. Update docs (#6227) · 1df620b4
  Keiven C authored Feb 24, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
```
  1df620b4
- chore: replace --enforce-disagg with --decode-fallback, default to enforcing disagg (#6515) · c9ff6235
  Yan Ru Pei authored Feb 24, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c9ff6235
- fix(api): preserve interleaved reasoning order for KV cache correctness (#6442) · a9e06960
  MatejKosec authored Feb 23, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  a9e06960
23 Feb, 2026 1 commit
- feat(runtime): add hierarchical Model/WorkerSet architecture for multi-namespace support (#6054) · cb55766c
  Thomas Montfort authored Feb 23, 2026
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
```
  cb55766c
18 Feb, 2026 1 commit
- fix: Remove http temp cancel token, use real one (#6344) · 9a93eb75
  Graham King authored Feb 18, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  9a93eb75
13 Feb, 2026 2 commits
- fix: consolidate dyn_discovery_backend and dyn_kv_store (#6167) · a289695c
  mohammedabdulwahhab authored Feb 13, 2026
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  a289695c
- feat: Decomposed pipeline for EPP integration [DEP-730] (#5446) · 52271760
  atchernych authored Feb 12, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  52271760
12 Feb, 2026 1 commit
- chore: Remove dynamo-run and mistral-rs engine (#6203) · bbe82f18
  Graham King authored Feb 12, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  bbe82f18
11 Feb, 2026 1 commit
- feat: support `reasoning_content` context management (DeepSeek v3.2 & GLM-4.7 & Kimi-2.5) (#6107) · 2cee89a0
  Vladislav Nosivskoy authored Feb 11, 2026
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
```
  2cee89a0
10 Feb, 2026 1 commit
- feat(frontend): Use vllm for pre and post processing (#5544) · 4f99451b
  Graham King authored Feb 10, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  4f99451b
09 Feb, 2026 1 commit
- feat: text to image vLLM Omni (#5912) · 9f76d060
  Ayush Agarwal authored Feb 09, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  9f76d060
06 Feb, 2026 1 commit
- refactor: Move --migration-limit flag from backend to frontend (#5918) · 1ffa489e
  Jacky authored Feb 06, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  1ffa489e
05 Feb, 2026 1 commit

chore: remove unused NIM specific code (part 2) (#5893) · cb7ebdd7

Keiven C authored Feb 05, 2026


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

cb7ebdd7

04 Feb, 2026 1 commit
- feat: Add per-worker Prometheus metrics for router load monitoring (#5842) · 0c0336e6
  Hongkuan Zhou authored Feb 04, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  0c0336e6
12 Jan, 2026 1 commit
- fix(llm): Send HF URLs to frontend not full paths (#5290) · f6ae58e3
  Graham King authored Jan 12, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  f6ae58e3
02 Jan, 2026 1 commit
- chore: update all copyright headers in repo to 2026 (#5130) · cf433e68
  Tushar Sharma authored Jan 02, 2026
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  cf433e68
31 Dec, 2025 1 commit

fix: sglang disagg routing fixes and optimizations [DYN-1692] (#5106) · 0b33c1df

Yan Ru Pei authored Dec 31, 2025


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
Co-authored-by: Sean SH Choi <sechoi@nvidia.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

0b33c1df

19 Dec, 2025 3 commits

feat: Request Migration Metrics (#5029) · e6a6a1f2
Jacky authored Dec 19, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
e6a6a1f2
feat: Runtime media decoder config (#5011) · d2faf0e6
milesial authored Dec 18, 2025
```
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
```
d2faf0e6

refactor: frontend/grpc tests to use dynamic ports (#4992) · c22280cc

Keiven C authored Dec 18, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

c22280cc

18 Dec, 2025 1 commit
- feat(frontend): First part of Python request handling (#4999) · da0f2fb8
  Graham King authored Dec 17, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  da0f2fb8
11 Dec, 2025 1 commit
- feat: early rejection based on active prefill tokens (#4837) · 10b01b45
  Yan Ru Pei authored Dec 11, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  10b01b45
09 Dec, 2025 1 commit
- chore(pipeline): Move migration outside of backend (#4823) · d5f425ab
  Graham King authored Dec 09, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  d5f425ab
02 Dec, 2025 2 commits
- feat: lora - centralize lora cache key, restructure folders, s3 resiliency (#4644) · 71f94eda
  Biswa Panda authored Dec 02, 2025
  
  71f94eda
- feat: dynamic setting of thresholds for rejection (#4673) · 4c1bc4ee
  Yan Ru Pei authored Dec 02, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  4c1bc4ee