Commits · e3d00b899f0c8a417cdfc45106c94bba5e3836a3 · OpenDAS / dynamo · GitLab

23 Apr, 2026 1 commit

feat: Tier-based KV Routing (#8380) · e3d00b89

jthomson04 authored Apr 23, 2026


Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

e3d00b89

22 Apr, 2026 1 commit
- fix: Remove double tokenization in EPP Integration fixes [DYN-2076] (#8093) · a2a2753d
  atchernych authored Apr 22, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  a2a2753d
21 Apr, 2026 1 commit
- feat(kv-router): add start positions to flat KV events (#8426) · 4b3cd459
  Yan Ru Pei authored Apr 21, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  4b3cd459
14 Apr, 2026 1 commit
- fix(kv-router): route pinned requests through scheduler (#8142) · 1142478a
  Yan Ru Pei authored Apr 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1142478a
08 Apr, 2026 1 commit
- fix: dp_rank always 0 in non-KV router mode (#7984) · a210efa6
  ishandhanani authored Apr 08, 2026
  
  a210efa6
06 Apr, 2026 1 commit
- chore(replay): refactor offline components into cleaner lanes (#7866) · 95a750f4
  Yan Ru Pei authored Apr 06, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  95a750f4
02 Apr, 2026 1 commit
- feat: enable DP for GAIE (#7741) · 2b906504
  atchernych authored Apr 02, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  2b906504
31 Mar, 2026 1 commit
- fix: Fix race condition in epp prefill (#7530) · 457db719
  atchernych authored Mar 31, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  457db719
25 Mar, 2026 2 commits
- feat(mocker): add offline disagg replay (#7617) · 02b1c58a
  Yan Ru Pei authored Mar 25, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  02b1c58a
- fix: sglang eagle bigram tokens kv event report. (#6872) · 2fe37a51
  huitian bai authored Mar 25, 2026
```
Signed-off-by: baihuitian <baihuitian.bht@gmail.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>
```
  2fe37a51
17 Mar, 2026 2 commits
- chore(kv-router): drop easy llm facade reexports (#7474) · 45be2fdc
  Yan Ru Pei authored Mar 17, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  45be2fdc
- feat: Enable EPP worker discovery mode (#6592) · a441aaf8
  atchernych authored Mar 16, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  a441aaf8
14 Mar, 2026 1 commit
- feat: standalone KV indexer runtime integration (#7295) · bba70a41
  Thomas Montfort authored Mar 14, 2026
  
  bba70a41
13 Mar, 2026 1 commit
- feat(kv-router): pluggable scheduling policy for router queue [DYN-2454] (#7260) · bddaaa26
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  bddaaa26
06 Mar, 2026 1 commit
- fix: restore --enforce-disagg to reject requests before prefill router activates (#6957) · f934744f
  Yan Ru Pei authored Mar 05, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f934744f
03 Mar, 2026 2 commits
- fix(kv-router): plumb expected_osl through scheduler queue path (#6812) · 8055b7dd
  Yan Ru Pei authored Mar 03, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  8055b7dd
- feat: upgrade rust to v1.93.0 (#6802) · 57bdbdf1
  Ryan Olson authored Mar 03, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  57bdbdf1
25 Feb, 2026 2 commits
- ci: Accelerate dynamo frontend image build (#6479) · e5f97343
  Ran Rubin authored Feb 25, 2026
  
  e5f97343
- feat: Support epp's "pods" interface in Dynamo fixes [DEP-424] (#6302) · c916cd42
  atchernych authored Feb 24, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  c916cd42
24 Feb, 2026 2 commits
- feat: make KV cache events and routing LoRA-aware (#6517) · 75fea787
  Biswa Panda authored Feb 24, 2026
  
  75fea787
- chore: replace --enforce-disagg with --decode-fallback, default to enforcing disagg (#6515) · c9ff6235
  Yan Ru Pei authored Feb 24, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c9ff6235
23 Feb, 2026 1 commit
- feat(runtime): add hierarchical Model/WorkerSet architecture for multi-namespace support (#6054) · cb55766c
  Thomas Montfort authored Feb 23, 2026
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
```
  cb55766c
20 Feb, 2026 1 commit
- chore: cargo machete - remove unused dependencies (#6453) · 7a6283e9
  Ryan Olson authored Feb 20, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  7a6283e9
14 Feb, 2026 1 commit

feat: mm aware routing for vllm (#6235) · 815b1291

zhongdaor-nv authored Feb 13, 2026


Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com>

815b1291

13 Feb, 2026 1 commit
- feat: Decomposed pipeline for EPP integration [DEP-730] (#5446) · 52271760
  atchernych authored Feb 12, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  52271760
12 Feb, 2026 1 commit

feat: use RNG when dp routing targets are tied; override no-assume-kv-reuse... · cd6984b9

Karen Chung authored Feb 12, 2026


feat: use RNG when dp routing targets are tied; override no-assume-kv-reuse for decode requests (#6253)
Signed-off-by: Karen Chung <karenc@nvidia.com>

cd6984b9

06 Feb, 2026 2 commits
- refactor: Move --migration-limit flag from backend to frontend (#5918) · 1ffa489e
  Jacky authored Feb 06, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  1ffa489e
- chore: clean ups in kv_router.rs (#6028) · 9e33e3fa
  Yan Ru Pei authored Feb 06, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  9e33e3fa
04 Feb, 2026 1 commit
- feat: Add per-worker Prometheus metrics for router load monitoring (#5842) · 0c0336e6
  Hongkuan Zhou authored Feb 04, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  0c0336e6
03 Feb, 2026 3 commits
- feat: Add EPP startup probe and adjust recipe - fixes [DEP-749] (#5770) · 2d602853
  atchernych authored Feb 03, 2026
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
Co-authored-by: Julien Mancuso <jmancuso@nvidia.com>
```
  2d602853
- feat: prefill tokens threshold based on max num batched tokens frac (#5867) · a337113a
  Yan Ru Pei authored Feb 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  a337113a
- feat(lora): Add lora_name tracking to scheduling and sequence management (#5875) · 373e76c1
  Biswa Panda authored Feb 02, 2026
  
  373e76c1
29 Jan, 2026 1 commit
- feat: add epp component (#5611) · 9e2a2cc9
  Julien Mancuso authored Jan 29, 2026
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  9e2a2cc9
26 Jan, 2026 1 commit
- feat: handle PrefillComplete in the Dynamo EPP Scorer Plugin [DEP-728] (#5592) · 2a2e63a0
  atchernych authored Jan 26, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  2a2e63a0
18 Jan, 2026 1 commit
- feat: track output tokens / blocks in the Router (optional) (#5452) · 050906b5
  Yan Ru Pei authored Jan 18, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  050906b5
13 Jan, 2026 1 commit
- fix: Bug 5792966 [DYN -1729] (#5385) · 1da603a4
  atchernych authored Jan 13, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  1da603a4
12 Jan, 2026 1 commit
- feat: allow router not assuming decode kv reuse (#5350) · 7fdc742e
  Yan Ru Pei authored Jan 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7fdc742e
10 Jan, 2026 1 commit
- fix: fix bug in diffing logic in list_and_watch (#5318) · 2f9812aa
  mohammedabdulwahhab authored Jan 10, 2026
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  2f9812aa
03 Jan, 2026 1 commit
- feat: mockers with bootstrap optimization (sglang testing) + CI test (#5121) · 0980b27f
  Yan Ru Pei authored Jan 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  0980b27f
02 Jan, 2026 1 commit
- chore: update all copyright headers in repo to 2026 (#5130) · cf433e68
  Tushar Sharma authored Jan 02, 2026
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  cf433e68