Commits · e3d00b899f0c8a417cdfc45106c94bba5e3836a3 · OpenDAS / dynamo

23 Apr, 2026 1 commit

feat: Tier-based KV Routing (#8380) · e3d00b89

jthomson04 authored Apr 23, 2026


Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

e3d00b89

21 Apr, 2026 1 commit
- feat(kv-router): add start positions to flat KV events (#8426) · 4b3cd459
  Yan Ru Pei authored Apr 21, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  4b3cd459
14 Apr, 2026 1 commit
- fix(kv-router): route pinned requests through scheduler (#8142) · 1142478a
  Yan Ru Pei authored Apr 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1142478a
08 Apr, 2026 1 commit
- feat(kv-router): split Dynamo-native remote indexer [DYN-2593] (#7973) · 49eb397a
  Yan Ru Pei authored Apr 07, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  49eb397a
06 Apr, 2026 2 commits
- fix: latch busy load until both cool off (#7912) · ffe20629
  Yan Ru Pei authored Apr 06, 2026
```
Signed-off-by: AmeenP <ameenp360@gmail.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: AmeenP <ameenp360@gmail.com>
```
  ffe20629
- chore(replay): refactor offline components into cleaner lanes (#7866) · 95a750f4
  Yan Ru Pei authored Apr 06, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  95a750f4
25 Mar, 2026 1 commit

fix: sglang eagle bigram tokens kv event report. (#6872) · 2fe37a51

huitian bai authored Mar 25, 2026


Signed-off-by: baihuitian <baihuitian.bht@gmail.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>

2fe37a51

24 Mar, 2026 1 commit
- feat(router): add best_worker indexer update flag (#7603) · 149bf5a2
  Yan Ru Pei authored Mar 24, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  149bf5a2
17 Mar, 2026 1 commit
- chore(kv-router): drop easy llm facade reexports (#7474) · 45be2fdc
  Yan Ru Pei authored Mar 17, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  45be2fdc
15 Mar, 2026 1 commit
- feat(kv-indexer): add python launcher follow-up [DYN-2459] (#7395) · 56b448a6
  Yan Ru Pei authored Mar 15, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  56b448a6
14 Mar, 2026 1 commit
- feat: standalone KV indexer runtime integration (#7295) · bba70a41
  Thomas Montfort authored Mar 14, 2026
  
  bba70a41
11 Mar, 2026 1 commit

feat: follow up of optinal, batching-of-client-side-events (#6741) · fca0a801

Michael Feil authored Mar 11, 2026

Signed-off-by: michaelfeil <63565275+michaelfeil@users.noreply.github.com>
Signed-off-by: Michael Feil <michaelfeil@users.noreply.github.com>
Signed-off-by: Michael Feil <63565275+michaelfeil@users.noreply.github.com>

fca0a801

03 Mar, 2026 1 commit
- fix(kv-router): plumb expected_osl through scheduler queue path (#6812) · 8055b7dd
  Yan Ru Pei authored Mar 03, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  8055b7dd
02 Mar, 2026 1 commit
- feat: move standalone KV indexer into kv-router crate with HTTP integration tests (#6569) · 07742cc2
  Yan Ru Pei authored Mar 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  07742cc2
28 Feb, 2026 1 commit
- feat: dynamic batching of client side events (#6733) · 713c96d2
  Michael Feil authored Feb 28, 2026
```
Signed-off-by: michaelfeil <63565275+michaelfeil@users.noreply.github.com>
```
  713c96d2
25 Feb, 2026 2 commits
- chore: plumb allowed_worker_ids through RoutingHints (#6580) · ebaf048d
  Yan Ru Pei authored Feb 25, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ebaf048d
- feat: Support epp's "pods" interface in Dynamo fixes [DEP-424] (#6302) · c916cd42
  atchernych authored Feb 24, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  c916cd42
24 Feb, 2026 1 commit
- feat: make KV cache events and routing LoRA-aware (#6517) · 75fea787
  Biswa Panda authored Feb 24, 2026
  
  75fea787
23 Feb, 2026 2 commits
- feat: Remove Component from public (#6403) · 80cac7c1
  Tzu-Ling Kan authored Feb 23, 2026
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  80cac7c1
- feat: add standalone KV indexer with query endpoint [DYN-2164] (#6446) · 038b50d2
  Yan Ru Pei authored Feb 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  038b50d2
19 Feb, 2026 1 commit

chore: Remove ZmqKvEventListener binding and rework standalone TRT-LLM example... · fc229004

Yan Ru Pei authored Feb 18, 2026


chore: Remove ZmqKvEventListener binding and rework standalone TRT-LLM example to use native Python ZMQ (#6164)
Signed-off-by: PeaBrane <yanrpei@gmail.com>

fc229004

14 Feb, 2026 1 commit

feat: mm aware routing for vllm (#6235) · 815b1291

zhongdaor-nv authored Feb 13, 2026


Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com>

815b1291

13 Feb, 2026 2 commits
- chore: rename KvPushRouter to KvRouter in python + more bindings removal (#6238) · 14eceb43
  Yan Ru Pei authored Feb 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  14eceb43
- feat: router priority queue (#6010) · bc514fbe
  Yan Ru Pei authored Feb 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
```
  bc514fbe
12 Feb, 2026 1 commit

feat: use RNG when dp routing targets are tied; override no-assume-kv-reuse... · cd6984b9

Karen Chung authored Feb 12, 2026


feat: use RNG when dp routing targets are tied; override no-assume-kv-reuse for decode requests (#6253)
Signed-off-by: Karen Chung <karenc@nvidia.com>

cd6984b9

11 Feb, 2026 2 commits
- chore: remove kv indexers bindings (#6159) · 6a728d10
  Yan Ru Pei authored Feb 11, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  6a728d10
- feat: add router-level Prometheus metrics and centralize request tracking (#6146) · f46720c9
  Yan Ru Pei authored Feb 10, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
```
  f46720c9
08 Feb, 2026 1 commit

chore: enable local indexers by default, and use normal event plane by default... · 6783bdca

Yan Ru Pei authored Feb 08, 2026


chore: enable local indexers by default, and use normal event plane by default (not jetstream) (#5941)
Signed-off-by: PeaBrane <yanrpei@gmail.com>

6783bdca

06 Feb, 2026 1 commit
- chore: remove and unify bindings in kv.rs (#6016) · 3e417022
  Yan Ru Pei authored Feb 06, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  3e417022
04 Feb, 2026 1 commit
- feat: Add per-worker Prometheus metrics for router load monitoring (#5842) · 0c0336e6
  Hongkuan Zhou authored Feb 04, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  0c0336e6
03 Feb, 2026 2 commits
- feat: per dp rank gap detection (#5873) · 902eabd9
  Yan Ru Pei authored Feb 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  902eabd9
- feat(lora): Add lora_name tracking to scheduling and sequence management (#5875) · 373e76c1
  Biswa Panda authored Feb 02, 2026
  
  373e76c1
02 Feb, 2026 1 commit

fix: enable DP attention KV events for multi-node deployments (#5589) · c5f5ab60

ishandhanani authored Feb 02, 2026


Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
Co-authored-by: huitianbai <huitianbai@gmail.com>
Co-authored-by: Huitianqi Bai <huitianbai@users.noreply.github.com>

c5f5ab60

29 Jan, 2026 2 commits
- feat: remove deprecated events api (#5778) · 1174c819
  Biswa Panda authored Jan 28, 2026
  
  1174c819
- chore: clean ups in kv-router (#5771) · fc92fc18
  Yan Ru Pei authored Jan 28, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  fc92fc18
23 Jan, 2026 1 commit
- chore: nuke ForwardPassMetrics (#5531) · feb6d272
  Yan Ru Pei authored Jan 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  feb6d272
14 Jan, 2026 1 commit
- chore(router): Remove deprecated best_worker_id and metrics_labels (#5412) · c5458b99
  Graham King authored Jan 14, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  c5458b99
02 Jan, 2026 1 commit
- chore: update all copyright headers in repo to 2026 (#5130) · cf433e68
  Tushar Sharma authored Jan 02, 2026
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  cf433e68
31 Dec, 2025 1 commit

fix: sglang disagg routing fixes and optimizations [DYN-1692] (#5106) · 0b33c1df

Yan Ru Pei authored Dec 31, 2025


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
Co-authored-by: Sean SH Choi <sechoi@nvidia.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

0b33c1df

19 Dec, 2025 1 commit
- chore: clean up PreprocessedRequest (#5040) · f4245c99
  Yan Ru Pei authored Dec 19, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f4245c99