Commits · e3d00b899f0c8a417cdfc45106c94bba5e3836a3 · OpenDAS / dynamo · GitLab

23 Apr, 2026 1 commit

feat: Tier-based KV Routing (#8380) · e3d00b89

jthomson04 authored Apr 23, 2026


Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

e3d00b89

22 Apr, 2026 1 commit

feat: Interface for shared kv cache handling in kv routing (#7536) · b441e26a

jthomson04 authored Apr 22, 2026

Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

b441e26a

14 Apr, 2026 2 commits
- fix(kv-router): route pinned requests through scheduler (#8142) · 1142478a
  Yan Ru Pei authored Apr 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1142478a
- feat: router, metric only add queue isl tokens (#8136) · eac6a5fc
  Michael Feil authored Apr 13, 2026
```
Signed-off-by: michaelfeil <63565275+michaelfeil@users.noreply.github.com>
```
  eac6a5fc
13 Apr, 2026 1 commit
- fix(kv-router): wake queue on remote lifecycle (#8097) · 36e8b8c8
  Yan Ru Pei authored Apr 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  36e8b8c8
06 Apr, 2026 1 commit
- chore(replay): refactor offline components into cleaner lanes (#7866) · 95a750f4
  Yan Ru Pei authored Apr 06, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  95a750f4
25 Mar, 2026 1 commit
- feat(mocker): add offline disagg replay (#7617) · 02b1c58a
  Yan Ru Pei authored Mar 25, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  02b1c58a
23 Mar, 2026 1 commit
- feat(mocker): add multi-worker replay and router startup fixes (#7553) · b7fe46b1
  Yan Ru Pei authored Mar 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b7fe46b1
17 Mar, 2026 2 commits
- chore(kv-router): drop easy llm facade reexports (#7474) · 45be2fdc
  Yan Ru Pei authored Mar 17, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  45be2fdc
- feat: Enable EPP worker discovery mode (#6592) · a441aaf8
  atchernych authored Mar 16, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  a441aaf8
13 Mar, 2026 1 commit
- feat(kv-router): pluggable scheduling policy for router queue [DYN-2454] (#7260) · bddaaa26
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  bddaaa26
12 Mar, 2026 1 commit
- feat(kv-router): add worker_type to router selection log (#7258) · dcbccbcd
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  dcbccbcd
04 Mar, 2026 1 commit
- chore(kv-router): split monolithic indexer.rs into indexer/ directory (#6870) · b94cb543
  Yan Ru Pei authored Mar 04, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  b94cb543
03 Mar, 2026 3 commits
- fix: properly setup and register vLLM worker for external / hybrid load... · 90d74637
  GuanLuo authored Mar 03, 2026
```
fix: properly setup and register vLLM worker for external / hybrid load balancing. Update launch script (#6695)
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
```
  90d74637
- fix(kv-router): plumb expected_osl through scheduler queue path (#6812) · 8055b7dd
  Yan Ru Pei authored Mar 03, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  8055b7dd
- feat(kv-router): add router queue depth Prometheus metric and nvext field (#6786) · 073fb437
  Yan Ru Pei authored Mar 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  073fb437
28 Feb, 2026 1 commit
- feat(kv-router): add ActiveSequences benchmark and extract common bench utils (#6633) · e5850e23
  Yan Ru Pei authored Feb 27, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  e5850e23
26 Feb, 2026 1 commit
- chore: move ActiveSequences to kv-router and add unit tests (#6600) · 3f99cf21
  Yan Ru Pei authored Feb 25, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  3f99cf21
25 Feb, 2026 1 commit
- feat: Support epp's "pods" interface in Dynamo fixes [DEP-424] (#6302) · c916cd42
  atchernych authored Feb 24, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  c916cd42
24 Feb, 2026 2 commits
- chore: de-async scheduler read paths and unblock decode output tracking (#6510) · efa89448
  Yan Ru Pei authored Feb 24, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  efa89448
- fix: fold scheduling into queue so backpressure actually works (#6470) · 0cb1d733
  Yan Ru Pei authored Feb 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  0cb1d733
19 Feb, 2026 1 commit
- chore: derive router_id and cancellation_token from component instead of plumbing (#6419) · 1549c338
  Yan Ru Pei authored Feb 19, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  1549c338
13 Feb, 2026 1 commit

feat: router priority queue (#6010) · bc514fbe

Yan Ru Pei authored Feb 12, 2026


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

bc514fbe

12 Feb, 2026 1 commit

feat: use RNG when dp routing targets are tied; override no-assume-kv-reuse... · cd6984b9

Karen Chung authored Feb 12, 2026


feat: use RNG when dp routing targets are tied; override no-assume-kv-reuse for decode requests (#6253)
Signed-off-by: Karen Chung <karenc@nvidia.com>

cd6984b9

11 Feb, 2026 1 commit
- feat: add router-level Prometheus metrics and centralize request tracking (#6146) · f46720c9
  Yan Ru Pei authored Feb 10, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
```
  f46720c9
08 Feb, 2026 1 commit

chore: enable local indexers by default, and use normal event plane by default... · 6783bdca

Yan Ru Pei authored Feb 08, 2026


chore: enable local indexers by default, and use normal event plane by default (not jetstream) (#5941)
Signed-off-by: PeaBrane <yanrpei@gmail.com>

6783bdca

04 Feb, 2026 2 commits
- test: indexer and full router benchmarks (#5784) · 039d35ff
  Janelle Cai authored Feb 04, 2026
  
  039d35ff
- feat: Add per-worker Prometheus metrics for router load monitoring (#5842) · 0c0336e6
  Hongkuan Zhou authored Feb 04, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  0c0336e6
03 Feb, 2026 1 commit
- feat(lora): Add lora_name tracking to scheduling and sequence management (#5875) · 373e76c1
  Biswa Panda authored Feb 02, 2026
  
  373e76c1
02 Feb, 2026 1 commit
- chore: remove dead AllWorkersBusy handling in KvScheduler (#5869) · df4cd191
  Yan Ru Pei authored Feb 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  df4cd191
29 Jan, 2026 2 commits
- chore: consistently used the arc shared workers configs + CI flake fixes (#5707) · 584020f4
  Yan Ru Pei authored Jan 29, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  584020f4
- chore: clean ups in kv-router (#5771) · fc92fc18
  Yan Ru Pei authored Jan 28, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  fc92fc18
28 Jan, 2026 2 commits
- chore: lift invariant logic out of loop (#5720) · 453cb26c
  Kante Yin authored Jan 28, 2026
```
Signed-off-by: kerthcet <kerthcet@gmail.com>
```
  453cb26c
- chore: make core kv-router its own crate (#5677) · 649d9b7d
  Yan Ru Pei authored Jan 28, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  649d9b7d
27 Jan, 2026 1 commit
- feat: add ZMQ transport and its discovery (#5625) · 8fc70f20
  Biswa Panda authored Jan 26, 2026
  
  8fc70f20
18 Jan, 2026 2 commits
- chore: use u64 as router consumer id instead of uuid (#5478) · 602ce0ed
  Yan Ru Pei authored Jan 18, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  602ce0ed
- feat: track output tokens / blocks in the Router (optional) (#5452) · 050906b5
  Yan Ru Pei authored Jan 18, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  050906b5
06 Jan, 2026 1 commit
- fix: block on notification of at least one runtime config (#5191) · cdeda221
  Yan Ru Pei authored Jan 05, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  cdeda221
04 Jan, 2026 1 commit

chore: remove unused codes (#5151) · e5502e78

Kante Yin authored Jan 04, 2026


Signed-off-by: kerthcet <kerthcet@gmail.com>
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>

e5502e78

02 Jan, 2026 1 commit
- chore: update all copyright headers in repo to 2026 (#5130) · cf433e68
  Tushar Sharma authored Jan 02, 2026
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  cf433e68