Commits · e3d00b899f0c8a417cdfc45106c94bba5e3836a3 · OpenDAS / dynamo

23 Apr, 2026 1 commit

feat: Tier-based KV Routing (#8380) · e3d00b89

jthomson04 authored Apr 23, 2026


Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

e3d00b89

22 Apr, 2026 3 commits

feat: Interface for shared kv cache handling in kv routing (#7536) · b441e26a

jthomson04 authored Apr 22, 2026

Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

b441e26a

feat(router): branch sharded kv indexer (#7859) · 73a9a53f

Janelle Cai authored Apr 22, 2026


Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Hannah Zhang <hannahz@nvidia.com>

73a9a53f

feat(kv-router): warn on duplicate store replays (#8473) · 4833e29b
Yan Ru Pei authored Apr 21, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
4833e29b

21 Apr, 2026 1 commit
- feat(kv-router): add start positions to flat KV events (#8426) · 4b3cd459
  Yan Ru Pei authored Apr 21, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  4b3cd459
20 Apr, 2026 1 commit
- fix(kv-router): allow unit block size in slot tracking (#8395) · cdb40ec6
  Yan Ru Pei authored Apr 20, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  cdb40ec6
17 Apr, 2026 2 commits
- chore(kv-router): make sequences stop doing token math (#8260) · d94b350d
  Yan Ru Pei authored Apr 17, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d94b350d
- fix(kv-router): Increase JSON body to 8 MiB to allow 1M tokens (#8315) · 4e7c6afd
  Graham King authored Apr 17, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  4e7c6afd
16 Apr, 2026 1 commit
- fix(kv-router): prune stale compressed-tree children (#8127) · 0652441f
  Yan Ru Pei authored Apr 16, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  0652441f
15 Apr, 2026 2 commits
- feat(kv-router): add prompt membership index for scheduler reads (#8175) · 134d484d
  Yan Ru Pei authored Apr 15, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  134d484d
- fix(kv-router): expose kv_cache_events_applied in multithreaded indexer (#8088) · d0d9c030
  Thomas Montfort authored Apr 15, 2026
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
Signed-off-by: Thomas Montfort <tmontfort@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  d0d9c030
14 Apr, 2026 2 commits
- fix(kv-router): route pinned requests through scheduler (#8142) · 1142478a
  Yan Ru Pei authored Apr 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1142478a
- feat: router, metric only add queue isl tokens (#8136) · eac6a5fc
  Michael Feil authored Apr 13, 2026
```
Signed-off-by: michaelfeil <63565275+michaelfeil@users.noreply.github.com>
```
  eac6a5fc
13 Apr, 2026 1 commit
- fix(kv-router): wake queue on remote lifecycle (#8097) · 36e8b8c8
  Yan Ru Pei authored Apr 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  36e8b8c8
10 Apr, 2026 1 commit
- fix: add worker dump throtteling (#8013) · 859bd6ea
  Michael Feil authored Apr 09, 2026
```
Signed-off-by: michaelfeil <63565275+michaelfeil@users.noreply.github.com>
```
  859bd6ea
09 Apr, 2026 2 commits
- chore(kv-router): remove sharded indexer path (#8041) · 02666f04
  Yan Ru Pei authored Apr 09, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  02666f04
- fix(kv-router): coalesce worker recovery dumps (#8021) · f3d3a8b3
  Yan Ru Pei authored Apr 09, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f3d3a8b3
08 Apr, 2026 1 commit
- feat(kv-router): split Dynamo-native remote indexer [DYN-2593] (#7973) · 49eb397a
  Yan Ru Pei authored Apr 07, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  49eb397a
07 Apr, 2026 3 commits
- chore(kv-router): tighten indexer cleanup helpers (#7945) · 22da711f
  Yan Ru Pei authored Apr 07, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  22da711f
- chore: bump vLLM to 0.19.0 (#7894) · d5803cbe
  Alec authored Apr 07, 2026
  
  d5803cbe
- fix(kv-router): correct decode-worker scoring for unregistered workers in selector (#7919) · 2af062ec
  MatejKosec authored Apr 06, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  2af062ec
06 Apr, 2026 2 commits
- fix: latch busy load until both cool off (#7912) · ffe20629
  Yan Ru Pei authored Apr 06, 2026
```
Signed-off-by: AmeenP <ameenp360@gmail.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: AmeenP <ameenp360@gmail.com>
```
  ffe20629
- chore(replay): refactor offline components into cleaner lanes (#7866) · 95a750f4
  Yan Ru Pei authored Apr 06, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  95a750f4
04 Apr, 2026 1 commit
- fix(kv-router): migrate raw zmq paths to libzmq and refresh lockfiles (#7871) · f849e1a6
  Yan Ru Pei authored Apr 04, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f849e1a6
03 Apr, 2026 2 commits
- fix(kv-router): default to compressed concurrent tree (#7874) · 04e05f8c
  Yan Ru Pei authored Apr 03, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  04e05f8c
- fix(kv-router): clean up watermarks on worker deregister (#7863) · 4cf04338
  doujiang24 authored Apr 04, 2026
```
Signed-off-by: zhudejiang.pt <zhudejiang.pt@antgroup.com>
```
  4cf04338
02 Apr, 2026 4 commits
- refactor(kv-router): tidy indexer test query helpers (#7801) · 1f10ba55
  Yan Ru Pei authored Apr 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1f10ba55
- fix(kv-router): compressed tree sizes accounting (#7800) · b55277c9
  Yan Ru Pei authored Apr 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b55277c9
- fix(kv-router): lazily register workers in slot tracker (#7795) · 1bbdff2d
  ishandhanani authored Apr 02, 2026
  
  1bbdff2d
- refactor(protocols): deprecate cache control (#7790) · c09ac697
  ishandhanani authored Apr 01, 2026
  
  c09ac697
27 Mar, 2026 1 commit
- chore(mocker): batch live output signal sends (#7647) · a2154ba5
  Yan Ru Pei authored Mar 26, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  a2154ba5
25 Mar, 2026 3 commits
- feat(mocker): add offline disagg replay (#7617) · 02b1c58a
  Yan Ru Pei authored Mar 25, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  02b1c58a
- perf: Miscellaneous router perf improvements (#7477) · 1368ccd6
  jthomson04 authored Mar 24, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  1368ccd6
- fix: sglang eagle bigram tokens kv event report. (#6872) · 2fe37a51
  huitian bai authored Mar 25, 2026
```
Signed-off-by: baihuitian <baihuitian.bht@gmail.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>
```
  2fe37a51
24 Mar, 2026 2 commits
- chore(kv-router): share recovery cursor state (#7596) · 7389a369
  Yan Ru Pei authored Mar 24, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7389a369
- feat(replay): add shared loadgen workload paths [DYN-2510] (#7593) · b2c59aa4
  Yan Ru Pei authored Mar 24, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b2c59aa4
23 Mar, 2026 3 commits
- fix: Don't double-count duplicate store events in the tree size. (#7549) · 52382c91
  jthomson04 authored Mar 23, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  52382c91
- feat(mocker): add multi-worker replay and router startup fixes (#7553) · b7fe46b1
  Yan Ru Pei authored Mar 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b7fe46b1
- feat: radix tree implementation (#7459) · ed4d8068
  Janelle Cai authored Mar 23, 2026
  
  ed4d8068
20 Mar, 2026 1 commit
- feat(mocker): add offline trace replay mode [DYN-2502] (#7543) · c3908a36
  Yan Ru Pei authored Mar 20, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c3908a36