Commits · 1ebe706004186218331c8fa331a5d51064e35d99 · OpenDAS / dynamo

13 Apr, 2026 2 commits
- feat: add KV cache transfer estimated latency metric for disaggregated serving (#7590) · 1ebe7060
  Jonathan Tong authored Apr 13, 2026
```
Signed-off-by: Jont828 <jt572@cornell.edu>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
```
  1ebe7060
- fix(kv-router): wake queue on remote lifecycle (#8097) · 36e8b8c8
  Yan Ru Pei authored Apr 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  36e8b8c8
10 Apr, 2026 3 commits
- fix: recovery etc order, full recovery, thundering herd on same worker ids in same order. (#8016) · 6b75d6b0
  Michael Feil authored Apr 10, 2026
```
Signed-off-by: michaelfeil <63565275+michaelfeil@users.noreply.github.com>
```
  6b75d6b0
- fix: prevent KV block leak from cancel during disagg KV transfer (#7489) · 9055b2d3
  Yuewei Na authored Apr 09, 2026
```
Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>
```
  9055b2d3
- fix: add worker dump throtteling (#8013) · 859bd6ea
  Michael Feil authored Apr 09, 2026
```
Signed-off-by: michaelfeil <63565275+michaelfeil@users.noreply.github.com>
```
  859bd6ea
09 Apr, 2026 3 commits
- fix(llm): preserve unresolved dp rank routing (#8000) · b579a772
  Yan Ru Pei authored Apr 09, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b579a772
- fix(kv-router): coalesce worker recovery dumps (#8021) · f3d3a8b3
  Yan Ru Pei authored Apr 09, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f3d3a8b3
- feat(kv-router): add dedup filter for duplicate vLLM KV block events (#8012) · 9b3e9249
  jthomson04 authored Apr 08, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  9b3e9249
08 Apr, 2026 2 commits
- fix: dp_rank always 0 in non-KV router mode (#7984) · a210efa6
  ishandhanani authored Apr 08, 2026
  
  a210efa6
- feat(kv-router): split Dynamo-native remote indexer [DYN-2593] (#7973) · 49eb397a
  Yan Ru Pei authored Apr 07, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  49eb397a
07 Apr, 2026 1 commit
- chore: bump vLLM to 0.19.0 (#7894) · d5803cbe
  Alec authored Apr 07, 2026
  
  d5803cbe
06 Apr, 2026 2 commits
- fix: latch busy load until both cool off (#7912) · ffe20629
  Yan Ru Pei authored Apr 06, 2026
```
Signed-off-by: AmeenP <ameenp360@gmail.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: AmeenP <ameenp360@gmail.com>
```
  ffe20629
- chore(replay): refactor offline components into cleaner lanes (#7866) · 95a750f4
  Yan Ru Pei authored Apr 06, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  95a750f4
04 Apr, 2026 1 commit
- fix(kv-router): migrate raw zmq paths to libzmq and refresh lockfiles (#7871) · f849e1a6
  Yan Ru Pei authored Apr 04, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f849e1a6
03 Apr, 2026 1 commit
- fix(kv-router): default to compressed concurrent tree (#7874) · 04e05f8c
  Yan Ru Pei authored Apr 03, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  04e05f8c
02 Apr, 2026 3 commits
- feat: enable DP for GAIE (#7741) · 2b906504
  atchernych authored Apr 02, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  2b906504
- refactor(protocols): deprecate cache control (#7790) · c09ac697
  ishandhanani authored Apr 01, 2026
  
  c09ac697
- fix(llm): retry worker-local ZMQ subscriber startup (#7788) · abd0ba5d
  Yan Ru Pei authored Apr 01, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  abd0ba5d
31 Mar, 2026 1 commit
- fix: Fix race condition in epp prefill (#7530) · 457db719
  atchernych authored Mar 31, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  457db719
27 Mar, 2026 1 commit
- chore(mocker): batch live output signal sends (#7647) · a2154ba5
  Yan Ru Pei authored Mar 26, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  a2154ba5
25 Mar, 2026 4 commits
- feat(mocker): add offline disagg replay (#7617) · 02b1c58a
  Yan Ru Pei authored Mar 25, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  02b1c58a
- feat(sglang): disagg DP rank routing + backwards-compatible network imports (#6736) · 7edb07b5
  ishandhanani authored Mar 25, 2026
```
Co-authored-by: huitian bai <baihuitian.bht@gmail.com>
```
  7edb07b5
- perf: Miscellaneous router perf improvements (#7477) · 1368ccd6
  jthomson04 authored Mar 24, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  1368ccd6
- fix: sglang eagle bigram tokens kv event report. (#6872) · 2fe37a51
  huitian bai authored Mar 25, 2026
```
Signed-off-by: baihuitian <baihuitian.bht@gmail.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>
```
  2fe37a51
24 Mar, 2026 2 commits
- chore(kv-router): share recovery cursor state (#7596) · 7389a369
  Yan Ru Pei authored Mar 24, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7389a369
- feat(router): add best_worker indexer update flag (#7603) · 149bf5a2
  Yan Ru Pei authored Mar 24, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  149bf5a2
23 Mar, 2026 2 commits
- feat(mocker): add multi-worker replay and router startup fixes (#7553) · b7fe46b1
  Yan Ru Pei authored Mar 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b7fe46b1
- feat(perf): add pipeline instrumentation and feature gated NVTX markers (#6746) · 82794761
  Biswa Panda authored Mar 23, 2026
  
  82794761
17 Mar, 2026 5 commits
- chore(kv-router): drop easy llm facade reexports (#7474) · 45be2fdc
  Yan Ru Pei authored Mar 17, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  45be2fdc
- feat(kv-router): plumb medium into worker-side placements (#7462) · e811db50
  Yan Ru Pei authored Mar 17, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  e811db50
- feat: Concurrent KV event consumer (#7293) · 7ff5e0be
  jthomson04 authored Mar 17, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  7ff5e0be
- fix: Improve active sequences request expiration (#7340) · 1e261dbd
  blarson-b10 authored Mar 16, 2026
```
Signed-off-by: Brian Larson <brian.larson@baseten.co>
```
  1e261dbd
- feat: Enable EPP worker discovery mode (#6592) · a441aaf8
  atchernych authored Mar 16, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  a441aaf8
14 Mar, 2026 1 commit
- feat: standalone KV indexer runtime integration (#7295) · bba70a41
  Thomas Montfort authored Mar 14, 2026
  
  bba70a41
13 Mar, 2026 1 commit
- feat(kv-router): pluggable scheduling policy for router queue [DYN-2454] (#7260) · bddaaa26
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  bddaaa26
12 Mar, 2026 1 commit
- feat(kv-router): add worker_type to router selection log (#7258) · dcbccbcd
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  dcbccbcd
11 Mar, 2026 2 commits

feat: follow up of optinal, batching-of-client-side-events (#6741) · fca0a801

Michael Feil authored Mar 11, 2026

Signed-off-by: michaelfeil <63565275+michaelfeil@users.noreply.github.com>
Signed-off-by: Michael Feil <michaelfeil@users.noreply.github.com>
Signed-off-by: Michael Feil <63565275+michaelfeil@users.noreply.github.com>

fca0a801

feat: GlobalPlanner --max-total-gpus for cluster-wide GPU budget (#7103) · 5d5fd243

daiyaanarfeen authored Mar 11, 2026


Signed-off-by: Daiyaan <darfeen@nvidia.com>
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Signed-off-by: Anish <80174047+athreesh@users.noreply.github.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-authored-by: athreesh <anish.maddipoti@utexas.edu>
Co-authored-by: Anish <80174047+athreesh@users.noreply.github.com>

5d5fd243

09 Mar, 2026 2 commits
- feat(kv-router): P2P recovery for standalone KV indexer [DYN-2367] (#6934) · 48eb52e7
  Yan Ru Pei authored Mar 09, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  48eb52e7
- fix(prefill-router): pass preselected_worker in sync prefill fallback path (#7055) · e96f71ba
  Yan Ru Pei authored Mar 09, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  e96f71ba