Commits · e811db503ae48beeb029cf73a2d5953b52bc8176 · OpenDAS / dynamo

17 Mar, 2026 6 commits
- feat(kv-router): plumb medium into worker-side placements (#7462) · e811db50
  Yan Ru Pei authored Mar 17, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  e811db50
- chore(kv-router): drop naive bench indexers (#7447) · a800515d
  Yan Ru Pei authored Mar 17, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  a800515d
- feat: Concurrent KV event consumer (#7293) · 7ff5e0be
  jthomson04 authored Mar 17, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  7ff5e0be
- fix(kv-router): recover initial standalone-indexer ZMQ gaps (#7463) · 0f8e1a9e
  Yan Ru Pei authored Mar 17, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  0f8e1a9e
- fix: Improve active sequences request expiration (#7340) · 1e261dbd
  blarson-b10 authored Mar 16, 2026
```
Signed-off-by: Brian Larson <brian.larson@baseten.co>
```
  1e261dbd
- feat: Enable EPP worker discovery mode (#6592) · a441aaf8
  atchernych authored Mar 16, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  a441aaf8
15 Mar, 2026 2 commits
- feat(kv-indexer): add python launcher follow-up [DYN-2459] (#7395) · 56b448a6
  Yan Ru Pei authored Mar 15, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  56b448a6
- chore(kv-router): remove native kv-indexer binary, use maturin-built one (#7338) · b6596c52
  Yan Ru Pei authored Mar 15, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b6596c52
14 Mar, 2026 1 commit
- feat: standalone KV indexer runtime integration (#7295) · bba70a41
  Thomas Montfort authored Mar 14, 2026
  
  bba70a41
13 Mar, 2026 4 commits
- test(kv-router): use flush-and-settle helper in indexer tests (#7347) · cb9b1cd5
  Yan Ru Pei authored Mar 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  cb9b1cd5
- feat(kv-router): add Prometheus metrics to standalone indexer (#7339) · 5aa2f53f
  Yan Ru Pei authored Mar 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  5aa2f53f
- feat(kv-router): pluggable scheduling policy for router queue [DYN-2454] (#7260) · bddaaa26
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  bddaaa26
- fix: cancellation kv commit router (#7178) · d170d56a
  Michael Feil authored Mar 12, 2026
```
Signed-off-by: michaelfeil <63565275+michaelfeil@users.noreply.github.com>
```
  d170d56a
12 Mar, 2026 3 commits
- feat(kv-router): add worker_type to router selection log (#7258) · dcbccbcd
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  dcbccbcd
- feat(kv-router): package dynamo-kv-indexer binary via maturin [LLM-126] (#7194) · f80ad692
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f80ad692
- feat(kv-router): ZMQ gap detection + replay for standalone indexer [LLM-126] (#7209) · bb07b2f4
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  bb07b2f4
09 Mar, 2026 1 commit
- feat(kv-router): P2P recovery for standalone KV indexer [DYN-2367] (#6934) · 48eb52e7
  Yan Ru Pei authored Mar 09, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  48eb52e7
06 Mar, 2026 2 commits
- chore(kv-router): move benches to lib/bench to break circular dep [OPS-3752] (#7013) · 2e29620d
  Yan Ru Pei authored Mar 06, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  2e29620d
- fix: Move some router logs to DYN_LOG=debug (#6994) · ff6c3f7f
  jthomson04 authored Mar 06, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  ff6c3f7f
05 Mar, 2026 1 commit
- test(kv-router): add mid-chain removal, idempotency tests and flush_wait helpers (#6948) · dc14ce05
  Yan Ru Pei authored Mar 05, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  dc14ce05
04 Mar, 2026 2 commits
- chore(kv-router): split monolithic indexer.rs into indexer/ directory (#6870) · b94cb543
  Yan Ru Pei authored Mar 04, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  b94cb543
- feat(kv-indexer): multi-model and multi-tenant isolation (#6830) · 35f99f93
  Yan Ru Pei authored Mar 04, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  35f99f93
03 Mar, 2026 3 commits
- fix: properly setup and register vLLM worker for external / hybrid load... · 90d74637
  GuanLuo authored Mar 03, 2026
```
fix: properly setup and register vLLM worker for external / hybrid load balancing. Update launch script (#6695)
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
```
  90d74637
- fix(kv-router): plumb expected_osl through scheduler queue path (#6812) · 8055b7dd
  Yan Ru Pei authored Mar 03, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  8055b7dd
- feat(kv-router): add router queue depth Prometheus metric and nvext field (#6786) · 073fb437
  Yan Ru Pei authored Mar 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  073fb437
02 Mar, 2026 2 commits

perf(kv-router): linear scan improvements [DYN-2164] (#6363) · d24cfbe1

Yan Ru Pei authored Mar 02, 2026


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

d24cfbe1

feat: move standalone KV indexer into kv-router crate with HTTP integration tests (#6569) · 07742cc2
Yan Ru Pei authored Mar 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
07742cc2

28 Feb, 2026 2 commits
- perf: Concurrent router perf improvements (#6536) · 9e5014da
  jthomson04 authored Feb 28, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  9e5014da
- feat(kv-router): add ActiveSequences benchmark and extract common bench utils (#6633) · e5850e23
  Yan Ru Pei authored Feb 27, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  e5850e23
26 Feb, 2026 2 commits
- feat: improve mooncake_bench sweep logic and throughput accounting (#6631) · 824b456f
  Yan Ru Pei authored Feb 26, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  824b456f
- chore: move ActiveSequences to kv-router and add unit tests (#6600) · 3f99cf21
  Yan Ru Pei authored Feb 25, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  3f99cf21
25 Feb, 2026 1 commit

docs: alphabetize backends (SGLang, TensorRT-LLM, vLLM) (#6537) · e0373bd7

dagil-nvidia authored Feb 25, 2026


Signed-off-by: Dan Gil <dagil@nvidia.com>
Signed-off-by: dagil-nvidia <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>

e0373bd7

24 Feb, 2026 3 commits
- test: add tests for lora aware kv cache events and routing (#6523) · 6fab12be
  Biswa Panda authored Feb 24, 2026
  
  6fab12be
- feat: make KV cache events and routing LoRA-aware (#6517) · 75fea787
  Biswa Panda authored Feb 24, 2026
  
  75fea787
- feat: Standardized Dynamo Error Type (#6303) · c8276cd2
  Jacky authored Feb 23, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  c8276cd2
20 Feb, 2026 2 commits
- chore: cargo machete - remove unused dependencies (#6453) · 7a6283e9
  Ryan Olson authored Feb 20, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  7a6283e9
- refactor(mocker): modularize into common/scheduler/kv_manager/cache (#6440) · 9b2e8f3d
  Yongming Ding authored Feb 20, 2026
```
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
```
  9b2e8f3d
18 Feb, 2026 3 commits
- chore: gate plotters dependency behind bench feature (#6380) · cf51a0c4
  Yan Ru Pei authored Feb 18, 2026
```
Co-authored-by: Cursor <cursoragent@cursor.com>
```
  cf51a0c4
- fix: remove default-members in workspace (#6279) · aa16ccf5
  Anant Sharma authored Feb 18, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  aa16ccf5
- feat: more flash indexer optimizations (#6305) · c5c6a551
  Yan Ru Pei authored Feb 18, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
```
  c5c6a551