Commits · 2e29620df14e1ef3af01ea3402f913b4da3bff2f · OpenDAS / dynamo

06 Mar, 2026 2 commits
- chore(kv-router): move benches to lib/bench to break circular dep [OPS-3752] (#7013) · 2e29620d
  Yan Ru Pei authored Mar 06, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  2e29620d
- fix: Move some router logs to DYN_LOG=debug (#6994) · ff6c3f7f
  jthomson04 authored Mar 06, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  ff6c3f7f
05 Mar, 2026 1 commit
- test(kv-router): add mid-chain removal, idempotency tests and flush_wait helpers (#6948) · dc14ce05
  Yan Ru Pei authored Mar 05, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  dc14ce05
04 Mar, 2026 2 commits
- chore(kv-router): split monolithic indexer.rs into indexer/ directory (#6870) · b94cb543
  Yan Ru Pei authored Mar 04, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  b94cb543
- feat(kv-indexer): multi-model and multi-tenant isolation (#6830) · 35f99f93
  Yan Ru Pei authored Mar 04, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  35f99f93
03 Mar, 2026 3 commits
- fix: properly setup and register vLLM worker for external / hybrid load... · 90d74637
  GuanLuo authored Mar 03, 2026
```
fix: properly setup and register vLLM worker for external / hybrid load balancing. Update launch script (#6695)
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
```
  90d74637
- fix(kv-router): plumb expected_osl through scheduler queue path (#6812) · 8055b7dd
  Yan Ru Pei authored Mar 03, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  8055b7dd
- feat(kv-router): add router queue depth Prometheus metric and nvext field (#6786) · 073fb437
  Yan Ru Pei authored Mar 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  073fb437
02 Mar, 2026 2 commits

perf(kv-router): linear scan improvements [DYN-2164] (#6363) · d24cfbe1

Yan Ru Pei authored Mar 02, 2026


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

d24cfbe1

feat: move standalone KV indexer into kv-router crate with HTTP integration tests (#6569) · 07742cc2
Yan Ru Pei authored Mar 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
07742cc2

28 Feb, 2026 2 commits
- perf: Concurrent router perf improvements (#6536) · 9e5014da
  jthomson04 authored Feb 28, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  9e5014da
- feat(kv-router): add ActiveSequences benchmark and extract common bench utils (#6633) · e5850e23
  Yan Ru Pei authored Feb 27, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  e5850e23
26 Feb, 2026 2 commits
- feat: improve mooncake_bench sweep logic and throughput accounting (#6631) · 824b456f
  Yan Ru Pei authored Feb 26, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  824b456f
- chore: move ActiveSequences to kv-router and add unit tests (#6600) · 3f99cf21
  Yan Ru Pei authored Feb 25, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  3f99cf21
25 Feb, 2026 1 commit

docs: alphabetize backends (SGLang, TensorRT-LLM, vLLM) (#6537) · e0373bd7

dagil-nvidia authored Feb 25, 2026


Signed-off-by: Dan Gil <dagil@nvidia.com>
Signed-off-by: dagil-nvidia <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>

e0373bd7

24 Feb, 2026 3 commits
- test: add tests for lora aware kv cache events and routing (#6523) · 6fab12be
  Biswa Panda authored Feb 24, 2026
  
  6fab12be
- feat: make KV cache events and routing LoRA-aware (#6517) · 75fea787
  Biswa Panda authored Feb 24, 2026
  
  75fea787
- feat: Standardized Dynamo Error Type (#6303) · c8276cd2
  Jacky authored Feb 23, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  c8276cd2
20 Feb, 2026 2 commits
- chore: cargo machete - remove unused dependencies (#6453) · 7a6283e9
  Ryan Olson authored Feb 20, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  7a6283e9
- refactor(mocker): modularize into common/scheduler/kv_manager/cache (#6440) · 9b2e8f3d
  Yongming Ding authored Feb 20, 2026
```
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
```
  9b2e8f3d
18 Feb, 2026 3 commits
- chore: gate plotters dependency behind bench feature (#6380) · cf51a0c4
  Yan Ru Pei authored Feb 18, 2026
```
Co-authored-by: Cursor <cursoragent@cursor.com>
```
  cf51a0c4
- fix: remove default-members in workspace (#6279) · aa16ccf5
  Anant Sharma authored Feb 18, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  aa16ccf5
- feat: more flash indexer optimizations (#6305) · c5c6a551
  Yan Ru Pei authored Feb 18, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
```
  c5c6a551
17 Feb, 2026 1 commit

feat: add prefix groups to rust mooncake bench (#6308) · ef2583a9

Janelle Cai authored Feb 17, 2026


Signed-off-by: Janelle Cai <jcai18@mit.edu>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>

ef2583a9

16 Feb, 2026 1 commit
- fix: local block hash consistency in mooncake bench (#6310) · e361d6fa
  Yan Ru Pei authored Feb 16, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  e361d6fa
15 Feb, 2026 1 commit

feat: speculative prefill (#6230) · 4ede59a2

Yan Ru Pei authored Feb 15, 2026


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Janelle Cai <jcai18@mit.edu>

4ede59a2

14 Feb, 2026 1 commit

feat: mm aware routing for vllm (#6235) · 815b1291

zhongdaor-nv authored Feb 13, 2026


Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com>

815b1291

13 Feb, 2026 1 commit
- chore: remove stale indexer benchmarking results (#6233) · 16a28058
  Yan Ru Pei authored Feb 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  16a28058
12 Feb, 2026 1 commit

feat: Flash Indexer (#5785) · 937398cf

Yan Ru Pei authored Feb 11, 2026


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: jthomson04 <jothomson@nvidia.com>
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Signed-off-by: Janelle Cai <jcai18@mit.edu>
Co-authored-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Janelle Cai <jcai18@mit.edu>

937398cf

04 Feb, 2026 1 commit
- test: indexer and full router benchmarks (#5784) · 039d35ff
  Janelle Cai authored Feb 04, 2026
  
  039d35ff
03 Feb, 2026 1 commit
- feat(lora): Add lora_name tracking to scheduling and sequence management (#5875) · 373e76c1
  Biswa Panda authored Feb 02, 2026
  
  373e76c1
29 Jan, 2026 1 commit
- chore: clean ups in kv-router (#5771) · fc92fc18
  Yan Ru Pei authored Jan 28, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  fc92fc18
28 Jan, 2026 1 commit
- chore: make core kv-router its own crate (#5677) · 649d9b7d
  Yan Ru Pei authored Jan 28, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  649d9b7d