Commits · e3d00b899f0c8a417cdfc45106c94bba5e3836a3 · OpenDAS / dynamo

23 Apr, 2026 1 commit

feat: Tier-based KV Routing (#8380) · e3d00b89

jthomson04 authored Apr 23, 2026


Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

e3d00b89

15 Apr, 2026 1 commit

fix(kv-router): expose kv_cache_events_applied in multithreaded indexer (#8088) · d0d9c030

Thomas Montfort authored Apr 15, 2026


Signed-off-by: tmontfort <tmontfort@nvidia.com>
Signed-off-by: Thomas Montfort <tmontfort@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

d0d9c030

09 Apr, 2026 1 commit
- fix(kv-router): coalesce worker recovery dumps (#8021) · f3d3a8b3
  Yan Ru Pei authored Apr 09, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f3d3a8b3
08 Apr, 2026 1 commit
- feat(kv-router): split Dynamo-native remote indexer [DYN-2593] (#7973) · 49eb397a
  Yan Ru Pei authored Apr 07, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  49eb397a
03 Apr, 2026 1 commit
- fix(kv-router): default to compressed concurrent tree (#7874) · 04e05f8c
  Yan Ru Pei authored Apr 03, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  04e05f8c
25 Mar, 2026 1 commit
- feat(mocker): add offline disagg replay (#7617) · 02b1c58a
  Yan Ru Pei authored Mar 25, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  02b1c58a
28 Jan, 2026 1 commit
- chore: make core kv-router its own crate (#5677) · 649d9b7d
  Yan Ru Pei authored Jan 28, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  649d9b7d
24 Jan, 2026 1 commit
- chore: remove some clones in Indexer (#5612) · 67c868e7
  Yan Ru Pei authored Jan 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  67c868e7
23 Jan, 2026 1 commit
- chore: simplify RadixTree assuming consistent hashing across workers (#5605) · b273eda2
  Yan Ru Pei authored Jan 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b273eda2
22 Jan, 2026 1 commit
- chore: use Rc in RadixTree BFS dumpt (#5574) · 8f1ae2c5
  Yan Ru Pei authored Jan 22, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  8f1ae2c5
21 Jan, 2026 1 commit
- fix: add test for long context kv store events and fix drop issue (#5499) · fdd2d15e
  blarson-b10 authored Jan 20, 2026
```
Signed-off-by: Brian Larson <brian.larson@baseten.co>
```
  fdd2d15e
18 Jan, 2026 1 commit
- fix: remove store block recursion in favor of loop + don't try to detect loops (#5497) · d5befaab
  blarson-b10 authored Jan 17, 2026
```
Signed-off-by: Brian Larson <brian.larson@baseten.co>
```
  d5befaab
15 Jan, 2026 1 commit
- feat: [router] serve worker KV query over dynamo endpoint instead of nats (#5451) · 7ebd5f82
  Biswa Panda authored Jan 15, 2026
  
  7ebd5f82
02 Jan, 2026 1 commit
- chore: update all copyright headers in repo to 2026 (#5130) · cf433e68
  Tushar Sharma authored Jan 02, 2026
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  cf433e68
31 Dec, 2025 1 commit

fix: sglang disagg routing fixes and optimizations [DYN-1692] (#5106) · 0b33c1df

Yan Ru Pei authored Dec 31, 2025


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
Co-authored-by: Sean SH Choi <sechoi@nvidia.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

0b33c1df

19 Dec, 2025 1 commit
- feat: add multimodal support to KV router with standalone trtllm example (#4577) · 481dc636
  zhongdaor-nv authored Dec 18, 2025
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com>
```
  481dc636
17 Dec, 2025 1 commit
- fix: make gap detection work e2e (#4993) · 0fba01c2
  Yan Ru Pei authored Dec 16, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  0fba01c2
12 Dec, 2025 1 commit
- feat: support decentralized router with NATs core (#4921) · ef3027bd
  Yan Ru Pei authored Dec 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ef3027bd
11 Dec, 2025 1 commit
- feat: worker-local KvIndexer in KvEventPublisher (#4519) · 33249945
  Karen Chung authored Dec 11, 2025
```
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
```
  33249945
21 Nov, 2025 1 commit
- chore: merge KvIndexer and ApproxKvIndexer (#4500) · c61e0dd3
  Yan Ru Pei authored Nov 21, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c61e0dd3
18 Nov, 2025 1 commit

fix: guard KV-indexer against self-referential blocks (#4395) · 4f2cbec0

Vladislav Nosivskoy authored Nov 19, 2025


Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>

4f2cbec0

12 Nov, 2025 2 commits
- feat: tie break on tree size when routing (#4257) · 7d604dd3
  Yan Ru Pei authored Nov 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7d604dd3
- feat(router): max tree size based pruning (#4057) · 3ea22fcf
  Waël Boukhobza authored Nov 12, 2025
```
Signed-off-by: Wael Boukhobza <wawa_wael@live.fr>
```
  3ea22fcf
05 Nov, 2025 1 commit
- feat: remove distributed locks dependency from Router (#4113) · 1ab2fe1b
  Yan Ru Pei authored Nov 05, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1ab2fe1b
28 Oct, 2025 1 commit
- feat: mocker disagg (#3833) · cc4c3516
  Yan Ru Pei authored Oct 28, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  cc4c3516
24 Oct, 2025 1 commit

refactor: redesign the metrics API from Trait to composition to make the code... · cbe0b177

Keiven C authored Oct 24, 2025


refactor: redesign the metrics API from Trait to composition to make the code cleaner and easier to understand (#3687)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>

cbe0b177

16 Oct, 2025 1 commit
- feat: dp rank routing (#3597) · f978f4d1
  Yan Ru Pei authored Oct 15, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f978f4d1
13 Oct, 2025 1 commit
- feat: remove stale workers on snapshot + some refactoring (#3589) · b5e762b2
  Yan Ru Pei authored Oct 13, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b5e762b2
11 Oct, 2025 1 commit

chore: consolidations of KvPushRouter bindings and usage examples (#3543) · c3fcfdd6

Yan Ru Pei authored Oct 10, 2025


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

c3fcfdd6

10 Oct, 2025 1 commit
- chore: use Rc to do reference counting in Router slot manager (#3545) · 227846f2
  Yan Ru Pei authored Oct 10, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  227846f2
07 Oct, 2025 1 commit

perf: Improve performance of snapshot using a reverse lookup from block -> external hash (#3370) · 11694273

blarson-b10 authored Oct 07, 2025


Signed-off-by: Brian Larson <brian.larson@baseten.co>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>

11694273

26 Sep, 2025 1 commit

chore: bump vllm version to 0.10.2 (#3180) · 5bb74904

Alec authored Sep 26, 2025


Signed-off-by: Alec <aflowers@nvidia.com>
Signed-off-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Signed-off-by: krishung5 <krish@nvidia.com>
Co-authored-by: Kris Hung <krish@nvidia.com>

5bb74904

17 Sep, 2025 2 commits
- fix: hook up worker removals for indexer (#3095) · 78a3feda
  Yan Ru Pei authored Sep 17, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  78a3feda
- fix: purge before snapshotting (#3077) · d49fc3eb
  Yan Ru Pei authored Sep 16, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d49fc3eb
16 Sep, 2025 1 commit
- chore(llm): Remove extra license headers (#3065) · bc0a7633
  Graham King authored Sep 16, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  bc0a7633
10 Sep, 2025 1 commit
- feat: adds kv indexer metrics (#2905) · 40000976
  blarson-b10 authored Sep 10, 2025
```
Signed-off-by: Brian Larson <brian.larson@baseten.co>
```
  40000976
30 Aug, 2025 1 commit
- feat: Router warm restarts via durable KV event consumers and radix snapshotting (#2756) · 488c8709
  Yan Ru Pei authored Aug 30, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  488c8709
22 Aug, 2025 1 commit
- chore: Rust to 1.89 and edition 2024 (#2659) · bce74588
  Graham King authored Aug 22, 2025
  
  bce74588
01 Aug, 2025 1 commit
- feat: reduce / revert routing overheads, do not consider output tokens (#2182) · 66231cf0
  Yan Ru Pei authored Jul 31, 2025
  
  66231cf0
24 Jul, 2025 1 commit
- feat: dump radix tree as router events (#2057) · 2fc65ad8
  Yan Ru Pei authored Jul 24, 2025
  
  2fc65ad8