Commits · b441e26a6a288ff0fee65ce13b21a1b75268dd5a · OpenDAS / dynamo · GitLab

22 Apr, 2026 1 commit

feat: Interface for shared kv cache handling in kv routing (#7536) · b441e26a

jthomson04 authored Apr 22, 2026

Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

b441e26a

20 Apr, 2026 1 commit
- feat(planner/replay): KV reuse awareness in load + throughput scaling (#8314) · c388483a
  Hongkuan Zhou authored Apr 20, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
```
  c388483a
17 Apr, 2026 2 commits
- chore(kv-router): make sequences stop doing token math (#8260) · d94b350d
  Yan Ru Pei authored Apr 17, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d94b350d
- fix(replay/planner): planner-in-the-loop replay diagnostics + planner scaling logics fixes (#8280) · 0c7068dd
  Hongkuan Zhou authored Apr 17, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  0c7068dd
16 Apr, 2026 2 commits
- feat(replay): simulate non-zero worker startup time in offline replay (#8231) · 0bbba988
  jthomson04 authored Apr 16, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  0bbba988
- fix(replay): harden router scaling invariants (#8236) · a1e1954a
  Yan Ru Pei authored Apr 15, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  a1e1954a
15 Apr, 2026 2 commits
- feat(kv-router): add prompt membership index for scheduler reads (#8175) · 134d484d
  Yan Ru Pei authored Apr 15, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  134d484d
- feat(replay): planner-in-the-loop offline replay (#8187) · 89d67172
  jthomson04 authored Apr 14, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  89d67172
14 Apr, 2026 1 commit
- fix(kv-router): route pinned requests through scheduler (#8142) · 1142478a
  Yan Ru Pei authored Apr 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1142478a
07 Apr, 2026 1 commit
- fix(mocker): restore disagg cache reuse accounting (#7938) · d42ff092
  Yan Ru Pei authored Apr 06, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d42ff092
06 Apr, 2026 1 commit
- chore(replay): refactor offline components into cleaner lanes (#7866) · 95a750f4
  Yan Ru Pei authored Apr 06, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  95a750f4