Commits · d401c1a4c5d6143a1494da2bdbf8ca7ba12ac3e9 · OpenDAS / dynamo · GitLab

22 Apr, 2026 2 commits

feat: Interface for shared kv cache handling in kv routing (#7536) · b441e26a

jthomson04 authored Apr 22, 2026

Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

b441e26a

chore(mocker): fold workload concurrency cap into WorkloadDriver (#8446) · 73e0a2f2
Yan Ru Pei authored Apr 21, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
73e0a2f2

21 Apr, 2026 1 commit
- fix(mocker): cancel replay router scheduler tasks (#8429) · 6f87f932
  Yan Ru Pei authored Apr 21, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  6f87f932
20 Apr, 2026 1 commit
- feat(planner/replay): KV reuse awareness in load + throughput scaling (#8314) · c388483a
  Hongkuan Zhou authored Apr 20, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
```
  c388483a
17 Apr, 2026 2 commits
- chore(kv-router): make sequences stop doing token math (#8260) · d94b350d
  Yan Ru Pei authored Apr 17, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d94b350d
- fix(replay/planner): planner-in-the-loop replay diagnostics + planner scaling logics fixes (#8280) · 0c7068dd
  Hongkuan Zhou authored Apr 17, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  0c7068dd
16 Apr, 2026 2 commits
- feat(replay): simulate non-zero worker startup time in offline replay (#8231) · 0bbba988
  jthomson04 authored Apr 16, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  0bbba988
- fix(replay): harden router scaling invariants (#8236) · a1e1954a
  Yan Ru Pei authored Apr 15, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  a1e1954a
15 Apr, 2026 3 commits
- fix(replay): drain traffic metrics only on throughput ticks (#8232) · b92c9593
  Hongkuan Zhou authored Apr 15, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  b92c9593
- feat(kv-router): add prompt membership index for scheduler reads (#8175) · 134d484d
  Yan Ru Pei authored Apr 15, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  134d484d
- feat(replay): planner-in-the-loop offline replay (#8187) · 89d67172
  jthomson04 authored Apr 14, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  89d67172
14 Apr, 2026 2 commits
- feat(mocker): emit forward pass metrics to event plane for planner consumption (#8032) · 4e6c3964
  jthomson04 authored Apr 13, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Signed-off-by: jthomson04 <jothomson@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  4e6c3964
- fix(kv-router): route pinned requests through scheduler (#8142) · 1142478a
  Yan Ru Pei authored Apr 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1142478a
07 Apr, 2026 1 commit
- fix(mocker): restore disagg cache reuse accounting (#7938) · d42ff092
  Yan Ru Pei authored Apr 06, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d42ff092
06 Apr, 2026 1 commit
- chore(replay): refactor offline components into cleaner lanes (#7866) · 95a750f4
  Yan Ru Pei authored Apr 06, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  95a750f4
03 Apr, 2026 1 commit
- fix(bench): replay mooncake events offline (#7876) · c08034eb
  Yan Ru Pei authored Apr 03, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c08034eb
31 Mar, 2026 1 commit
- chore(mocker): speed up replay hash hot paths (#7698) · 40768e9c
  Yan Ru Pei authored Mar 30, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  40768e9c
30 Mar, 2026 1 commit
- test(mocker): relax flaky online max-in-flight checks (#7688) · 68628976
  Yan Ru Pei authored Mar 30, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  68628976
27 Mar, 2026 1 commit
- chore(mocker): batch live output signal sends (#7647) · a2154ba5
  Yan Ru Pei authored Mar 26, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  a2154ba5
25 Mar, 2026 3 commits
- feat(mocker): add offline disagg replay (#7617) · 02b1c58a
  Yan Ru Pei authored Mar 25, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  02b1c58a
- perf: Miscellaneous router perf improvements (#7477) · 1368ccd6
  jthomson04 authored Mar 24, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  1368ccd6
- fix: sglang eagle bigram tokens kv event report. (#6872) · 2fe37a51
  huitian bai authored Mar 25, 2026
```
Signed-off-by: baihuitian <baihuitian.bht@gmail.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>
```
  2fe37a51
24 Mar, 2026 1 commit
- feat(replay): add shared loadgen workload paths [DYN-2510] (#7593) · b2c59aa4
  Yan Ru Pei authored Mar 24, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b2c59aa4
23 Mar, 2026 1 commit
- feat(mocker): add multi-worker replay and router startup fixes (#7553) · b7fe46b1
  Yan Ru Pei authored Mar 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b7fe46b1