Commits · 4b8826b36bbead614a344b1ba0fb26cfd8ef959c · OpenDAS / dynamo

25 Mar, 2026 2 commits

perf: Miscellaneous router perf improvements (#7477) · 1368ccd6
jthomson04 authored Mar 24, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
1368ccd6

fix: sglang eagle bigram tokens kv event report. (#6872) · 2fe37a51

huitian bai authored Mar 25, 2026


Signed-off-by: baihuitian <baihuitian.bht@gmail.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>

2fe37a51

24 Mar, 2026 1 commit
- feat(replay): add shared loadgen workload paths [DYN-2510] (#7593) · b2c59aa4
  Yan Ru Pei authored Mar 24, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b2c59aa4
23 Mar, 2026 2 commits
- test(mocker): cut replay helper sleeps (#7577) · d4e30a59
  Yan Ru Pei authored Mar 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d4e30a59
- feat(mocker): add multi-worker replay and router startup fixes (#7553) · b7fe46b1
  Yan Ru Pei authored Mar 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b7fe46b1
20 Mar, 2026 2 commits
- feat(mocker): integrate AIConfigurator for latency prediction (#7505) · 6b67c1c4
  Yongming Ding authored Mar 20, 2026
```
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  6b67c1c4
- feat(mocker): add offline trace replay mode [DYN-2502] (#7543) · c3908a36
  Yan Ru Pei authored Mar 20, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c3908a36
17 Mar, 2026 1 commit

feat(mocker): add SGLang engine simulation (#6977) · 930721c8

Yongming Ding authored Mar 17, 2026


Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

930721c8

13 Mar, 2026 2 commits
- feat(mocker): add --decode-speedup-ratio for speculative decoding simulation (#7349) · 7e07495f
  Yan Ru Pei authored Mar 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7e07495f
- feat(kv-router): pluggable scheduling policy for router queue [DYN-2454] (#7260) · bddaaa26
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  bddaaa26
12 Mar, 2026 2 commits
- feat(kv-router): add worker_type to router selection log (#7258) · dcbccbcd
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  dcbccbcd
- feat(kv-router): ZMQ gap detection + replay for standalone indexer [LLM-126] (#7209) · bb07b2f4
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  bb07b2f4
10 Mar, 2026 1 commit
- fix(mocker): align vLLM scheduler with v1 — drop watermark, LIFO preemption, retry loop (#7020) · 236cb17d
  Yan Ru Pei authored Mar 10, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  236cb17d
06 Mar, 2026 2 commits
- chore(kv-router): move benches to lib/bench to break circular dep [OPS-3752] (#7013) · 2e29620d
  Yan Ru Pei authored Mar 06, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  2e29620d
- fix: llm/mocker: Remove the llm -> mocker crate dependency, move config (#6998) · abc02c68
  Graham King authored Mar 06, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  abc02c68
28 Feb, 2026 1 commit
- feat(kv-router): add ActiveSequences benchmark and extract common bench utils (#6633) · e5850e23
  Yan Ru Pei authored Feb 27, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  e5850e23
25 Feb, 2026 2 commits
- feat(mocker): add KV cache transfer latency for disagg serving (#6504) · 5d958623
  Yongming Ding authored Feb 24, 2026
```
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
```
  5d958623
- feat: add ZMQ KV event publishing to mocker [DYN-2221] (#6528) · 65dc451d
  Yan Ru Pei authored Feb 24, 2026
```
Signed-off-by: Ru Pei <rupei@nvidia.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  65dc451d
20 Feb, 2026 1 commit
- refactor(mocker): modularize into common/scheduler/kv_manager/cache (#6440) · 9b2e8f3d
  Yongming Ding authored Feb 20, 2026
```
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
```
  9b2e8f3d
15 Feb, 2026 1 commit

feat: speculative prefill (#6230) · 4ede59a2

Yan Ru Pei authored Feb 15, 2026


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Janelle Cai <jcai18@mit.edu>

4ede59a2

13 Feb, 2026 3 commits
- chore: allow frontend + mockers to run on macos (#6282) · e30696e5
  Yan Ru Pei authored Feb 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  e30696e5
- chore: more mocker rusty cleanups (#6271) · 5a3c52ab
  Yan Ru Pei authored Feb 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  5a3c52ab
- feat(mocker): improve mocker's perf timing accuracy (#6100) · 2d517e77
  Yongming Ding authored Feb 12, 2026
```
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
```
  2d517e77
12 Feb, 2026 1 commit
- feat(mocker): enable KV cache trace for decode workers (#6207) · 373b8ffb
  Yongming Ding authored Feb 12, 2026
```
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
```
  373b8ffb
07 Feb, 2026 1 commit
- feat(mocker): add optional KV cache allocation/eviction trace (#6052) · 7c25f702
  Yongming Ding authored Feb 06, 2026
```
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
```
  7c25f702
06 Feb, 2026 1 commit
- chore: clean ups in kv_router.rs (#6028) · 9e33e3fa
  Yan Ru Pei authored Feb 06, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  9e33e3fa
05 Feb, 2026 1 commit
- chore: make mocker it's own crate (#5958) · 91fb78cd
  Yan Ru Pei authored Feb 05, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  91fb78cd