Commits · 930721c8c93a6473447b846d6cc5833caf4301f6 · OpenDAS / dynamo

17 Mar, 2026 1 commit

feat(mocker): add SGLang engine simulation (#6977) · 930721c8

Yongming Ding authored Mar 17, 2026


Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

930721c8

13 Mar, 2026 2 commits
- feat(mocker): add --decode-speedup-ratio for speculative decoding simulation (#7349) · 7e07495f
  Yan Ru Pei authored Mar 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7e07495f
- feat(kv-router): pluggable scheduling policy for router queue [DYN-2454] (#7260) · bddaaa26
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  bddaaa26
12 Mar, 2026 2 commits
- feat(kv-router): add worker_type to router selection log (#7258) · dcbccbcd
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  dcbccbcd
- feat(kv-router): ZMQ gap detection + replay for standalone indexer [LLM-126] (#7209) · bb07b2f4
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  bb07b2f4
10 Mar, 2026 1 commit
- fix(mocker): align vLLM scheduler with v1 — drop watermark, LIFO preemption, retry loop (#7020) · 236cb17d
  Yan Ru Pei authored Mar 10, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  236cb17d
06 Mar, 2026 2 commits
- chore(kv-router): move benches to lib/bench to break circular dep [OPS-3752] (#7013) · 2e29620d
  Yan Ru Pei authored Mar 06, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  2e29620d
- fix: llm/mocker: Remove the llm -> mocker crate dependency, move config (#6998) · abc02c68
  Graham King authored Mar 06, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  abc02c68
28 Feb, 2026 1 commit
- feat(kv-router): add ActiveSequences benchmark and extract common bench utils (#6633) · e5850e23
  Yan Ru Pei authored Feb 27, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  e5850e23
25 Feb, 2026 2 commits
- feat(mocker): add KV cache transfer latency for disagg serving (#6504) · 5d958623
  Yongming Ding authored Feb 24, 2026
```
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
```
  5d958623
- feat: add ZMQ KV event publishing to mocker [DYN-2221] (#6528) · 65dc451d
  Yan Ru Pei authored Feb 24, 2026
```
Signed-off-by: Ru Pei <rupei@nvidia.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  65dc451d
20 Feb, 2026 1 commit
- refactor(mocker): modularize into common/scheduler/kv_manager/cache (#6440) · 9b2e8f3d
  Yongming Ding authored Feb 20, 2026
```
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
```
  9b2e8f3d
15 Feb, 2026 1 commit

feat: speculative prefill (#6230) · 4ede59a2

Yan Ru Pei authored Feb 15, 2026


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Janelle Cai <jcai18@mit.edu>

4ede59a2

13 Feb, 2026 3 commits
- chore: allow frontend + mockers to run on macos (#6282) · e30696e5
  Yan Ru Pei authored Feb 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  e30696e5
- chore: more mocker rusty cleanups (#6271) · 5a3c52ab
  Yan Ru Pei authored Feb 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  5a3c52ab
- feat(mocker): improve mocker's perf timing accuracy (#6100) · 2d517e77
  Yongming Ding authored Feb 12, 2026
```
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
```
  2d517e77
12 Feb, 2026 1 commit
- feat(mocker): enable KV cache trace for decode workers (#6207) · 373b8ffb
  Yongming Ding authored Feb 12, 2026
```
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
```
  373b8ffb
07 Feb, 2026 1 commit
- feat(mocker): add optional KV cache allocation/eviction trace (#6052) · 7c25f702
  Yongming Ding authored Feb 06, 2026
```
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
```
  7c25f702
06 Feb, 2026 1 commit
- chore: clean ups in kv_router.rs (#6028) · 9e33e3fa
  Yan Ru Pei authored Feb 06, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  9e33e3fa
05 Feb, 2026 1 commit
- chore: make mocker it's own crate (#5958) · 91fb78cd
  Yan Ru Pei authored Feb 05, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  91fb78cd