Commits · 04f32fe226d3937cb2c811b3ac1539f88d22557b · OpenDAS / dynamo · GitLab

28 Jan, 2026 2 commits
- fix: emit first token creation signal after sleeping. (#5681) · 941ad640
  luc-hiverge authored Jan 28, 2026
```
Signed-off-by: Luc Grosheintz <luc@hiverge.ai>
```
  941ad640
- chore: make core kv-router its own crate (#5677) · 649d9b7d
  Yan Ru Pei authored Jan 28, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  649d9b7d
23 Jan, 2026 1 commit
- chore: nuke ForwardPassMetrics (#5531) · feb6d272
  Yan Ru Pei authored Jan 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  feb6d272
03 Jan, 2026 1 commit
- feat: mockers with bootstrap optimization (sglang testing) + CI test (#5121) · 0980b27f
  Yan Ru Pei authored Jan 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  0980b27f
02 Jan, 2026 1 commit
- chore: update all copyright headers in repo to 2026 (#5130) · cf433e68
  Tushar Sharma authored Jan 02, 2026
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  cf433e68
19 Dec, 2025 2 commits
- chore: clean up PreprocessedRequest (#5040) · f4245c99
  Yan Ru Pei authored Dec 19, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f4245c99
- feat: add multimodal support to KV router with standalone trtllm example (#4577) · 481dc636
  zhongdaor-nv authored Dec 18, 2025
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com>
```
  481dc636
13 Dec, 2025 1 commit
- feat: Support for field include_stop_str_in_output (#4924) · 45e881d3
  KrishnanPrash authored Dec 12, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  45e881d3
11 Dec, 2025 2 commits
- feat: worker-local KvIndexer in KvEventPublisher (#4519) · 33249945
  Karen Chung authored Dec 11, 2025
```
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
```
  33249945
- fix: worker to graceful shutdown after finishing in-flight requests (#4838) · c8845b41
  Hongkuan Zhou authored Dec 10, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
```
  c8845b41
08 Dec, 2025 1 commit
- chore: de-spaghetti mocker scheduler (#4789) · 377711d3
  Yan Ru Pei authored Dec 08, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  377711d3
03 Dec, 2025 1 commit
- test: remove redundant mocker e2e test in rust (#4720) · 77841e7b
  Yan Ru Pei authored Dec 03, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  77841e7b
21 Nov, 2025 1 commit
- chore: Make nats_client private at crate level, various tidy up (#4513) · f05f7629
  Graham King authored Nov 21, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  f05f7629
18 Nov, 2025 2 commits

feat: support prompt_tokens_details in usage (#4239) · be9d6b2b
Vladislav Nosivskoy authored Nov 19, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
```
be9d6b2b

feat: mocker can use planner profile data (#4422) · fc2ad4eb

Yan Ru Pei authored Nov 18, 2025


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

fc2ad4eb

10 Nov, 2025 1 commit
- refactor: Make the Runtime and DistributedRuntime fields private (#4193) · cf630bf7
  Graham King authored Nov 10, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  cf630bf7
28 Oct, 2025 2 commits
- feat: mocker disagg (#3833) · cc4c3516
  Yan Ru Pei authored Oct 28, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  cc4c3516
- chore(runtime): Do not expose etcd lease ID (#3915) · c78b5901
  Graham King authored Oct 28, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  c78b5901
24 Oct, 2025 1 commit
- chore: mocker states do not need arc mutex (#3883) · d870d4b0
  Yan Ru Pei authored Oct 24, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d870d4b0
23 Oct, 2025 1 commit
- chore: restructure mocker cli args handling, to include prefill/decode (#3847) · 41ff394f
  Yan Ru Pei authored Oct 23, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  41ff394f
20 Oct, 2025 1 commit
- chore: Replace ServiceConfigBuilder with add_stats_service (#3736) · f6ed01b1
  Graham King authored Oct 20, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  f6ed01b1
17 Oct, 2025 1 commit
- chore: remove kv metrics scraping and aggregation (#3701) · 4c207e0c
  Yan Ru Pei authored Oct 17, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  4c207e0c
16 Oct, 2025 1 commit
- feat: dp rank routing (#3597) · f978f4d1
  Yan Ru Pei authored Oct 15, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f978f4d1
08 Oct, 2025 1 commit
- feat: prefill routing for trtllm (#3471) · f3987f6c
  Yan Ru Pei authored Oct 08, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f3987f6c
04 Oct, 2025 1 commit
- feat: use KvPushRouter for prefill router (#3401) · 30610e73
  Yan Ru Pei authored Oct 03, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  30610e73
19 Sep, 2025 1 commit
- chore: Upgrade Rust to 1.90 (#3147) · 7a5a0bd6
  Graham King authored Sep 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  7a5a0bd6
04 Sep, 2025 1 commit
- chore: pass in mocker engine args directly in python cli + default frontend port to 8000 (#2853) · 3c7c1d64
  Yan Ru Pei authored Sep 03, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  3c7c1d64
30 Aug, 2025 1 commit
- feat: Router warm restarts via durable KV event consumers and radix snapshotting (#2756) · 488c8709
  Yan Ru Pei authored Aug 30, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  488c8709
29 Aug, 2025 1 commit
- feat: add Prometheus metrics integration for KvStats (#2704) · 15539fd0
  Keiven C authored Aug 28, 2025
```
Signed-off-by: Keiven C <213854356+keivenchang@users.noreply.github.com>
```
  15539fd0
25 Aug, 2025 1 commit
- feat: python bindings for the entire KvPushRouter + per-request router configs (#2658) · f08729ae
  Yan Ru Pei authored Aug 25, 2025
  
  f08729ae
22 Aug, 2025 2 commits
- chore: Rust to 1.89 and edition 2024 (#2659) · bce74588
  Graham King authored Aug 22, 2025
  
  bce74588
- chore(llm): Rename protocols::Endpoint to EndpointId (#2615) · 6a358f7c
  Graham King authored Aug 22, 2025
  
  6a358f7c
21 Aug, 2025 1 commit
- feat: Add model label for vllm backend metrics (#2474) · 57728909
  Tzu-Ling Kan authored Aug 21, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  57728909
19 Aug, 2025 2 commits
- feat: skip router when worker id is pre-determined (#2450) · 6bc6d400
  atchernych authored Aug 19, 2025
```
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
```
  6bc6d400
- feat: router-level request rejection (#2465) · 85d83108
  Yan Ru Pei authored Aug 19, 2025
  
  85d83108
14 Aug, 2025 1 commit
- feat: logprob handling (#2426) · f476fd74
  Greg Clark authored Aug 14, 2025
```
Signed-off-by: Greg Clark <grclark@nvidia.com>
```
  f476fd74
11 Aug, 2025 1 commit
- fix(preprocessor): Populate model ID in PreprocessedRequest (#2397) · c443528f
  Graham King authored Aug 11, 2025
  
  c443528f
28 Jul, 2025 1 commit
- feat: proper local hashes for mockers + router watches endpoints (#2132) · 803bfa81
  Yan Ru Pei authored Jul 28, 2025
  
  803bfa81
24 Jul, 2025 1 commit
- test: add router e2e test with mockers to per-merge ci (#2073) · ba3ac235
  Yan Ru Pei authored Jul 24, 2025
```
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
```
  ba3ac235
18 Jul, 2025 1 commit

feat: enable / disable chunked prefill for mockers (#2015) · e330d969

Yan Ru Pei authored Jul 18, 2025


Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

e330d969