Commits · cc22114d7825b2be78b2790373bd47582dbae46f · OpenDAS / dynamo

01 Apr, 2026 1 commit

feat: add least-loaded router (#6314) · cc22114d

kornelcsernai-harmonic authored Mar 31, 2026


Signed-off-by: Kornel Csernai <239206175+kornelcsernai-harmonic@users.noreply.github.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>

cc22114d

31 Mar, 2026 4 commits
- test: split replay tests into a package (#7731) · 75c16393
  Yan Ru Pei authored Mar 31, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  75c16393
- test(replay): compare offline replay against AIC static point (#7729) · c4ef45bb
  Yan Ru Pei authored Mar 31, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c4ef45bb
- feat: Add standardized Dynamo error types as Python exceptions (#7136) · 8ff0b6e7
  Tanmay Verma authored Mar 31, 2026
  
  8ff0b6e7
- chore(mocker): speed up replay hash hot paths (#7698) · 40768e9c
  Yan Ru Pei authored Mar 30, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  40768e9c
27 Mar, 2026 1 commit
- chore(mocker): batch live output signal sends (#7647) · a2154ba5
  Yan Ru Pei authored Mar 26, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  a2154ba5
26 Mar, 2026 1 commit
- refactor: load planner using new forwardpass metric and many improvements (#7351) · a58bcc31
  Hongkuan Zhou authored Mar 25, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  a58bcc31
25 Mar, 2026 4 commits

feat(mocker): add offline disagg replay (#7617) · 02b1c58a
Yan Ru Pei authored Mar 25, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
02b1c58a

fix: strip tools from chat template when tool_choice=none (#7391) · 14a6122e

Yifan Jiang authored Mar 24, 2026

Signed-off-by: Yifan Jiang <19356972+yifjiang@users.noreply.github.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

14a6122e

feat: add power-of-two-choices router mode (#7614) · db49dfd2
Aaron Batilo authored Mar 24, 2026
```
Signed-off-by: Aaron Batilo <abatilo@coreweave.com>
```
db49dfd2

fix: sglang eagle bigram tokens kv event report. (#6872) · 2fe37a51

huitian bai authored Mar 25, 2026


Signed-off-by: baihuitian <baihuitian.bht@gmail.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>

2fe37a51

24 Mar, 2026 4 commits
- feat(perf): add frontend performance sweep runner with full observability (#6749) · 01bf7170
  Biswa Panda authored Mar 24, 2026
  
  01bf7170
- feat(router): add best_worker indexer update flag (#7603) · 149bf5a2
  Yan Ru Pei authored Mar 24, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  149bf5a2
- fix(replay): resolve planner_profile_data directory (#7586) · 16bca7b6
  Yongming Ding authored Mar 24, 2026
```
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
```
  16bca7b6
- feat(replay): add shared loadgen workload paths [DYN-2510] (#7593) · b2c59aa4
  Yan Ru Pei authored Mar 24, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b2c59aa4
23 Mar, 2026 5 commits
- test(mocker): cut replay helper sleeps (#7577) · d4e30a59
  Yan Ru Pei authored Mar 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d4e30a59
- feat(gms): e2e failover support for vLLM (#6818) · 1c65a588
  mohammedabdulwahhab authored Mar 23, 2026
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  1c65a588
- chore(snapshot): gms + snapshot support (#7026) · b2aefc53
  Janelle Cai authored Mar 23, 2026
```
Signed-off-by: Janelle Cai <jcai18@mit.edu>
```
  b2aefc53
- feat(mocker): add multi-worker replay and router startup fixes (#7553) · b7fe46b1
  Yan Ru Pei authored Mar 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b7fe46b1
- feat(perf): add pipeline instrumentation and feature gated NVTX markers (#6746) · 82794761
  Biswa Panda authored Mar 23, 2026
  
  82794761
20 Mar, 2026 3 commits
- feat(mocker): integrate AIConfigurator for latency prediction (#7505) · 6b67c1c4
  Yongming Ding authored Mar 20, 2026
```
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  6b67c1c4
- feat(mocker): add offline trace replay mode [DYN-2502] (#7543) · c3908a36
  Yan Ru Pei authored Mar 20, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c3908a36
- feat(llm): unify user-facing priority hints (#7492) · ebd06a1f
  Yan Ru Pei authored Mar 20, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ebd06a1f
19 Mar, 2026 2 commits
- feat: enable mypy in pre-merge (#6732) · 2712426f
  jh-nv authored Mar 19, 2026
  
  2712426f
- fix: observability fixes for OTEL tracing and logging (#7240) · 9eee5354
  jh-nv authored Mar 19, 2026
```
Signed-off-by: Jie Hao <jihao@nvidia.com>
```
  9eee5354
17 Mar, 2026 3 commits
- feat(mocker): add SGLang engine simulation (#6977) · 930721c8
  Yongming Ding authored Mar 17, 2026
```
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  930721c8
- chore(kv-router): drop easy llm facade reexports (#7474) · 45be2fdc
  Yan Ru Pei authored Mar 17, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  45be2fdc
- feat: Enable EPP worker discovery mode (#6592) · a441aaf8
  atchernych authored Mar 16, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  a441aaf8
15 Mar, 2026 3 commits
- feat: integrate fastokens BPE tokenizer backend (#7387) · da810a26
  Biswa Panda authored Mar 15, 2026
  
  da810a26
- feat(kv-indexer): add python launcher follow-up [DYN-2459] (#7395) · 56b448a6
  Yan Ru Pei authored Mar 15, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  56b448a6
- chore(kv-router): remove native kv-indexer binary, use maturin-built one (#7338) · b6596c52
  Yan Ru Pei authored Mar 15, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b6596c52
14 Mar, 2026 3 commits
- feat: standalone KV indexer runtime integration (#7295) · bba70a41
  Thomas Montfort authored Mar 14, 2026
  
  bba70a41
- feat(perf): add request-plane, transport, and work-handler metric definitions (#6735) · cec19d4d
  Biswa Panda authored Mar 14, 2026
  
  cec19d4d
- feat: propagate OTEL trace context across E/P/D multimodal workers (#7239) · c263a99e
  jh-nv authored Mar 13, 2026
  
  c263a99e
13 Mar, 2026 2 commits
- feat(kv-router): add Prometheus metrics to standalone indexer (#7339) · 5aa2f53f
  Yan Ru Pei authored Mar 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  5aa2f53f
- feat(kv-router): pluggable scheduling policy for router queue [DYN-2454] (#7260) · bddaaa26
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  bddaaa26
12 Mar, 2026 4 commits
- feat(kv-router): package dynamo-kv-indexer binary via maturin [LLM-126] (#7194) · f80ad692
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f80ad692
- feat: ForwardPassMetrics dynamo event plane integration (#7250) · cd4773fb
  Hongkuan Zhou authored Mar 12, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  cd4773fb
- test: Fix cancellation test (#7296) · 87ac404e
  Graham King authored Mar 12, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  87ac404e
- feat: replaces PersistentConnector monkey-patch with proper nixl_conn… (#6913) · 387100c8
  Daniel Socek authored Mar 11, 2026
```
Signed-off-by: Daniel Socek <daniel.socek@intel.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  387100c8