Commits · b6a3b0c6629906b2c84723593ba4eb141e9bd6e8 · OpenDAS / dynamo · GitLab

01 Apr, 2026 6 commits
- refactor(2/3): rename dynamo-async-openai to dynamo-protocols (#7565) · b6a3b0c6
  ishandhanani authored Apr 01, 2026
  
  b6a3b0c6
- feat: unified internal request representation for lossless API conversion (#7202) · 3bfee568
  MatejKosec authored Apr 01, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
Signed-off-by: Marko Kosec <mkosec@nvidia.com>
```
  3bfee568
- test(planner): isolate planner-family suites [DYN-2534] (#7723) · ab5a31b5
  Alec authored Mar 31, 2026
  
  ab5a31b5
- feat: add least-loaded router (#6314) · cc22114d
  kornelcsernai-harmonic authored Mar 31, 2026
```
Signed-off-by: Kornel Csernai <239206175+kornelcsernai-harmonic@users.noreply.github.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>
```
  cc22114d
- fix(backend): Reject conflicting model registrations on the same endpoint (#7686) · 21ba0c4b
  Graham King authored Mar 31, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  21ba0c4b
- fix: Flaky cuda event test (#7747) · e5e65b58
  jthomson04 authored Mar 31, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  e5e65b58
31 Mar, 2026 8 commits
- feat: add initial audio/TTS pipeline support for vLLM-omni backend (#7495) · cbbde3d0
  Zhongdongming Dai authored Mar 31, 2026
```
Signed-off-by: Zhongdongming Dai <zhongdongmin@nvidia.com>
```
  cbbde3d0
- fix: allow having no rust tokenizer when using dyn-chat-processor vllm (#7697) · 76c70f41
  Neal Vaidya authored Mar 31, 2026
  
  76c70f41
- test: split replay tests into a package (#7731) · 75c16393
  Yan Ru Pei authored Mar 31, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  75c16393
- fix: strip null bytes before tokenization to prevent false positive prompt... · 023a299c
  Albert Cheng authored Mar 31, 2026
```
fix: strip null bytes before tokenization to prevent false positive prompt rejection due to Rust/Python tokenizer divergence (#7694)
Signed-off-by: Albert Cheng (Engrg-Hardware 1) <albecheng@login-lyris01.lyris.clusters.nvidia.com>
Co-authored-by: Albert Cheng (Engrg-Hardware 1) <albecheng@login-lyris01.lyris.clusters.nvidia.com>
```
  023a299c
- test(replay): compare offline replay against AIC static point (#7729) · c4ef45bb
  Yan Ru Pei authored Mar 31, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c4ef45bb
- fix: Fix race condition in epp prefill (#7530) · 457db719
  atchernych authored Mar 31, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  457db719
- feat: Add standardized Dynamo error types as Python exceptions (#7136) · 8ff0b6e7
  Tanmay Verma authored Mar 31, 2026
  
  8ff0b6e7
- chore(mocker): speed up replay hash hot paths (#7698) · 40768e9c
  Yan Ru Pei authored Mar 30, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  40768e9c
30 Mar, 2026 7 commits
- test(mocker): relax flaky online max-in-flight checks (#7688) · 68628976
  Yan Ru Pei authored Mar 30, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  68628976
- docs(crates): add readmes for mocker and kv-router [DYN-2456] (#7687) · db54ca2f
  Yan Ru Pei authored Mar 30, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  db54ca2f
- fix: Anthropic streaming double-parsing + reasoning_content roundtrip (#7358) · f0d3ce63
  MatejKosec authored Mar 30, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  f0d3ce63
- refactor(1/3): move `nvext` to `dynamo-llm` and move `anthropic` to `dynamo-async-openai` (#7564) · 2887cd1c
  ishandhanani authored Mar 30, 2026
  
  2887cd1c
- feat(runtime): scope MDC checksum validation to per-WorkerSet (#7368) · d6136f4a
  Thomas Montfort authored Mar 30, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  d6136f4a
- fix: make sleep/wake errors fatal in failover mode and correct RO memory accounting (#7681) · a565f105
  mohammedabdulwahhab authored Mar 30, 2026
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  a565f105
- fix: downgrade noisy tool parser INFO logs to DEBUG (#7573) · 64c6eb66
  Ameen Patel authored Mar 30, 2026
```
Signed-off-by: AmeenP <ameenp360@gmail.com>
```
  64c6eb66
27 Mar, 2026 1 commit
- chore(mocker): batch live output signal sends (#7647) · a2154ba5
  Yan Ru Pei authored Mar 26, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  a2154ba5
26 Mar, 2026 1 commit
- refactor: load planner using new forwardpass metric and many improvements (#7351) · a58bcc31
  Hongkuan Zhou authored Mar 25, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  a58bcc31
25 Mar, 2026 8 commits
- feat(mocker): add offline disagg replay (#7617) · 02b1c58a
  Yan Ru Pei authored Mar 25, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  02b1c58a
- feat(sglang): disagg DP rank routing + backwards-compatible network imports (#6736) · 7edb07b5
  ishandhanani authored Mar 25, 2026
```
Co-authored-by: huitian bai <baihuitian.bht@gmail.com>
```
  7edb07b5
- fix: strip tools from chat template when tool_choice=none (#7391) · 14a6122e
  Yifan Jiang authored Mar 24, 2026
```
Signed-off-by: Yifan Jiang <19356972+yifjiang@users.noreply.github.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  14a6122e
- perf: Miscellaneous router perf improvements (#7477) · 1368ccd6
  jthomson04 authored Mar 24, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  1368ccd6
- fix(frontend): carry forward real stream metadata in JailedStream finalization (#7608) · 0adfd98d
  vvagias authored Mar 24, 2026
  
  0adfd98d
- feat: add power-of-two-choices router mode (#7614) · db49dfd2
  Aaron Batilo authored Mar 24, 2026
```
Signed-off-by: Aaron Batilo <abatilo@coreweave.com>
```
  db49dfd2
- fix: sglang eagle bigram tokens kv event report. (#6872) · 2fe37a51
  huitian bai authored Mar 25, 2026
```
Signed-off-by: baihuitian <baihuitian.bht@gmail.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>
```
  2fe37a51
- fix: Request Rejection busy signal passage (#7615) · db79f324
  Jacky authored Mar 24, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  db79f324
24 Mar, 2026 6 commits
- feat(perf): add frontend performance sweep runner with full observability (#6749) · 01bf7170
  Biswa Panda authored Mar 24, 2026
  
  01bf7170
- chore(kv-router): share recovery cursor state (#7596) · 7389a369
  Yan Ru Pei authored Mar 24, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7389a369
- feat(router): add best_worker indexer update flag (#7603) · 149bf5a2
  Yan Ru Pei authored Mar 24, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  149bf5a2
- feat(vllm): elastic EP scaling — ray.nodes() patch, scale_elastic_ep route,... · daa4fb04
  Tzu-Ling Kan authored Mar 24, 2026
```
feat(vllm): elastic EP scaling — ray.nodes() patch, scale_elastic_ep route, null-tolerant discovery (#7481)
Signed-off-by: tzulingk <tzulingk@nvidia.com>
```
  daa4fb04
- fix(replay): resolve planner_profile_data directory (#7586) · 16bca7b6
  Yongming Ding authored Mar 24, 2026
```
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
```
  16bca7b6
- feat(replay): add shared loadgen workload paths [DYN-2510] (#7593) · b2c59aa4
  Yan Ru Pei authored Mar 24, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b2c59aa4
23 Mar, 2026 3 commits
- fix: Don't double-count duplicate store events in the tree size. (#7549) · 52382c91
  jthomson04 authored Mar 23, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  52382c91
- test(mocker): cut replay helper sleeps (#7577) · d4e30a59
  Yan Ru Pei authored Mar 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d4e30a59
- feat(gms): e2e failover support for vLLM (#6818) · 1c65a588
  mohammedabdulwahhab authored Mar 23, 2026
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  1c65a588