Commits · b2cafb7feb3f2fc5c3ee0a868b3b2a3f9c0f29b9 · OpenDAS / dynamo

"lib/runtime/src/metrics_server.rs" did not exist on "f10e44cae9f4dc8f4e8f16e7b455b5214a037601"

06 Apr, 2026 4 commits
- fix(sglang): use incremental streaming output for completions (#7752) · b2cafb7f
  weireweire authored Apr 07, 2026
```
Signed-off-by: Weiliangl User <weiliangl@login-node.hosted.internal>
Co-authored-by: Weiliangl User <weiliangl@login-node.hosted.internal>
```
  b2cafb7f
- fix: Handle anyOf/oneOf parameter schemas in Qwen3Coder tool parser (#7847) · 0ba80f6a
  Neal Vaidya authored Apr 06, 2026
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
```
  0ba80f6a
- feat(kvbm): KVBM MLA support optimization (#7015) · 1caf6659
  Aniket Kulkarni authored Apr 06, 2026
```
Signed-off-by: aknvda <anikkulkarni@nvidia.com>
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: jthomson04 <jwillthomson19@gmail.com>
```
  1caf6659
- chore: Missed cleanup, delete batch mode (#7873) · ac60a0e1
  Graham King authored Apr 06, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  ac60a0e1
04 Apr, 2026 2 commits
- fix(kv-router): migrate raw zmq paths to libzmq and refresh lockfiles (#7871) · f849e1a6
  Yan Ru Pei authored Apr 04, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f849e1a6
- fix(frontend): Kimi tokenizer fix - use absolute token ID in tiktoken reserved... · 9ad38639
  Biswa Panda authored Apr 03, 2026
```
fix(frontend): Kimi tokenizer fix - use absolute token ID in tiktoken reserved token fallback names (#7886)
```
  9ad38639
03 Apr, 2026 6 commits
- fix(bench): replay mooncake events offline (#7876) · c08034eb
  Yan Ru Pei authored Apr 03, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c08034eb
- fix(kv-router): default to compressed concurrent tree (#7874) · 04e05f8c
  Yan Ru Pei authored Apr 03, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  04e05f8c
- fix: reuse elapsed duration in InflightGuard::Drop [DIS-1643] (#7869) · 63915ef5
  Neelay Shah authored Apr 03, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  63915ef5
- fix(kv-router): clean up watermarks on worker deregister (#7863) · 4cf04338
  doujiang24 authored Apr 04, 2026
```
Signed-off-by: zhudejiang.pt <zhudejiang.pt@antgroup.com>
```
  4cf04338
- chore(replay-optimize): quiet the sweep chatter (#7838) · 38b99369
  Yan Ru Pei authored Apr 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  38b99369
- feat: request lifecycle logging + metrics capture [DIS-1643] (#7840) · 679d9f14
  Neelay Shah authored Apr 02, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  679d9f14
02 Apr, 2026 14 commits
- feat: enable KVBM Disk allocation support different storage types (#7839) · 234a89c0
  Ziqi Fan authored Apr 02, 2026
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  234a89c0
- refactor: unify on_response, rename request_id fields, deprecate x-dynamo-request-id (#7834) · c376655f
  Neelay Shah authored Apr 02, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  c376655f
- feat: enable DP for GAIE (#7741) · 2b906504
  atchernych authored Apr 02, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  2b906504
- refactor(kv-router): tidy indexer test query helpers (#7801) · 1f10ba55
  Yan Ru Pei authored Apr 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1f10ba55
- feat: trace infrastructure — spans + request ID propagation [DIS-1643] (#7733) · 13058cbd
  Neelay Shah authored Apr 02, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  13058cbd
- feat: support chat_template.json as a prompt formatter artifact (#7785) · 06a24503
  Neal Vaidya authored Apr 02, 2026
```
Closes https://github.com/ai-dynamo/dynamo/issues/7737
```
  06a24503
- fix: support OpenAI content arrays in DeepSeek V3.2 prompt rendering (#6321) · 52a3ca94
  Vladislav Nosivskoy authored Apr 02, 2026
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
```
  52a3ca94
- feat(replay): add agg/disagg offline replay optimization [DYN-2566] (#7774) · 4ea21079
  Yan Ru Pei authored Apr 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  4ea21079
- fix(kv-router): compressed tree sizes accounting (#7800) · b55277c9
  Yan Ru Pei authored Apr 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b55277c9
- fix(kv-router): lazily register workers in slot tracker (#7795) · 1bbdff2d
  ishandhanani authored Apr 02, 2026
  
  1bbdff2d
- fix: tool_choice=required bypasses format-specific parsers (#6821) (#7589) · 07af8dca
  Asad Shahid authored Apr 02, 2026
  
  07af8dca
- fix: simplify GMS layout state and harden GPU-backed flows (#7006) · 91a8c6af
  Schwinn Saereesitthipitak authored Apr 01, 2026
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Co-authored-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
```
  91a8c6af
- refactor(protocols): deprecate cache control (#7790) · c09ac697
  ishandhanani authored Apr 01, 2026
  
  c09ac697
- fix(llm): retry worker-local ZMQ subscriber startup (#7788) · abd0ba5d
  Yan Ru Pei authored Apr 01, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  abd0ba5d
01 Apr, 2026 6 commits
- refactor(2/3): rename dynamo-async-openai to dynamo-protocols (#7565) · b6a3b0c6
  ishandhanani authored Apr 01, 2026
  
  b6a3b0c6
- feat: unified internal request representation for lossless API conversion (#7202) · 3bfee568
  MatejKosec authored Apr 01, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
Signed-off-by: Marko Kosec <mkosec@nvidia.com>
```
  3bfee568
- test(planner): isolate planner-family suites [DYN-2534] (#7723) · ab5a31b5
  Alec authored Mar 31, 2026
  
  ab5a31b5
- feat: add least-loaded router (#6314) · cc22114d
  kornelcsernai-harmonic authored Mar 31, 2026
```
Signed-off-by: Kornel Csernai <239206175+kornelcsernai-harmonic@users.noreply.github.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>
```
  cc22114d
- fix(backend): Reject conflicting model registrations on the same endpoint (#7686) · 21ba0c4b
  Graham King authored Mar 31, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  21ba0c4b
- fix: Flaky cuda event test (#7747) · e5e65b58
  jthomson04 authored Mar 31, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  e5e65b58
31 Mar, 2026 8 commits
- feat: add initial audio/TTS pipeline support for vLLM-omni backend (#7495) · cbbde3d0
  Zhongdongming Dai authored Mar 31, 2026
```
Signed-off-by: Zhongdongming Dai <zhongdongmin@nvidia.com>
```
  cbbde3d0
- fix: allow having no rust tokenizer when using dyn-chat-processor vllm (#7697) · 76c70f41
  Neal Vaidya authored Mar 31, 2026
  
  76c70f41
- test: split replay tests into a package (#7731) · 75c16393
  Yan Ru Pei authored Mar 31, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  75c16393
- fix: strip null bytes before tokenization to prevent false positive prompt... · 023a299c
  Albert Cheng authored Mar 31, 2026
```
fix: strip null bytes before tokenization to prevent false positive prompt rejection due to Rust/Python tokenizer divergence (#7694)
Signed-off-by: Albert Cheng (Engrg-Hardware 1) <albecheng@login-lyris01.lyris.clusters.nvidia.com>
Co-authored-by: Albert Cheng (Engrg-Hardware 1) <albecheng@login-lyris01.lyris.clusters.nvidia.com>
```
  023a299c
- test(replay): compare offline replay against AIC static point (#7729) · c4ef45bb
  Yan Ru Pei authored Mar 31, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c4ef45bb
- fix: Fix race condition in epp prefill (#7530) · 457db719
  atchernych authored Mar 31, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  457db719
- feat: Add standardized Dynamo error types as Python exceptions (#7136) · 8ff0b6e7
  Tanmay Verma authored Mar 31, 2026
  
  8ff0b6e7
- chore(mocker): speed up replay hash hot paths (#7698) · 40768e9c
  Yan Ru Pei authored Mar 30, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  40768e9c