Commits · d1a94558847bb7fff1ab313d5eeb3a903281cc62 · OpenDAS / dynamo

"fern/pages/backends/vllm/prometheus.md" did not exist on "f4cd71f388d2490bb14b4e3701fead85ac8d4e94"

10 Apr, 2026 3 commits
- fix: recovery etc order, full recovery, thundering herd on same worker ids in same order. (#8016) · 6b75d6b0
  Michael Feil authored Apr 10, 2026
```
Signed-off-by: michaelfeil <63565275+michaelfeil@users.noreply.github.com>
```
  6b75d6b0
- fix: prevent KV block leak from cancel during disagg KV transfer (#7489) · 9055b2d3
  Yuewei Na authored Apr 09, 2026
```
Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>
```
  9055b2d3
- fix: add worker dump throtteling (#8013) · 859bd6ea
  Michael Feil authored Apr 09, 2026
```
Signed-off-by: michaelfeil <63565275+michaelfeil@users.noreply.github.com>
```
  859bd6ea
09 Apr, 2026 5 commits
- fix(llm): preserve unresolved dp rank routing (#8000) · b579a772
  Yan Ru Pei authored Apr 09, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b579a772
- fix(kv-router): coalesce worker recovery dumps (#8021) · f3d3a8b3
  Yan Ru Pei authored Apr 09, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f3d3a8b3
- perf: avoid cloning content parts in gather_multi_modal_data (#8009) · f49df565
  KrishnanPrash authored Apr 08, 2026
  
  f49df565
- feat(kv-router): add dedup filter for duplicate vLLM KV block events (#8012) · 9b3e9249
  jthomson04 authored Apr 08, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  9b3e9249
- fix(llm): log routing input hashes for replay debug (#8017) · e45bb0fe
  Yan Ru Pei authored Apr 08, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  e45bb0fe
08 Apr, 2026 8 commits
- feat: adding kvbm-engine (#6773) · 008683d6
  Ryan Olson authored Apr 08, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  008683d6
- fix: tool call loss under speculative decoding (#7768) · f69580b0
  Oleg Zhelezniak authored Apr 08, 2026
```
Signed-off-by: jellysnack <oleg.jellysnack@gmail.com>
```
  f69580b0
- feat(kvbm): add MLA support for DeepSeek-V2 and extend determinism tests (#7786) · ba34f131
  Olga Andreeva authored Apr 08, 2026
```
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-authored-by: wz1qqx <ziqi.wang@novita.ai>
```
  ba34f131
- refactor(3/3): switch dynamo-protocols to upstream async-openai types (#7625) · fd5cc288
  ishandhanani authored Apr 08, 2026
```
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  fd5cc288
- test(router): cover round-robin unset dp-rank flow (#7991) · c09abf7d
  Yan Ru Pei authored Apr 08, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  c09abf7d
- fix: dp_rank always 0 in non-KV router mode (#7984) · a210efa6
  ishandhanani authored Apr 08, 2026
  
  a210efa6
- feat(kv-router): split Dynamo-native remote indexer [DYN-2593] (#7973) · 49eb397a
  Yan Ru Pei authored Apr 07, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  49eb397a
- fix(migration): disable migration for guided-decoding requests (#7930) · c53ef736
  MatejKosec authored Apr 07, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  c53ef736
07 Apr, 2026 6 commits
- feat: add I2I (image-to-image) support for SGLang diffusion backend (#7870) · 225dad4d
  KrishnanPrash authored Apr 07, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  225dad4d
- test: e2e JSONL log verification for request tracing (#7817) · 73f8557a
  Neelay Shah authored Apr 07, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  73f8557a
- fix: call inflight.mark_error() in media handler error paths (#7917) · a27475de
  MatejKosec authored Apr 07, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  a27475de
- chore: bump vLLM to 0.19.0 (#7894) · d5803cbe
  Alec authored Apr 07, 2026
  
  d5803cbe
- feat: Request Rejection Frontend metrics (#7644) · 3205e7db
  Jacky authored Apr 06, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  3205e7db
- fix(parsers): parallel XML/JSON tool calls no longer drop N-1 of N calls (#7914) · 91700375
  MatejKosec authored Apr 06, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  91700375
06 Apr, 2026 6 commits
- perf(multimodal): strip inline base64 from TCP transport in frontend decoding (#7895) · 6b8545fc
  Qi Wang authored Apr 06, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  6b8545fc
- fix: latch busy load until both cool off (#7912) · ffe20629
  Yan Ru Pei authored Apr 06, 2026
```
Signed-off-by: AmeenP <ameenp360@gmail.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: AmeenP <ameenp360@gmail.com>
```
  ffe20629
- chore(replay): refactor offline components into cleaner lanes (#7866) · 95a750f4
  Yan Ru Pei authored Apr 06, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  95a750f4
- fix(sglang): use incremental streaming output for completions (#7752) · b2cafb7f
  weireweire authored Apr 07, 2026
```
Signed-off-by: Weiliangl User <weiliangl@login-node.hosted.internal>
Co-authored-by: Weiliangl User <weiliangl@login-node.hosted.internal>
```
  b2cafb7f
- feat(kvbm): KVBM MLA support optimization (#7015) · 1caf6659
  Aniket Kulkarni authored Apr 06, 2026
```
Signed-off-by: aknvda <anikkulkarni@nvidia.com>
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: jthomson04 <jwillthomson19@gmail.com>
```
  1caf6659
- chore: Missed cleanup, delete batch mode (#7873) · ac60a0e1
  Graham King authored Apr 06, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  ac60a0e1
04 Apr, 2026 2 commits
- fix(kv-router): migrate raw zmq paths to libzmq and refresh lockfiles (#7871) · f849e1a6
  Yan Ru Pei authored Apr 04, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f849e1a6
- fix(frontend): Kimi tokenizer fix - use absolute token ID in tiktoken reserved... · 9ad38639
  Biswa Panda authored Apr 03, 2026
```
fix(frontend): Kimi tokenizer fix - use absolute token ID in tiktoken reserved token fallback names (#7886)
```
  9ad38639
03 Apr, 2026 3 commits
- fix(kv-router): default to compressed concurrent tree (#7874) · 04e05f8c
  Yan Ru Pei authored Apr 03, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  04e05f8c
- fix: reuse elapsed duration in InflightGuard::Drop [DIS-1643] (#7869) · 63915ef5
  Neelay Shah authored Apr 03, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  63915ef5
- feat: request lifecycle logging + metrics capture [DIS-1643] (#7840) · 679d9f14
  Neelay Shah authored Apr 02, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  679d9f14
02 Apr, 2026 7 commits
- feat: enable KVBM Disk allocation support different storage types (#7839) · 234a89c0
  Ziqi Fan authored Apr 02, 2026
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  234a89c0
- refactor: unify on_response, rename request_id fields, deprecate x-dynamo-request-id (#7834) · c376655f
  Neelay Shah authored Apr 02, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  c376655f
- feat: enable DP for GAIE (#7741) · 2b906504
  atchernych authored Apr 02, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  2b906504
- feat: trace infrastructure — spans + request ID propagation [DIS-1643] (#7733) · 13058cbd
  Neelay Shah authored Apr 02, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  13058cbd
- feat: support chat_template.json as a prompt formatter artifact (#7785) · 06a24503
  Neal Vaidya authored Apr 02, 2026
```
Closes https://github.com/ai-dynamo/dynamo/issues/7737
```
  06a24503
- fix: support OpenAI content arrays in DeepSeek V3.2 prompt rendering (#6321) · 52a3ca94
  Vladislav Nosivskoy authored Apr 02, 2026
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
```
  52a3ca94
- fix: tool_choice=required bypasses format-specific parsers (#6821) (#7589) · 07af8dca
  Asad Shahid authored Apr 02, 2026
  
  07af8dca