Commits · b441e26a6a288ff0fee65ce13b21a1b75268dd5a · OpenDAS / dynamo · GitLab

22 Apr, 2026 10 commits
- feat: Interface for shared kv cache handling in kv routing (#7536) · b441e26a
  jthomson04 authored Apr 22, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
```
  b441e26a
- fix(responses): align wire shape with OpenResponses spec + add compliance CI (#8283) · 2a95ef63
  ishandhanani authored Apr 22, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
```
  2a95ef63
- fix(vllm): initialize failover flock in prefill worker (#8367) · 81819fbc
  mohammedabdulwahhab authored Apr 22, 2026
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  81819fbc
- refactor(mocker): replace vllm block manager with kvbm-logical (#8451) · 36b4208e
  Yongming Ding authored Apr 22, 2026
```
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
Co-authored-by: Ryan Olson <rolson@nvidia.com>
```
  36b4208e
- fix(runtime): reset canary health check timer on request arrival and per streaming chunk (#8467) · 1dc0975b
  Thomas Montfort authored Apr 22, 2026
```
Signed-off-by: Thomas Montfort <tmontfort@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  1dc0975b
- feat(router): branch sharded kv indexer (#7859) · 73a9a53f
  Janelle Cai authored Apr 22, 2026
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Hannah Zhang <hannahz@nvidia.com>
```
  73a9a53f
- fix: DIS-1768 emit structured SSE error + [DONE] on mid-stream fault (#8430) · f53fa64c
  Keiven C authored Apr 22, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f53fa64c
- feat: garbage collection tcp machine + read from shared place (#8420) · ffa6e84a
  Michael Feil authored Apr 21, 2026
```
Signed-off-by: michaelfeil <63565275+michaelfeil@users.noreply.github.com>
```
  ffa6e84a
- chore(mocker): fold workload concurrency cap into WorkloadDriver (#8446) · 73e0a2f2
  Yan Ru Pei authored Apr 21, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  73e0a2f2
- feat(kv-router): warn on duplicate store replays (#8473) · 4833e29b
  Yan Ru Pei authored Apr 21, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  4833e29b
21 Apr, 2026 6 commits
- fix(discovery): send ModelUpdate::Added after add_worker_set completes (#8242) · 7ffc699f
  MatejKosec authored Apr 21, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  7ffc699f
- feat(lpu): add opaque engine_data field to nvext response with per-request opt-in via extra_fields · 1c9412d2
  Biswa Panda authored Apr 21, 2026
  
  1c9412d2
- chore: upgrade modelexpress version (#8336) · 9514236c
  Nate Mailhot authored Apr 21, 2026
```
Signed-off-by: Nate Mailhot <nmailhot@nvidia.com>
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  9514236c
- feat(kv-router): add start positions to flat KV events (#8426) · 4b3cd459
  Yan Ru Pei authored Apr 21, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  4b3cd459
- fix(mocker): cancel replay router scheduler tasks (#8429) · 6f87f932
  Yan Ru Pei authored Apr 21, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  6f87f932
- chore(mocker): panic loudly on scheduler invariant violations (#8406) · f701319e
  Yan Ru Pei authored Apr 20, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f701319e
20 Apr, 2026 9 commits
- fix(parsers): recover Kimi K2 tool calls when section_end is missing (#8208) · 47cfbd46
  Keiven C authored Apr 20, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  47cfbd46
- feat: (Router) Guard threshold-based rejection logic when CLI thresholds are unset (#8333) · adfc02d5
  Karen Chung authored Apr 20, 2026
  
  adfc02d5
- fix(kv-router): allow unit block size in slot tracking (#8395) · cdb40ec6
  Yan Ru Pei authored Apr 20, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  cdb40ec6
- fix(planner): backfill max_num_batched_tokens from discovery for VirtualConnector (#8042) · 44190094
  jthomson04 authored Apr 20, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
```
  44190094
- fix(protocols): always serialize chat message content (null when absent) (#8372) · 846ce71a
  Ryan McCormick authored Apr 20, 2026
```
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
```
  846ce71a
- fix(responses): own input chain in dynamo-protocols to accept Codex/Agents-SDK shapes (#8275) · 4ef28940
  ishandhanani authored Apr 20, 2026
  
  4ef28940
- feat(planner/replay): KV reuse awareness in load + throughput scaling (#8314) · c388483a
  Hongkuan Zhou authored Apr 20, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
```
  c388483a
- feat(frontend): gate nvext response metadata behind extra_fields (#8252) · f437c8cf
  Biswa Panda authored Apr 20, 2026
```
Co-authored-by: AmeenP <ameenp360@gmail.com>
```
  f437c8cf
- feat: add staged frontend gauges (#8162) · 0c98d9a1
  Jie Hao authored Apr 20, 2026
  
  0c98d9a1
17 Apr, 2026 8 commits
- chore(kv-router): make sequences stop doing token math (#8260) · d94b350d
  Yan Ru Pei authored Apr 17, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d94b350d
- fix(health): use local endpoint registry for canary health checks (#8294) · c2ec3359
  Thomas Montfort authored Apr 17, 2026
```
Signed-off-by: Thomas Montfort <tmontfort@nvidia.com>
Signed-off-by: Thomas Montfort <tmontfort@nvidia.com>
Signed-off-by: tmontfort <tmontfort@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  c2ec3359
- fix(replay/planner): planner-in-the-loop replay diagnostics + planner scaling logics fixes (#8280) · 0c7068dd
  Hongkuan Zhou authored Apr 17, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  0c7068dd
- fix(kv-router): Increase JSON body to 8 MiB to allow 1M tokens (#8315) · 4e7c6afd
  Graham King authored Apr 17, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  4e7c6afd
- fix(discovery): address concurrency edge cases in handle_put lifecycle (#8237) · 7f40761b
  MatejKosec authored Apr 17, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  7f40761b
- perf(discovery): replace polling with Notify in concurrent registration wait (#8291) · f05cabac
  MatejKosec authored Apr 17, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  f05cabac
- fix(health): make canary sole authority on endpoint readiness when enabled (#8165) · 61d4674c
  Neelay Shah authored Apr 17, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  61d4674c
- fix(jail): preserve logprobs through tool-call jailing (#8072) · 59d18d8e
  jthomson04 authored Apr 16, 2026
```
Signed-off-by: jthomson04 <jothomson@nvidia.com>
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  59d18d8e
16 Apr, 2026 5 commits
- fix(kv-router): prune stale compressed-tree children (#8127) · 0652441f
  Yan Ru Pei authored Apr 16, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  0652441f
- fix(discovery): add missing Audios model type to is_model_type_list_empty (#8241) · 67bc6a1f
  MatejKosec authored Apr 16, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  67bc6a1f
- feat(replay): simulate non-zero worker startup time in offline replay (#8231) · 0bbba988
  jthomson04 authored Apr 16, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  0bbba988
- fix(runtime): lock-free TCP connection pool for OOM prevention and... · 6633be54
  Biswa Panda authored Apr 15, 2026
```
fix(runtime): lock-free TCP connection pool for OOM prevention and inflight/resource-leak fixes (#7806)
```
  6633be54
- fix(replay): harden router scaling invariants (#8236) · a1e1954a
  Yan Ru Pei authored Apr 15, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  a1e1954a
15 Apr, 2026 2 commits
- feat(planner): add advisory mode for scaling decisions (#8244) · 3da6f4d4
  Hongkuan Zhou authored Apr 15, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  3da6f4d4
- chore: bump dynamo version numbers (#8191) · 01a4b6d6
  Harrison Saturley-Hall authored Apr 15, 2026
  
  01a4b6d6