Commits · e3d00b899f0c8a417cdfc45106c94bba5e3836a3 · OpenDAS / dynamo

"vllm/vscode:/vscode.git/clone" did not exist on "33437bc6e7af316fa9ce6b6e559501ca45d9cd45"

23 Apr, 2026 3 commits
- feat: Tier-based KV Routing (#8380) · e3d00b89
  jthomson04 authored Apr 23, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  e3d00b89
- chore(mocker): drop the Destroy variant (#8588) · 6b452a14
  Yan Ru Pei authored Apr 22, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  6b452a14
- chore(profiler): reshape replay_optimize into DGDR-aligned Pydantic specs (#8585) · 241b254d
  Yan Ru Pei authored Apr 22, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  241b254d
22 Apr, 2026 14 commits
- fix(runtime): stop unconditional NATS connection with --discovery-backend file (#8398) · 6ba534a6
  Biswa Panda authored Apr 22, 2026
  
  6ba534a6
- fix(parsers): back-port sglang kimi-k2 tool-call and reasoning detection (#8532) · 04ea38c3
  Nikita authored Apr 23, 2026
```
Signed-off-by: Nikita Sukharev <kaonael@gmail.com>
```
  04ea38c3
- fix: Remove double tokenization in EPP Integration fixes [DYN-2076] (#8093) · a2a2753d
  atchernych authored Apr 22, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  a2a2753d
- chore: Upgrade ffmpeg to v8.1 (#8452) · 4d5db80a
  Graham King authored Apr 22, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  4d5db80a
- feat: Interface for shared kv cache handling in kv routing (#7536) · b441e26a
  jthomson04 authored Apr 22, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
```
  b441e26a
- fix(responses): align wire shape with OpenResponses spec + add compliance CI (#8283) · 2a95ef63
  ishandhanani authored Apr 22, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
```
  2a95ef63
- fix(vllm): initialize failover flock in prefill worker (#8367) · 81819fbc
  mohammedabdulwahhab authored Apr 22, 2026
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  81819fbc
- refactor(mocker): replace vllm block manager with kvbm-logical (#8451) · 36b4208e
  Yongming Ding authored Apr 22, 2026
```
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
Co-authored-by: Ryan Olson <rolson@nvidia.com>
```
  36b4208e
- fix(runtime): reset canary health check timer on request arrival and per streaming chunk (#8467) · 1dc0975b
  Thomas Montfort authored Apr 22, 2026
```
Signed-off-by: Thomas Montfort <tmontfort@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  1dc0975b
- feat(router): branch sharded kv indexer (#7859) · 73a9a53f
  Janelle Cai authored Apr 22, 2026
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Hannah Zhang <hannahz@nvidia.com>
```
  73a9a53f
- fix: DIS-1768 emit structured SSE error + [DONE] on mid-stream fault (#8430) · f53fa64c
  Keiven C authored Apr 22, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f53fa64c
- feat: garbage collection tcp machine + read from shared place (#8420) · ffa6e84a
  Michael Feil authored Apr 21, 2026
```
Signed-off-by: michaelfeil <63565275+michaelfeil@users.noreply.github.com>
```
  ffa6e84a
- chore(mocker): fold workload concurrency cap into WorkloadDriver (#8446) · 73e0a2f2
  Yan Ru Pei authored Apr 21, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  73e0a2f2
- feat(kv-router): warn on duplicate store replays (#8473) · 4833e29b
  Yan Ru Pei authored Apr 21, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  4833e29b
21 Apr, 2026 6 commits
- fix(discovery): send ModelUpdate::Added after add_worker_set completes (#8242) · 7ffc699f
  MatejKosec authored Apr 21, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  7ffc699f
- feat(lpu): add opaque engine_data field to nvext response with per-request opt-in via extra_fields · 1c9412d2
  Biswa Panda authored Apr 21, 2026
  
  1c9412d2
- chore: upgrade modelexpress version (#8336) · 9514236c
  Nate Mailhot authored Apr 21, 2026
```
Signed-off-by: Nate Mailhot <nmailhot@nvidia.com>
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  9514236c
- feat(kv-router): add start positions to flat KV events (#8426) · 4b3cd459
  Yan Ru Pei authored Apr 21, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  4b3cd459
- fix(mocker): cancel replay router scheduler tasks (#8429) · 6f87f932
  Yan Ru Pei authored Apr 21, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  6f87f932
- chore(mocker): panic loudly on scheduler invariant violations (#8406) · f701319e
  Yan Ru Pei authored Apr 20, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f701319e
20 Apr, 2026 9 commits
- fix(parsers): recover Kimi K2 tool calls when section_end is missing (#8208) · 47cfbd46
  Keiven C authored Apr 20, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  47cfbd46
- feat: (Router) Guard threshold-based rejection logic when CLI thresholds are unset (#8333) · adfc02d5
  Karen Chung authored Apr 20, 2026
  
  adfc02d5
- fix(kv-router): allow unit block size in slot tracking (#8395) · cdb40ec6
  Yan Ru Pei authored Apr 20, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  cdb40ec6
- fix(planner): backfill max_num_batched_tokens from discovery for VirtualConnector (#8042) · 44190094
  jthomson04 authored Apr 20, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
```
  44190094
- fix(protocols): always serialize chat message content (null when absent) (#8372) · 846ce71a
  Ryan McCormick authored Apr 20, 2026
```
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
```
  846ce71a
- fix(responses): own input chain in dynamo-protocols to accept Codex/Agents-SDK shapes (#8275) · 4ef28940
  ishandhanani authored Apr 20, 2026
  
  4ef28940
- feat(planner/replay): KV reuse awareness in load + throughput scaling (#8314) · c388483a
  Hongkuan Zhou authored Apr 20, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
```
  c388483a
- feat(frontend): gate nvext response metadata behind extra_fields (#8252) · f437c8cf
  Biswa Panda authored Apr 20, 2026
```
Co-authored-by: AmeenP <ameenp360@gmail.com>
```
  f437c8cf
- feat: add staged frontend gauges (#8162) · 0c98d9a1
  Jie Hao authored Apr 20, 2026
  
  0c98d9a1
17 Apr, 2026 8 commits
- chore(kv-router): make sequences stop doing token math (#8260) · d94b350d
  Yan Ru Pei authored Apr 17, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d94b350d
- fix(health): use local endpoint registry for canary health checks (#8294) · c2ec3359
  Thomas Montfort authored Apr 17, 2026
```
Signed-off-by: Thomas Montfort <tmontfort@nvidia.com>
Signed-off-by: Thomas Montfort <tmontfort@nvidia.com>
Signed-off-by: tmontfort <tmontfort@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  c2ec3359
- fix(replay/planner): planner-in-the-loop replay diagnostics + planner scaling logics fixes (#8280) · 0c7068dd
  Hongkuan Zhou authored Apr 17, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  0c7068dd
- fix(kv-router): Increase JSON body to 8 MiB to allow 1M tokens (#8315) · 4e7c6afd
  Graham King authored Apr 17, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  4e7c6afd
- fix(discovery): address concurrency edge cases in handle_put lifecycle (#8237) · 7f40761b
  MatejKosec authored Apr 17, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  7f40761b
- perf(discovery): replace polling with Notify in concurrent registration wait (#8291) · f05cabac
  MatejKosec authored Apr 17, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  f05cabac
- fix(health): make canary sole authority on endpoint readiness when enabled (#8165) · 61d4674c
  Neelay Shah authored Apr 17, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  61d4674c
- fix(jail): preserve logprobs through tool-call jailing (#8072) · 59d18d8e
  jthomson04 authored Apr 16, 2026
```
Signed-off-by: jthomson04 <jothomson@nvidia.com>
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  59d18d8e