Commits · e8ecf6ff5ec7a7180a459071afed47fae5895de0 · OpenDAS / dynamo · GitLab

21 Apr, 2026 2 commits
- fix(mocker): cancel replay router scheduler tasks (#8429) · 6f87f932
  Yan Ru Pei authored Apr 21, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  6f87f932
- chore(mocker): panic loudly on scheduler invariant violations (#8406) · f701319e
  Yan Ru Pei authored Apr 20, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f701319e
20 Apr, 2026 9 commits
- fix(parsers): recover Kimi K2 tool calls when section_end is missing (#8208) · 47cfbd46
  Keiven C authored Apr 20, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  47cfbd46
- feat: (Router) Guard threshold-based rejection logic when CLI thresholds are unset (#8333) · adfc02d5
  Karen Chung authored Apr 20, 2026
  
  adfc02d5
- fix(kv-router): allow unit block size in slot tracking (#8395) · cdb40ec6
  Yan Ru Pei authored Apr 20, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  cdb40ec6
- fix(planner): backfill max_num_batched_tokens from discovery for VirtualConnector (#8042) · 44190094
  jthomson04 authored Apr 20, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
```
  44190094
- fix(protocols): always serialize chat message content (null when absent) (#8372) · 846ce71a
  Ryan McCormick authored Apr 20, 2026
```
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
```
  846ce71a
- fix(responses): own input chain in dynamo-protocols to accept Codex/Agents-SDK shapes (#8275) · 4ef28940
  ishandhanani authored Apr 20, 2026
  
  4ef28940
- feat(planner/replay): KV reuse awareness in load + throughput scaling (#8314) · c388483a
  Hongkuan Zhou authored Apr 20, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
```
  c388483a
- feat(frontend): gate nvext response metadata behind extra_fields (#8252) · f437c8cf
  Biswa Panda authored Apr 20, 2026
```
Co-authored-by: AmeenP <ameenp360@gmail.com>
```
  f437c8cf
- feat: add staged frontend gauges (#8162) · 0c98d9a1
  Jie Hao authored Apr 20, 2026
  
  0c98d9a1
17 Apr, 2026 8 commits
- chore(kv-router): make sequences stop doing token math (#8260) · d94b350d
  Yan Ru Pei authored Apr 17, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d94b350d
- fix(health): use local endpoint registry for canary health checks (#8294) · c2ec3359
  Thomas Montfort authored Apr 17, 2026
```
Signed-off-by: Thomas Montfort <tmontfort@nvidia.com>
Signed-off-by: Thomas Montfort <tmontfort@nvidia.com>
Signed-off-by: tmontfort <tmontfort@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  c2ec3359
- fix(replay/planner): planner-in-the-loop replay diagnostics + planner scaling logics fixes (#8280) · 0c7068dd
  Hongkuan Zhou authored Apr 17, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  0c7068dd
- fix(kv-router): Increase JSON body to 8 MiB to allow 1M tokens (#8315) · 4e7c6afd
  Graham King authored Apr 17, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  4e7c6afd
- fix(discovery): address concurrency edge cases in handle_put lifecycle (#8237) · 7f40761b
  MatejKosec authored Apr 17, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  7f40761b
- perf(discovery): replace polling with Notify in concurrent registration wait (#8291) · f05cabac
  MatejKosec authored Apr 17, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  f05cabac
- fix(health): make canary sole authority on endpoint readiness when enabled (#8165) · 61d4674c
  Neelay Shah authored Apr 17, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  61d4674c
- fix(jail): preserve logprobs through tool-call jailing (#8072) · 59d18d8e
  jthomson04 authored Apr 16, 2026
```
Signed-off-by: jthomson04 <jothomson@nvidia.com>
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  59d18d8e
16 Apr, 2026 5 commits
- fix(kv-router): prune stale compressed-tree children (#8127) · 0652441f
  Yan Ru Pei authored Apr 16, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  0652441f
- fix(discovery): add missing Audios model type to is_model_type_list_empty (#8241) · 67bc6a1f
  MatejKosec authored Apr 16, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  67bc6a1f
- feat(replay): simulate non-zero worker startup time in offline replay (#8231) · 0bbba988
  jthomson04 authored Apr 16, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  0bbba988
- fix(runtime): lock-free TCP connection pool for OOM prevention and... · 6633be54
  Biswa Panda authored Apr 15, 2026
```
fix(runtime): lock-free TCP connection pool for OOM prevention and inflight/resource-leak fixes (#7806)
```
  6633be54
- fix(replay): harden router scaling invariants (#8236) · a1e1954a
  Yan Ru Pei authored Apr 15, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  a1e1954a
15 Apr, 2026 16 commits
- feat(planner): add advisory mode for scaling decisions (#8244) · 3da6f4d4
  Hongkuan Zhou authored Apr 15, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  3da6f4d4
- chore: bump dynamo version numbers (#8191) · 01a4b6d6
  Harrison Saturley-Hall authored Apr 15, 2026
  
  01a4b6d6
- fix(gms): rewrite GMS checkpoint/restore operator support (#8194) · b2f7f220
  Schwinn Saereesitthipitak authored Apr 15, 2026
```
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  b2f7f220
- fix(discovery): spawn handle_put tasks concurrently to prevent replay wedging (#7931) · 470bb48f
  MatejKosec authored Apr 15, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  470bb48f
- feat(multimodal): forward mm_processor_kwargs through pipeline for use_audio_in_video (#8150) · e232bec0
  Neal Vaidya authored Apr 15, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  e232bec0
- fix(metrics): widen histogram buckets for request duration and router overhead (#8087) · bba26d55
  Thomas Montfort authored Apr 15, 2026
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
Signed-off-by: Thomas Montfort <tmontfort@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  bba26d55
- fix(metrics): skip output token histogram for zero-output requests (#8085) · 60acaa7b
  Thomas Montfort authored Apr 15, 2026
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
Signed-off-by: Thomas Montfort <tmontfort@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  60acaa7b
- fix(replay): drain traffic metrics only on throughput ticks (#8232) · b92c9593
  Hongkuan Zhou authored Apr 15, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  b92c9593
- feat: add TRT-LLM sleep/wake integration with GMS (#7575) · d96a2cf1
  hhzhang16 authored Apr 15, 2026
```
Co-authored-by: Schwinn Saereesitthipitak <schwinns@nvidia.com>
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  d96a2cf1
- feat(kv-router): add prompt membership index for scheduler reads (#8175) · 134d484d
  Yan Ru Pei authored Apr 15, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  134d484d
- fix(kv-router): expose kv_cache_events_applied in multithreaded indexer (#8088) · d0d9c030
  Thomas Montfort authored Apr 15, 2026
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
Signed-off-by: Thomas Montfort <tmontfort@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  d0d9c030
- feat(async-openai): accept dict format for tool-call arguments (#7772) · 59f474a2
  davilu-nvidia authored Apr 15, 2026
```
Signed-off-by: davilu-nvidia <davilu@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  59f474a2
- fix(llm): close push-router cleanup gap (#8181) · 3efc733f
  Yan Ru Pei authored Apr 14, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  3efc733f
- feat(replay): planner-in-the-loop offline replay (#8187) · 89d67172
  jthomson04 authored Apr 14, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  89d67172
- feat(metrics): auto-inject worker_id label into metrics (#8089) · cabdaebd
  Thomas Montfort authored Apr 14, 2026
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
Signed-off-by: Thomas Montfort <tmontfort@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  cabdaebd
- fix(trtllm): prevent decode worker segfault on prefill scale-down (#7933) · b13a440e
  MatejKosec authored Apr 14, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  b13a440e