Commits · 0bbba988f27c3fa542f8590ad7c95f1bfe05b625 · OpenDAS / dynamo · GitLab

16 Apr, 2026 4 commits
- feat(replay): simulate non-zero worker startup time in offline replay (#8231) · 0bbba988
  jthomson04 authored Apr 16, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  0bbba988
- fix(runtime): lock-free TCP connection pool for OOM prevention and... · 6633be54
  Biswa Panda authored Apr 15, 2026
```
fix(runtime): lock-free TCP connection pool for OOM prevention and inflight/resource-leak fixes (#7806)
```
  6633be54
- fix(sglang): pass stop_token_ids to engine for proactive EOS detection (#8084) · 7d46806d
  Ryan McCormick authored Apr 15, 2026
  
  7d46806d
- fix(replay): harden router scaling invariants (#8236) · a1e1954a
  Yan Ru Pei authored Apr 15, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  a1e1954a
15 Apr, 2026 30 commits
- feat(planner): add advisory mode for scaling decisions (#8244) · 3da6f4d4
  Hongkuan Zhou authored Apr 15, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  3da6f4d4
- chore: bump dynamo version numbers (#8191) · 01a4b6d6
  Harrison Saturley-Hall authored Apr 15, 2026
  
  01a4b6d6
- fix(tests): compare shadow failover restore to RO footprint (#8247) · 6d4d0a61
  Schwinn Saereesitthipitak authored Apr 15, 2026
```
Signed-off-by: Schwinn Saereesitthipitak <schwinns@nvidia.com>
Co-authored-by: Dan Gil <dagil@nvidia.com>
```
  6d4d0a61
- fix(gms): rewrite GMS checkpoint/restore operator support (#8194) · b2f7f220
  Schwinn Saereesitthipitak authored Apr 15, 2026
```
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  b2f7f220
- chore: flux benchmarking script + code clean (#8083) · 2d86b81d
  Ayush Agarwal authored Apr 15, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  2d86b81d
- fix(trtllm): read runtime config from resolved engine args (#8217) · 2e7a1e6c
  Thomas Montfort authored Apr 15, 2026
```
Signed-off-by: Thomas Montfort <tmontfort@nvidia.com>
Signed-off-by: tmontfort <tmontfort@nvidia.com>
```
  2e7a1e6c
- fix(discovery): spawn handle_put tasks concurrently to prevent replay wedging (#7931) · 470bb48f
  MatejKosec authored Apr 15, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  470bb48f
- feat(multimodal): forward mm_processor_kwargs through pipeline for use_audio_in_video (#8150) · e232bec0
  Neal Vaidya authored Apr 15, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  e232bec0
- fix(metrics): widen histogram buckets for request duration and router overhead (#8087) · bba26d55
  Thomas Montfort authored Apr 15, 2026
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
Signed-off-by: Thomas Montfort <tmontfort@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  bba26d55
- fix(container): align sglang nixl_ref with PyPI nixl-cu12 1.0.x (#8205) · 243d7f07
  Keiven C authored Apr 15, 2026
```
Signed-off-by: Keiven Chang <keivenc@nvidia.com>
```
  243d7f07
- ci: Enforce 6GB RAM limit on pytest (#8238) · 2541b97f
  Dillon Cullinan authored Apr 15, 2026
```
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
```
  2541b97f
- fix(metrics): skip output token histogram for zero-output requests (#8085) · 60acaa7b
  Thomas Montfort authored Apr 15, 2026
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
Signed-off-by: Thomas Montfort <tmontfort@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  60acaa7b
- test(router): add single-worker mocker soak test (#8234) · 44cfbb68
  Yan Ru Pei authored Apr 15, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  44cfbb68
- chore: Remove unused vLLM multimodal chat processor (#8229) · 2ac22df7
  Graham King authored Apr 15, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  2ac22df7
- fix(replay): drain traffic metrics only on throughput ticks (#8232) · b92c9593
  Hongkuan Zhou authored Apr 15, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  b92c9593
- feat: add TRT-LLM sleep/wake integration with GMS (#7575) · d96a2cf1
  hhzhang16 authored Apr 15, 2026
```
Co-authored-by: Schwinn Saereesitthipitak <schwinns@nvidia.com>
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  d96a2cf1
- fix(sglang): always populate max_num_batched_tokens in MDC (#8220) · 119149f2
  ishandhanani authored Apr 15, 2026
  
  119149f2
- feat(kv-router): add prompt membership index for scheduler reads (#8175) · 134d484d
  Yan Ru Pei authored Apr 15, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  134d484d
- fix(kv-router): expose kv_cache_events_applied in multithreaded indexer (#8088) · d0d9c030
  Thomas Montfort authored Apr 15, 2026
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
Signed-off-by: Thomas Montfort <tmontfort@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  d0d9c030
- ci: Move TRTLLM Fault Tolerance tests from post-merge back to nightly (#8210) · 71af9675
  Dmitry Tokarev authored Apr 15, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  71af9675
- chore: Remove obsolete note about lmcache not supported on arm or cuda 13 (#8213) · 6a5b08f5
  Dmitry Tokarev authored Apr 15, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  6a5b08f5
- fix: gpt-oss-120b disagg recipe — fix MODEL_PATH and update README (#8133) · 423c89ee
  Ben Hamm authored Apr 15, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  423c89ee
- feat(async-openai): accept dict format for tool-call arguments (#7772) · 59f474a2
  davilu-nvidia authored Apr 15, 2026
```
Signed-off-by: davilu-nvidia <davilu@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  59f474a2
- fix(llm): close push-router cleanup gap (#8181) · 3efc733f
  Yan Ru Pei authored Apr 14, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  3efc733f
- feat(replay): planner-in-the-loop offline replay (#8187) · 89d67172
  jthomson04 authored Apr 14, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  89d67172
- fix(operator): prevent DGD deletion thrashing under foreground cascading deletion (#8207) · ee9d67e4
  Thomas Montfort authored Apr 14, 2026
```
Signed-off-by: Tyler Montfort <tmontfort@nvidia.com>
```
  ee9d67e4
- feat(metrics): auto-inject worker_id label into metrics (#8089) · cabdaebd
  Thomas Montfort authored Apr 14, 2026
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
Signed-off-by: Thomas Montfort <tmontfort@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  cabdaebd
- feat(operator): enable failover API (#8157) · 45364b5f
  mohammedabdulwahhab authored Apr 14, 2026
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  45364b5f
- fix(trtllm): prevent decode worker segfault on prefill scale-down (#7933) · b13a440e
  MatejKosec authored Apr 14, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  b13a440e
- docs(profiler): add replay_optimize sweep README (#8195) · 9a07ca15
  Yan Ru Pei authored Apr 14, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  9a07ca15
14 Apr, 2026 6 commits
- feat: add unified backend architecture with DynamoBackend (#8003) · da40db40
  Tanmay Verma authored Apr 14, 2026
```
Signed-off-by: Tanmay Verma <tanmayv@nvidia.com>
```
  da40db40
- feat(gms): operator-managed GMS checkpoint/restore support (#8153) · f3b181a9
  Schwinn Saereesitthipitak authored Apr 14, 2026
  
  f3b181a9
- feat(planner): add live diagnostics dashboard HTTP endpoint (#8168) · 091cdb51
  Hongkuan Zhou authored Apr 14, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  091cdb51
- fix(recipes): remove container patch requirements for kimi k2.5 recipes (#8199) · be70dae0
  Karen Chung authored Apr 14, 2026
  
  be70dae0
- fix(planner): don't block agg decode scaling when max_num_batched_tokens is missing (#8196) · d185c881
  Hongkuan Zhou authored Apr 14, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  d185c881
- feat: remove enable_nats usage (#7265) · af0ff07c
  Biswa Panda authored Apr 14, 2026
  
  af0ff07c