Commits · 0c7068dda994f5fd1d6efac3abc8ce3ea8223800 · OpenDAS / dynamo

"lib/mocker/src/cache/mod.rs" did not exist on "5ed8c1c0ffb607136ff52777ad65c878a33a393d"

17 Apr, 2026 12 commits
- fix(replay/planner): planner-in-the-loop replay diagnostics + planner scaling logics fixes (#8280) · 0c7068dd
  Hongkuan Zhou authored Apr 17, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  0c7068dd
- fix(kv-router): Increase JSON body to 8 MiB to allow 1M tokens (#8315) · 4e7c6afd
  Graham King authored Apr 17, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  4e7c6afd
- fix(tests): keep shadows cold before failover quiesce (#8258) · c69e19e8
  Schwinn Saereesitthipitak authored Apr 17, 2026
```
Signed-off-by: Schwinn Saereesitthipitak <schwinns@nvidia.com>
```
  c69e19e8
- docs: improve KVBM guide by adding NGC and --platform (#8313) · 595ff0fa
  Ziqi Fan authored Apr 17, 2026
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  595ff0fa
- ci: Nightly CI - Increase single GPU test job timeout to 5 hrs (#8305) · 5b03a597
  Dmitry Tokarev authored Apr 17, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  5b03a597
- fix(trtllm): install pip into runtime venv for NVRTC JIT include discovery (#8296) · 94ee2aaf
  Yuewei Na authored Apr 17, 2026
```
Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>
```
  94ee2aaf
- fix(discovery): address concurrency edge cases in handle_put lifecycle (#8237) · 7f40761b
  MatejKosec authored Apr 17, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  7f40761b
- perf(discovery): replace polling with Notify in concurrent registration wait (#8291) · f05cabac
  MatejKosec authored Apr 17, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  f05cabac
- fix: Only read prompt embeds from request if globally enabled (#8248) · 0d5bf022
  Graham King authored Apr 17, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  0d5bf022
- fix: Use vllm to load prompt embeds (#8228) · d644d88d
  Graham King authored Apr 17, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  d644d88d
- fix(health): make canary sole authority on endpoint readiness when enabled (#8165) · 61d4674c
  Neelay Shah authored Apr 17, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  61d4674c
- fix(jail): preserve logprobs through tool-call jailing (#8072) · 59d18d8e
  jthomson04 authored Apr 16, 2026
```
Signed-off-by: jthomson04 <jothomson@nvidia.com>
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  59d18d8e
16 Apr, 2026 10 commits
- docs(vllm-omni): note transformers>=5.0 requirement for GLM-Image (#8287) · b0f7d8a5
  Ayush Agarwal authored Apr 16, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  b0f7d8a5
- fix(kv-router): prune stale compressed-tree children (#8127) · 0652441f
  Yan Ru Pei authored Apr 16, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  0652441f
- fix(discovery): add missing Audios model type to is_model_type_list_empty (#8241) · 67bc6a1f
  MatejKosec authored Apr 16, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  67bc6a1f
- feat: Expanding the hardware discovery to include RDMA, interconnect. (#7551) · 63787939
  devivasudevan authored Apr 16, 2026
  
  63787939
- feat(recipes): add Qwen3-32B-FP8 vLLM disaggregated single-node recipe (#7915) · df53b7a2
  Festus Ayobami Owumi authored Apr 16, 2026
```
Signed-off-by: enfinity <festusowumi@gmail.com>
```
  df53b7a2
- docs(README): add contributing link to nav bar (#8160) · ccd1711c
  Dr. Stefan Schimanski authored Apr 16, 2026
```
Signed-off-by: Dr. Stefan Schimanski <sschimanski@nvidia.com>
```
  ccd1711c
- feat(replay): simulate non-zero worker startup time in offline replay (#8231) · 0bbba988
  jthomson04 authored Apr 16, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  0bbba988
- fix(runtime): lock-free TCP connection pool for OOM prevention and... · 6633be54
  Biswa Panda authored Apr 15, 2026
```
fix(runtime): lock-free TCP connection pool for OOM prevention and inflight/resource-leak fixes (#7806)
```
  6633be54
- fix(sglang): pass stop_token_ids to engine for proactive EOS detection (#8084) · 7d46806d
  Ryan McCormick authored Apr 15, 2026
  
  7d46806d
- fix(replay): harden router scaling invariants (#8236) · a1e1954a
  Yan Ru Pei authored Apr 15, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  a1e1954a
15 Apr, 2026 18 commits
- feat(planner): add advisory mode for scaling decisions (#8244) · 3da6f4d4
  Hongkuan Zhou authored Apr 15, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  3da6f4d4
- chore: bump dynamo version numbers (#8191) · 01a4b6d6
  Harrison Saturley-Hall authored Apr 15, 2026
  
  01a4b6d6
- fix(tests): compare shadow failover restore to RO footprint (#8247) · 6d4d0a61
  Schwinn Saereesitthipitak authored Apr 15, 2026
```
Signed-off-by: Schwinn Saereesitthipitak <schwinns@nvidia.com>
Co-authored-by: Dan Gil <dagil@nvidia.com>
```
  6d4d0a61
- fix(gms): rewrite GMS checkpoint/restore operator support (#8194) · b2f7f220
  Schwinn Saereesitthipitak authored Apr 15, 2026
```
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  b2f7f220
- chore: flux benchmarking script + code clean (#8083) · 2d86b81d
  Ayush Agarwal authored Apr 15, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  2d86b81d
- fix(trtllm): read runtime config from resolved engine args (#8217) · 2e7a1e6c
  Thomas Montfort authored Apr 15, 2026
```
Signed-off-by: Thomas Montfort <tmontfort@nvidia.com>
Signed-off-by: tmontfort <tmontfort@nvidia.com>
```
  2e7a1e6c
- fix(discovery): spawn handle_put tasks concurrently to prevent replay wedging (#7931) · 470bb48f
  MatejKosec authored Apr 15, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  470bb48f
- feat(multimodal): forward mm_processor_kwargs through pipeline for use_audio_in_video (#8150) · e232bec0
  Neal Vaidya authored Apr 15, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  e232bec0
- fix(metrics): widen histogram buckets for request duration and router overhead (#8087) · bba26d55
  Thomas Montfort authored Apr 15, 2026
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
Signed-off-by: Thomas Montfort <tmontfort@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  bba26d55
- fix(container): align sglang nixl_ref with PyPI nixl-cu12 1.0.x (#8205) · 243d7f07
  Keiven C authored Apr 15, 2026
```
Signed-off-by: Keiven Chang <keivenc@nvidia.com>
```
  243d7f07
- ci: Enforce 6GB RAM limit on pytest (#8238) · 2541b97f
  Dillon Cullinan authored Apr 15, 2026
```
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
```
  2541b97f
- fix(metrics): skip output token histogram for zero-output requests (#8085) · 60acaa7b
  Thomas Montfort authored Apr 15, 2026
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
Signed-off-by: Thomas Montfort <tmontfort@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  60acaa7b
- test(router): add single-worker mocker soak test (#8234) · 44cfbb68
  Yan Ru Pei authored Apr 15, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  44cfbb68
- chore: Remove unused vLLM multimodal chat processor (#8229) · 2ac22df7
  Graham King authored Apr 15, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  2ac22df7
- fix(replay): drain traffic metrics only on throughput ticks (#8232) · b92c9593
  Hongkuan Zhou authored Apr 15, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  b92c9593
- feat: add TRT-LLM sleep/wake integration with GMS (#7575) · d96a2cf1
  hhzhang16 authored Apr 15, 2026
```
Co-authored-by: Schwinn Saereesitthipitak <schwinns@nvidia.com>
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  d96a2cf1
- fix(sglang): always populate max_num_batched_tokens in MDC (#8220) · 119149f2
  ishandhanani authored Apr 15, 2026
  
  119149f2
- feat(kv-router): add prompt membership index for scheduler reads (#8175) · 134d484d
  Yan Ru Pei authored Apr 15, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  134d484d