Commits · 119149f2d262f67d7233ae166d0289b7884d4f5e · OpenDAS / dynamo · GitLab

15 Apr, 2026 14 commits
- fix(sglang): always populate max_num_batched_tokens in MDC (#8220) · 119149f2
  ishandhanani authored Apr 15, 2026
  
  119149f2
- feat(kv-router): add prompt membership index for scheduler reads (#8175) · 134d484d
  Yan Ru Pei authored Apr 15, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  134d484d
- fix(kv-router): expose kv_cache_events_applied in multithreaded indexer (#8088) · d0d9c030
  Thomas Montfort authored Apr 15, 2026
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
Signed-off-by: Thomas Montfort <tmontfort@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  d0d9c030
- ci: Move TRTLLM Fault Tolerance tests from post-merge back to nightly (#8210) · 71af9675
  Dmitry Tokarev authored Apr 15, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  71af9675
- chore: Remove obsolete note about lmcache not supported on arm or cuda 13 (#8213) · 6a5b08f5
  Dmitry Tokarev authored Apr 15, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  6a5b08f5
- fix: gpt-oss-120b disagg recipe — fix MODEL_PATH and update README (#8133) · 423c89ee
  Ben Hamm authored Apr 15, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  423c89ee
- feat(async-openai): accept dict format for tool-call arguments (#7772) · 59f474a2
  davilu-nvidia authored Apr 15, 2026
```
Signed-off-by: davilu-nvidia <davilu@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  59f474a2
- fix(llm): close push-router cleanup gap (#8181) · 3efc733f
  Yan Ru Pei authored Apr 14, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  3efc733f
- feat(replay): planner-in-the-loop offline replay (#8187) · 89d67172
  jthomson04 authored Apr 14, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  89d67172
- fix(operator): prevent DGD deletion thrashing under foreground cascading deletion (#8207) · ee9d67e4
  Thomas Montfort authored Apr 14, 2026
```
Signed-off-by: Tyler Montfort <tmontfort@nvidia.com>
```
  ee9d67e4
- feat(metrics): auto-inject worker_id label into metrics (#8089) · cabdaebd
  Thomas Montfort authored Apr 14, 2026
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
Signed-off-by: Thomas Montfort <tmontfort@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  cabdaebd
- feat(operator): enable failover API (#8157) · 45364b5f
  mohammedabdulwahhab authored Apr 14, 2026
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  45364b5f
- fix(trtllm): prevent decode worker segfault on prefill scale-down (#7933) · b13a440e
  MatejKosec authored Apr 14, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  b13a440e
- docs(profiler): add replay_optimize sweep README (#8195) · 9a07ca15
  Yan Ru Pei authored Apr 14, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  9a07ca15
14 Apr, 2026 26 commits
- feat: add unified backend architecture with DynamoBackend (#8003) · da40db40
  Tanmay Verma authored Apr 14, 2026
```
Signed-off-by: Tanmay Verma <tanmayv@nvidia.com>
```
  da40db40
- feat(gms): operator-managed GMS checkpoint/restore support (#8153) · f3b181a9
  Schwinn Saereesitthipitak authored Apr 14, 2026
  
  f3b181a9
- feat(planner): add live diagnostics dashboard HTTP endpoint (#8168) · 091cdb51
  Hongkuan Zhou authored Apr 14, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  091cdb51
- fix(recipes): remove container patch requirements for kimi k2.5 recipes (#8199) · be70dae0
  Karen Chung authored Apr 14, 2026
  
  be70dae0
- fix(planner): don't block agg decode scaling when max_num_batched_tokens is missing (#8196) · d185c881
  Hongkuan Zhou authored Apr 14, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  d185c881
- feat: remove enable_nats usage (#7265) · af0ff07c
  Biswa Panda authored Apr 14, 2026
  
  af0ff07c
- feat(lora): add LoRA support for SGLang (#4769) · f9839161
  Biswa Panda authored Apr 14, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f9839161
- feat: lmcache on CUDA 13 and ARM (#7534) · 21b44473
  Dmitry Tokarev authored Apr 14, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  21b44473
- fix(kvbm): set CUDA device per rank before ncclCommInitRank (#8147) · 2263defc
  Alec authored Apr 14, 2026
```
Signed-off-by: Alec Flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  2263defc
- ci: add planner pipeline to post-merge CI and build for arm64 (#7956) · 37bef607
  Tushar Sharma authored Apr 14, 2026
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  37bef607
- fix: Reject local file inputs in ImageLoader (#8158) · 56f02422
  Graham King authored Apr 14, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  56f02422
- feat: add DGDR test suite (#7343) · 597b7249
  Ashna Mehrotra authored Apr 14, 2026
```
Signed-off-by: ashnamehrotra <ashnamehrotra@gmail.com>
```
  597b7249
- ci: speed up checkout and upgrade actions (#8064) · 8dfed173
  Dmitry Tokarev authored Apr 14, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  8dfed173
- ci: Increase post-merge GPU tests timeout to 120m (#8186) · a7631b7a
  Dmitry Tokarev authored Apr 14, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  a7631b7a
- ci: OPS-4223: Add snapshot build to CI (#8159) · 07c7cc87
  Dillon Cullinan authored Apr 14, 2026
```
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
```
  07c7cc87
- fix: Fix Disag Examples (#8070) · d187a14c
  atchernych authored Apr 14, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  d187a14c
- feat: bump up grove and KAI scheduler versions (#8134) · 3b410226
  Julien Mancuso authored Apr 14, 2026
  
  3b410226
- fix(ci): move negation patterns after positives in filters.yaml (#8123) · e2371a48
  Alec authored Apr 14, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: Saravana Periyasamy <saperiyasamy@nvidia.com>
```
  e2371a48
- ci: Revert skopeo runner change (#8167) · a7188f61
  Dillon Cullinan authored Apr 14, 2026
```
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
```
  a7188f61
- feat: per-container kube discovery for multi-engine pods (#8067) · 2f658327
  mohammedabdulwahhab authored Apr 14, 2026
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  2f658327
- feat: add gpu memory service API on engine services (#8148) · 47897f36
  mohammedabdulwahhab authored Apr 14, 2026
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  47897f36
- chore: remove deprecated examples/multimodal directory (#8141) · 617d55c0
  Ryan McCormick authored Apr 14, 2026
```
Signed-off-by: Ryan McCormick <rmccormick@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  617d55c0
- fix(tests): re-enable vLLM LoRA tests and fix gpu_1 test flakiness (#8094) · 326a702d
  Keiven C authored Apr 14, 2026
```
Signed-off-by: Keiven Chang <keivenc@nvidia.com>
```
  326a702d
- feat: add bash launch script guidelines for CodeRabbit review (#7913) · a5b384f7
  Keiven C authored Apr 14, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  a5b384f7
- docs: Request cancellation metrics and mechanism (#8138) · da28df97
  Jacky authored Apr 14, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  da28df97
- feat: propagate otel tracing to trtllm E/P/D workers (#7592) · 34ce777d
  Jie Hao authored Apr 14, 2026
  
  34ce777d