Commits · e319cd2b6d7f0a25349f396b3ae132c99b8415cb · OpenDAS / dynamo · GitLab

09 Apr, 2026 19 commits
- fix(profiler): use final TRT-LLM paged KV cache log entry for max tokens (#7988) · e319cd2b
  nihalmaddala authored Apr 09, 2026
```
Signed-off-by: nihalmaddala <nihalmaddala@gmail.com>
```
  e319cd2b
- fix(examples): correct componentType and ServiceAccount for GlobalPlanner in examples (#7755) · 2059f977
  Yao Qing authored Apr 10, 2026
```
Signed-off-by: Yao, Qing <qing.yao@intel.com>
```
  2059f977
- refactor(planner): extract discrete-event state machine with explicit inputs (#8046) · f7e0b3fd
  Hongkuan Zhou authored Apr 09, 2026
  
  f7e0b3fd
- refactor: simplify GPU Memory Service integrations and module boundaries (#7875) · 39a6a240
  Schwinn Saereesitthipitak authored Apr 09, 2026
  
  39a6a240
- chore(kv-router): remove sharded indexer path (#8041) · 02666f04
  Yan Ru Pei authored Apr 09, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  02666f04
- fix(sglang): use served_model_name for video/image model registration (#8035) · ba274a03
  Piotr Marcinkiewicz authored Apr 09, 2026
  
  ba274a03
- ci: Phase 1: Shared Workflow Improvements (#7345) · a0e41273
  Dillon Cullinan authored Apr 09, 2026
```
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
```
  a0e41273
- feat(global-router): priority-based pool routing from agent hints (#8010) · 7a6db48e
  jthomson04 authored Apr 09, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  7a6db48e
- feat(vllm): add audio_url loading to multimodal handler (#7955) · 8fd1b847
  Neal Vaidya authored Apr 09, 2026
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  8fd1b847
- fix(llm): preserve unresolved dp rank routing (#8000) · b579a772
  Yan Ru Pei authored Apr 09, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b579a772
- fix(kv-router): coalesce worker recovery dumps (#8021) · f3d3a8b3
  Yan Ru Pei authored Apr 09, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f3d3a8b3
- fix: disable Allure reporting to stop gh-pages bloat (#7982) · a1f230e9
  Dmitry Tokarev authored Apr 09, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  a1f230e9
- fix(operator): handle GPU resources in requests, not just limits (#8005) · 99199f49
  Dmitry Tokarev authored Apr 09, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  99199f49
- refactor(snapshot): tighten operator protocol boundary (#8018) · debda332
  Schwinn Saereesitthipitak authored Apr 08, 2026
  
  debda332
- perf: avoid cloning content parts in gather_multi_modal_data (#8009) · f49df565
  KrishnanPrash authored Apr 08, 2026
  
  f49df565
- feat(kv-router): add dedup filter for duplicate vLLM KV block events (#8012) · 9b3e9249
  jthomson04 authored Apr 08, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  9b3e9249
- feat(test): add generalized multimodal model coverage framework (#7975) · f45a6985
  Qi Wang authored Apr 08, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  f45a6985
- fix(llm): log routing input hashes for replay debug (#8017) · e45bb0fe
  Yan Ru Pei authored Apr 08, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  e45bb0fe
- feat: Add Intel XPU (Intel GPU) monitoring support to observability stack (#7511) · 4218bbae
  WenjiaoYue authored Apr 09, 2026
```
Signed-off-by: Wenjiao Yue <wenjiao.yue@intel.com>
```
  4218bbae
08 Apr, 2026 21 commits
- fix(runtime): handle instance disappearance in push router transport resolution (#8007) · 8f9c9998
  jthomson04 authored Apr 08, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  8f9c9998
- fix(planner): avoid hang in wait_for_scaling_completion when no decision pending (#8008) · cab6323c
  jthomson04 authored Apr 08, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  cab6323c
- feat: adding kvbm-engine (#6773) · 008683d6
  Ryan Olson authored Apr 08, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  008683d6
- feat: sglang guided decoding support (#6620) · cf79c4fc
  Oleg Zhelezniak authored Apr 08, 2026
```
Signed-off-by: jellysnack <oleg.jellysnack@gmail.com>
```
  cf79c4fc
- docs(kubernetes): remove decode-mode omission note (#8004) · 8409e412
  Yan Ru Pei authored Apr 08, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  8409e412
- fix: tool call loss under speculative decoding (#7768) · f69580b0
  Oleg Zhelezniak authored Apr 08, 2026
```
Signed-off-by: jellysnack <oleg.jellysnack@gmail.com>
```
  f69580b0
- feat: vllm omni disagg (#7409) · 1c199f88
  Ayush Agarwal authored Apr 08, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  1c199f88
- feat(kvbm): add MLA support for DeepSeek-V2 and extend determinism tests (#7786) · ba34f131
  Olga Andreeva authored Apr 08, 2026
```
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-authored-by: wz1qqx <ziqi.wang@novita.ai>
```
  ba34f131
- refactor(3/3): switch dynamo-protocols to upstream async-openai types (#7625) · fd5cc288
  ishandhanani authored Apr 08, 2026
```
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  fd5cc288
- feat(vllm): compute Qwen VL grid_thw from PIL images for P/D disagg (#7885) · d517fb80
  Qi Wang authored Apr 08, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  d517fb80
- test(router): cover round-robin unset dp-rank flow (#7991) · c09abf7d
  Yan Ru Pei authored Apr 08, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  c09abf7d
- feat(bench): add seed support to multimodal sweep and JSONL generator (#7995) · 1dd076cc
  Qi Wang authored Apr 08, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  1dd076cc
- feat(planner): unify throughput and load scaling on FPM regression (#7961) · 66f7832a
  Hongkuan Zhou authored Apr 08, 2026
  
  66f7832a
- chore: Remove dependency memory -> config (#7993) · 0b7a18ce
  Graham King authored Apr 08, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  0b7a18ce
- fix: dp_rank always 0 in non-KV router mode (#7984) · a210efa6
  ishandhanani authored Apr 08, 2026
  
  a210efa6
- build(deps): bump google.golang.org/grpc from 1.72.2 to 1.79.3 in /deploy/snapshot (#7979) · 56f87797
  dependabot[bot] authored Apr 08, 2026
```
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
```
  56f87797
- build(deps): bump google.golang.org/grpc from 1.78.0 to 1.79.3 in... · 61f16716
  dependabot[bot] authored Apr 08, 2026
```
build(deps): bump google.golang.org/grpc from 1.78.0 to 1.79.3 in /deploy/inference-gateway/epp (#7969)
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  61f16716
- feat(kv-router): split Dynamo-native remote indexer [DYN-2593] (#7973) · 49eb397a
  Yan Ru Pei authored Apr 07, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  49eb397a
- fix: correct history.jsonl path for Allure 3 trend charts (#7974) · d232b450
  Dmitry Tokarev authored Apr 08, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  d232b450
- chore: fix bindings typo in comments (#7516) · 06513c9b
  Xianlu Bird authored Apr 08, 2026
```
Signed-off-by: xianlubird <xianlubird@gmail.com>
```
  06513c9b
- feat(sglang): add logprob passthrough in decode handler (#6837) · 5802db87
  William Arnold authored Apr 07, 2026
```
Signed-off-by: William Arnold <7565007+Aphoh@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  5802db87