Commits · 12e144ae445019bc6c978794359810be4c96d7f1 · OpenDAS / dynamo

"vscode:/vscode.git/clone" did not exist on "40faaf0c0b74312b04efb67fc64298b7955319f6"

23 Apr, 2026 27 commits
- feat: mesh support fixes [DEP-854] (#8270) · 12e144ae
  atchernych authored Apr 23, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  12e144ae
- fix(frontend): fix the rust frontend tool calling with guided decoding and... · 5671d8e3
  Richard Huo authored Apr 23, 2026
```
fix(frontend): fix the rust frontend tool calling with guided decoding and some model parsers fixes (#8442)
```
  5671d8e3
- docs(planner): add planner replay benchmarking guide (#8641) · b2aea8f3
  Hongkuan Zhou authored Apr 23, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
```
  b2aea8f3
- fix(sglang): ship nvtx package and nsys PATH for DYN_NVTX profiling (#8629) · a7105b67
  Kris Hung authored Apr 24, 2026
```
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
```
  a7105b67
- ci: restrict dynamo-pipeline test markers to pre_merge only (#8634) · 5721dfe3
  Anant Sharma authored Apr 23, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  5721dfe3
- fix: implement block_count and worker_count for CRTC (#8559) · bdf01611
  hhzhang16 authored Apr 23, 2026
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  bdf01611
- fix: hardware discovery validation + enrichment improvements (#8508) · 60764414
  hhzhang16 authored Apr 23, 2026
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  60764414
- feat: add inter-pod GMS (#7777) · a48672f5
  Julien Mancuso authored Apr 23, 2026
  
  a48672f5
- feat: split tokenizer code into dynamo-tokenizers crate (#8185) · 0d635418
  ishandhanani authored Apr 23, 2026
  
  0d635418
- fix: honor DYN_MM_ALLOW_INTERNAL for localhost requests (DYN-2863) (#8535) · 159d9e06
  Tushar Sharma authored Apr 23, 2026
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
```
  159d9e06
- docs(observability): explain Prometheus label warmup behavior (#8545) · ab7a22ae
  Jie Hao authored Apr 23, 2026
```
Signed-off-by: Jie Hao <jihao@nvidia.com>
```
  ab7a22ae
- fix(sglang): disable piecewise CUDA graph in launch scripts (#8609) · f208208b
  ishandhanani authored Apr 23, 2026
  
  f208208b
- ci: switch EPP rust build from target cache mount to sccache (#8604) · c5a60a04
  Anant Sharma authored Apr 23, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  c5a60a04
- docs: update disagg communication guide with AWS EFA benchmark results (#7764) · 81ad3f8b
  rwipfelnv authored Apr 23, 2026
```
Signed-off-by: Robert Wipfel <rwipfel@nvidia.com>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
```
  81ad3f8b
- feat: Tier-based KV Routing (#8380) · e3d00b89
  jthomson04 authored Apr 23, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  e3d00b89
- ci: fold container-validation-dynamo into pr, post-merge, and nightly (#8525) · 7e48f3bd
  Anant Sharma authored Apr 23, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  7e48f3bd
- fix(planner): restore documented Prometheus metric behaviour [DYN-2855] (#8575) · dfde02c5
  Hongkuan Zhou authored Apr 23, 2026
```
Signed-off-by: Hongkuan Zhou <hongkuanz@nvidia.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  dfde02c5
- fix: add hardware discovery fallbacks and infer attempt (#8507) · 71fafe3f
  hhzhang16 authored Apr 23, 2026
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  71fafe3f
- fix(operator): enable DCGM discovery in namespace-scoped mode (#8365) · 9572355f
  Dr. Stefan Schimanski authored Apr 23, 2026
```
Signed-off-by: Dr. Stefan Schimanski <sschimanski@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  9572355f
- fix(container): add tail and env to planner distroless image (#8603) · c1a843b3
  Ran Rubin authored Apr 23, 2026
```
Signed-off-by: rrubin <rrubin@nvidia.com>
```
  c1a843b3
- fix(omni): fix disaggregated Qwen2.5-Omni serving pipeline (#8301) · 9e9240db
  ptarasiewiczNV authored Apr 23, 2026
```
Signed-off-by: Piotr Tarasiewicz <ptarasiewicz@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  9e9240db
- fix: install ray in vllm-runtime image (#8515) · 9293abb8
  Anant Sharma authored Apr 23, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  9293abb8
- ci: fix k8s fallback builder bootstrap (#8346) · 65433f43
  Ran Rubin authored Apr 23, 2026
```
Signed-off-by: rrubin <rrubin@nvidia.com>
Signed-off-by: Ran Rubin <ranrubin@gmail.com>
```
  65433f43
- fix: openai import in FT migration tests (#8594) · 0aa1c1bb
  Dmitry Tokarev authored Apr 23, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  0aa1c1bb
- test: skip test_sglang_indexers_sync in nightly only (DYN-2784) (#8539) · b8e32933
  Tushar Sharma authored Apr 22, 2026
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  b8e32933
- chore(mocker): drop the Destroy variant (#8588) · 6b452a14
  Yan Ru Pei authored Apr 22, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  6b452a14
- chore(profiler): reshape replay_optimize into DGDR-aligned Pydantic specs (#8585) · 241b254d
  Yan Ru Pei authored Apr 22, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  241b254d
22 Apr, 2026 13 commits
- refactor: Removes obsolete TRT-LLM request-abort disable wiring and re-enables... · d401c1a4
  Jacky authored Apr 22, 2026
```
refactor: Removes obsolete TRT-LLM request-abort disable wiring and re-enables cancellation test coverage (#8562)
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  d401c1a4
- fix(runtime): stop unconditional NATS connection with --discovery-backend file (#8398) · 6ba534a6
  Biswa Panda authored Apr 22, 2026
  
  6ba534a6
- fix(parsers): back-port sglang kimi-k2 tool-call and reasoning detection (#8532) · 04ea38c3
  Nikita authored Apr 23, 2026
```
Signed-off-by: Nikita Sukharev <kaonael@gmail.com>
```
  04ea38c3
- test(fault_tolerance): replace hand-rolled SSE parser with openai SDK (#8536) · 48911230
  Dmitry Tokarev authored Apr 22, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
```
  48911230
- fix: Remove double tokenization in EPP Integration fixes [DYN-2076] (#8093) · a2a2753d
  atchernych authored Apr 22, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  a2a2753d
- chore: Upgrade ffmpeg to v8.1 (#8452) · 4d5db80a
  Graham King authored Apr 22, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  4d5db80a
- fix: remove the tool calling flaky test as the small model is not stable in... · 1aa5f219
  Richard Huo authored Apr 22, 2026
```
fix: remove the tool calling flaky test as the small model is not stable in generating Json format (#8523)
```
  1aa5f219
- feat: Interface for shared kv cache handling in kv routing (#7536) · b441e26a
  jthomson04 authored Apr 22, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
```
  b441e26a
- feat: add TRTLLM text-to-image support (#8200) · 1b0334c8
  GuanLuo authored Apr 22, 2026
```
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
```
  1b0334c8
- doc: update metrics doc regarding frontend staged gauges (#8459) · 5135c321
  Jie Hao authored Apr 22, 2026
  
  5135c321
- feat(profiler): add replay objective knob (#8518) · 69823d72
  Yan Ru Pei authored Apr 22, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  69823d72
- fix(operator): drop Recreate override on restore-target Deployments (#8434) · bce060d2
  Schwinn Saereesitthipitak authored Apr 22, 2026
```
Signed-off-by: Schwinn Saereesitthipitak <schwinns@nvidia.com>
```
  bce060d2
- test: Explicit None token thresholds disable Router initiated Rejection (#8477) · 9321c2e5
  Jacky authored Apr 22, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  9321c2e5