Commits · dc9f80b341505be91ce308eb6df8cf6ce309596f · OpenDAS / dynamo · GitLab

05 Mar, 2026 22 commits
- feat: Deepseek V3.2 TRTLLM Recipe (#6688) · dc9f80b3
  Karen Chung authored Mar 05, 2026
```
Signed-off-by: Karen Chung <karenc@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
```
  dc9f80b3
- fix: validate initial uptime metric parsing in integration test (#6943) · c24882ff
  Keiven C authored Mar 05, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  c24882ff
- chore: Remove llava-hf recipies (#6954) · 7e55a734
  Indrajit Bhosale authored Mar 05, 2026
  
  7e55a734
- test(kv-router): add mid-chain removal, idempotency tests and flush_wait helpers (#6948) · dc14ce05
  Yan Ru Pei authored Mar 05, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  dc14ce05
- fix: add missing UCX/NIXL native libraries to sglang runtime (#6939) · 6be2a9b1
  Anant Sharma authored Mar 05, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  6be2a9b1
- chore: add mypy typing to sglang (#6859) · 6398d453
  jh-nv authored Mar 05, 2026
  
  6398d453
- fix(vllm-omni): Fix call to normalize_finish_reason on OmniHandler for main (#6910) · 22f1ab15
  Ayush Agarwal authored Mar 05, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  22f1ab15
- fix: extend LoRA download S3 timeout and stream large LoRA downloads to disk (#6544) · 844000eb
  Ameen Patel authored Mar 05, 2026
```
Signed-off-by: AmeenP <ameenp360@gmail.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
```
  844000eb
- fix: Enforce min_endpoint flag in Planner (#6637) · f1e8ea6e
  Karen Chung authored Mar 05, 2026
  
  f1e8ea6e
- fix: make KVBM respect CUDA_VISIBLE_DEVICES for NUMA binding (#6931) · 0853129a
  Ziqi Fan authored Mar 05, 2026
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  0853129a
- chore: mypy typing for python bindings (#6857) · f6b4da08
  jh-nv authored Mar 05, 2026
  
  f6b4da08
- docs(kv-router): add kv event replay comparison with vLLM (#6928) · 49fa25e2
  Yan Ru Pei authored Mar 05, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  49fa25e2
- fix: fix operator race condition (#6929) · 7f1f3076
  Julien Mancuso authored Mar 05, 2026
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  7f1f3076
- chore: add ephemeral-storage requests to deploy profiles (#6723) · 876c9761
  Tushar Sharma authored Mar 05, 2026
```
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  876c9761
- fix: revert accidental change of trtllm/multimodal_processor (#6921) · 9c6f36e9
  Qi Wang authored Mar 05, 2026
```
Signed-off-by: Qi Wang <qiwa@nvidia.com>
```
  9c6f36e9
- fix(llm): preserve reasoning content when tool-call starts mid-chunk (#6902) · 57e6a79f
  Graham King authored Mar 05, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  57e6a79f
- chore: add mypy typing for components/src/dynamo/common (#6721) · 869e7336
  jh-nv authored Mar 04, 2026
  
  869e7336
- perf: multimodal benchmark sweep (#6795) · 9780bf3a
  Qi Wang authored Mar 04, 2026
  
  9780bf3a
- fix: Skip Encoder llm creation for unsupported models in trtllm (#6866) · f0bfda1e
  Indrajit Bhosale authored Mar 04, 2026
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  f0bfda1e
- feat: Add NVTX markers for vLLM EPD (#6627) · eb0bf24e
  Kris Hung authored Mar 04, 2026
  
  eb0bf24e
- fix: revert changes in autogen files (#6908) · e15685d8
  jh-nv authored Mar 04, 2026
  
  e15685d8
- docs(router): add tuning guideline for output block tracking (#6911) · 5139f688
  Yan Ru Pei authored Mar 04, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  5139f688
04 Mar, 2026 18 commits
- fix(gms): resolve socket UUIDs via CUDA driver API (#6891) · 96237ba1
  Schwinn Saereesitthipitak authored Mar 04, 2026
  
  96237ba1
- fix: TRT-LLM multimodal preprocessor - revert to the old... · bb2ca1a9
  Michal Guzek authored Mar 04, 2026
```
fix: TRT-LLM multimodal preprocessor - revert to the old default_multimodal_input_loader for the embeddings case (#6840)
Signed-off-by: Michal Guzek <mguzek@nvidia.com>
```
  bb2ca1a9
- fix: support TRT-LLM 1.3 apply_mm_hashes API (#6810) · d993f9d3
  zhongdaor-nv authored Mar 04, 2026
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
```
  d993f9d3
- chore: bump(deploy): go otel sdk to v1.40.0 (#6901) · 3c0fdd05
  Thomas Montfort authored Mar 04, 2026
  
  3c0fdd05
- feat: move webhook certificate management and CA injection from Helm hooks... · e43b3050
  Julien Mancuso authored Mar 04, 2026
```
feat: move webhook certificate management and CA injection from Helm hooks into the operator (#6839)
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  e43b3050
- chore: add mypy typing to frontend (#6861) · 2128d48a
  jh-nv authored Mar 04, 2026
  
  2128d48a
- fix(examples): add missing --kv-transfer-config to disagg_router.yaml (#6897) · 93529753
  dagil-nvidia authored Mar 04, 2026
```
Signed-off-by: Dan Gil <dagil@nvidia.com>
```
  93529753
- docs(examples): add missing --kv-transfer-config to disaggregated serving README (#6898) · b356b499
  dagil-nvidia authored Mar 04, 2026
```
Signed-off-by: Dan Gil <dagil@nvidia.com>
```
  b356b499
- chore: add mypy to planner and mocker (#6862) · 63e7b7da
  jh-nv authored Mar 04, 2026
  
  63e7b7da
- chore: add mypy typing for profiler (#6863) · 6216ae55
  jh-nv authored Mar 04, 2026
  
  6216ae55
- chore: add mypy for router (#6864) · a96f5d73
  jh-nv authored Mar 04, 2026
  
  a96f5d73
- chore(kv-router): split monolithic indexer.rs into indexer/ directory (#6870) · b94cb543
  Yan Ru Pei authored Mar 04, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  b94cb543
- fix: remove empty multimodal input to avoid invalid uuid check in vLLM (#6853) · 2ae9c290
  GuanLuo authored Mar 04, 2026
```
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
```
  2ae9c290
- fix: strip None args when profiler generating configs (#6882) · 19e8a165
  Hongkuan Zhou authored Mar 04, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  19e8a165
- fix(trtllm): remove deprecated beam_width from health check payload (#6879) · bb79b7de
  Tzu-Ling Kan authored Mar 04, 2026
```
Signed-off-by: tzulingk <tzulingk@nvidia.com>
```
  bb79b7de
- docs: testing and container docs update (#6806) · c55f38dc
  Keiven C authored Mar 04, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  c55f38dc
- feat: multi-image in request support for sglang backend (#6068) · adc95380
  Wang, Yi authored Mar 05, 2026
```
Signed-off-by: Wang, Yi <yi.a.wang@intel.com>
```
  adc95380
- docs: add readme in component directory (#6699) · 203249e1
  jh-nv authored Mar 04, 2026
  
  203249e1