Commits · adc95380ab1a5edf8c9cf82a306f84aecd59974b · OpenDAS / dynamo · GitLab

04 Mar, 2026 16 commits
- feat: multi-image in request support for sglang backend (#6068) · adc95380
  Wang, Yi authored Mar 05, 2026
```
Signed-off-by: Wang, Yi <yi.a.wang@intel.com>
```
  adc95380
- docs: add readme in component directory (#6699) · 203249e1
  jh-nv authored Mar 04, 2026
  
  203249e1
- chore: Update AWS SDK version used (#6841) · 6d8b5c4e
  Adit Ranadive authored Mar 04, 2026
```
Signed-off-by: Adit Ranadive <aranadive@nvidia.com>
```
  6d8b5c4e
- fix: exclude nixl .so files from ai-dynamo-runtime wheel (#6430) · 550464b6
  Anant Sharma authored Mar 04, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  550464b6
- fix: refactor profiler's dgd generation workflow to correctly generate mocker config (#6848) · 7c1a6238
  Hongkuan Zhou authored Mar 04, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  7c1a6238
- feat: kimi2.5 with nvidia's model weights and trtllm patch (#6842) · 01baf4a3
  Biswa Panda authored Mar 04, 2026
  
  01baf4a3
- docs: fix invalid link for veto-events (#6867) · 3c0a0d75
  Ryan Olson authored Mar 04, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  3c0a0d75
- fix(frontend): vllm processor works with stream_interval > 1 (#6816) · 4e1bd700
  Graham King authored Mar 04, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  4e1bd700
- feat(kv-indexer): multi-model and multi-tenant isolation (#6830) · 35f99f93
  Yan Ru Pei authored Mar 04, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  35f99f93
- feat: enable intel xpu dockerfile (#6109) · e0a2e7bb
  zxue2 authored Mar 04, 2026
```
Signed-off-by: Zhan Xue <zhan.xue@intel.com>
Co-authored-by: XinYu Ye <xinyu.ye@intel.com>
Co-authored-by: Hongming Zheng <hongming.zheng@intel.com>
```
  e0a2e7bb
- ci: increase multi-GPU test timeout to 60 minutes for nightly pipeline (#6666) · ec63ff72
  knarangN authored Mar 03, 2026
```
Signed-off-by: Kavita Narang <knarang@nvidia.com>
```
  ec63ff72
- fix: Fix/docs readme skill links (#6856) · 3be53799
  Dmitry Tokarev authored Mar 03, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  3be53799
- chore: Optimizations for epp interface complience (#6581) · 73a4ab31
  atchernych authored Mar 03, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  73a4ab31
- chore: better error message for planner sweeping mode (#6844) · d688aa68
  Hongkuan Zhou authored Mar 03, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  d688aa68
- feat: optimize dev/local-dev Dockerfiles for source-based development (part 1) (#6743) · a60cdf59
  Keiven C authored Mar 03, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  a60cdf59
- refactor: move CRD apply from Helm hook Job to init container on operator Deployment (#6780) · a01cd9c1
  Julien Mancuso authored Mar 03, 2026
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  a01cd9c1
03 Mar, 2026 24 commits
- fix: lychee cache - don't cache failures, save cache on main for every run... · b40aa3e6
  Dmitry Tokarev authored Mar 03, 2026
```
fix: lychee cache - don't cache failures, save cache on main for every run after sanitizing it. (#6824)
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  b40aa3e6
- feat: add kimi k2.5 model recipe with baseten's model (#6602) · 62ec9f5b
  Biswa Panda authored Mar 03, 2026
```
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
```
  62ec9f5b
- fix: properly setup and register vLLM worker for external / hybrid load... · 90d74637
  GuanLuo authored Mar 03, 2026
```
fix: properly setup and register vLLM worker for external / hybrid load balancing. Update launch script (#6695)
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
```
  90d74637
- chore: update nixl version to 0.10.1 (#6826) · 9254e3d4
  Anant Sharma authored Mar 03, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  9254e3d4
- fix: update nixl version to 0.10.0 (#6789) · 2ff74404
  Biswa Panda authored Mar 03, 2026
  
  2ff74404
- chore(kv-router): deduplicate KvRouterConfig args into shared ArgGroup (#6805) · 9f3b7b33
  Yan Ru Pei authored Mar 03, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  9f3b7b33
- fix: pass in device_id to KVBM PinnedAllocator instead of hard code to 0 (#6809) · 0da960f1
  Ziqi Fan authored Mar 03, 2026
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  0da960f1
- feat: use model_fields_set to distinguish ttft/itl default usage (#6814) · e4601811
  hhzhang16 authored Mar 03, 2026
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  e4601811
- fix(kv-router): plumb expected_osl through scheduler queue path (#6812) · 8055b7dd
  Yan Ru Pei authored Mar 03, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  8055b7dd
- chore: update glab token for mirroring workflow (#6801) · 06c7d6f5
  Anant Sharma authored Mar 03, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  06c7d6f5
- ci: skip completions_only test (#6811) · 51e42e39
  KrishnanPrash authored Mar 03, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  51e42e39
- docs: delete script and add instructions (#6763) · 552ae186
  Qi Wang authored Mar 03, 2026
  
  552ae186
- fix: Added retries for docker pull. Removed unused docker-tag-push GH action (#6804) · bcbb4d4c
  Dmitry Tokarev authored Mar 03, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  bcbb4d4c
- fix: allow v1alpha1 DGDR creation by fixing webhook version matching and backend enum (#6803) · 0404a9be
  Julien Mancuso authored Mar 03, 2026
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  0404a9be
- feat: upgrade rust to v1.93.0 (#6802) · 57bdbdf1
  Ryan Olson authored Mar 03, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  57bdbdf1
- fix(frontend): Update vllm processor for vllm 0.16 (#6799) · 56212b49
  Graham King authored Mar 03, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  56212b49
- docs: vLLM README container instructions and KV offloading page (#6793) · 9fe03dd8
  Alec authored Mar 02, 2026
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  9fe03dd8
- feat: FlexKV integration in Dynamo (#5858) · 4d7c9845
  Yue Yu authored Mar 03, 2026
```
Signed-off-by: zhuofan1123 <zhuofanl@nvidia.com>
Co-authored-by: zhuofan1123 <zhuofanl@nvidia.com>
```
  4d7c9845
- feat(kvbm): add testing utilities to kvbm-logical and kvbm-physical (#6691) · 76042959
  Ryan Olson authored Mar 02, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  76042959
- fix: pass through extra args in trtllm agg.sh launch script (#6787) · 146eb3b4
  KrishnanPrash authored Mar 02, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  146eb3b4
- docs: Refactor TensorRT-LLM backend docs (#6782) · 1bb28d6f
  Tanmay Verma authored Mar 02, 2026
  
  1bb28d6f
- fix: auto-scale request count in benchmarks (#6777) · 8bd5966b
  Yongming Ding authored Mar 02, 2026
```
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
```
  8bd5966b
- feat(kv-router): add router queue depth Prometheus metric and nvext field (#6786) · 073fb437
  Yan Ru Pei authored Mar 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  073fb437
- docs: restructure vLLM docs and add startup banners to launch scripts (#6698) · 75bf1e09
  Alec authored Mar 02, 2026
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: ishandhanani <ishandhanani@gmail.com>
```
  75bf1e09