Commits · 8055b7dd2c8ca7b4ca486f9604da8a662623a2ca · OpenDAS / dynamo · GitLab

03 Mar, 2026 18 commits
- fix(kv-router): plumb expected_osl through scheduler queue path (#6812) · 8055b7dd
  Yan Ru Pei authored Mar 03, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  8055b7dd
- chore: update glab token for mirroring workflow (#6801) · 06c7d6f5
  Anant Sharma authored Mar 03, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  06c7d6f5
- ci: skip completions_only test (#6811) · 51e42e39
  KrishnanPrash authored Mar 03, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  51e42e39
- docs: delete script and add instructions (#6763) · 552ae186
  Qi Wang authored Mar 03, 2026
  
  552ae186
- fix: Added retries for docker pull. Removed unused docker-tag-push GH action (#6804) · bcbb4d4c
  Dmitry Tokarev authored Mar 03, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  bcbb4d4c
- fix: allow v1alpha1 DGDR creation by fixing webhook version matching and backend enum (#6803) · 0404a9be
  Julien Mancuso authored Mar 03, 2026
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  0404a9be
- feat: upgrade rust to v1.93.0 (#6802) · 57bdbdf1
  Ryan Olson authored Mar 03, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  57bdbdf1
- fix(frontend): Update vllm processor for vllm 0.16 (#6799) · 56212b49
  Graham King authored Mar 03, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  56212b49
- docs: vLLM README container instructions and KV offloading page (#6793) · 9fe03dd8
  Alec authored Mar 02, 2026
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  9fe03dd8
- feat: FlexKV integration in Dynamo (#5858) · 4d7c9845
  Yue Yu authored Mar 03, 2026
```
Signed-off-by: zhuofan1123 <zhuofanl@nvidia.com>
Co-authored-by: zhuofan1123 <zhuofanl@nvidia.com>
```
  4d7c9845
- feat(kvbm): add testing utilities to kvbm-logical and kvbm-physical (#6691) · 76042959
  Ryan Olson authored Mar 02, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  76042959
- fix: pass through extra args in trtllm agg.sh launch script (#6787) · 146eb3b4
  KrishnanPrash authored Mar 02, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  146eb3b4
- docs: Refactor TensorRT-LLM backend docs (#6782) · 1bb28d6f
  Tanmay Verma authored Mar 02, 2026
  
  1bb28d6f
- fix: auto-scale request count in benchmarks (#6777) · 8bd5966b
  Yongming Ding authored Mar 02, 2026
```
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
```
  8bd5966b
- feat(kv-router): add router queue depth Prometheus metric and nvext field (#6786) · 073fb437
  Yan Ru Pei authored Mar 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  073fb437
- docs: restructure vLLM docs and add startup banners to launch scripts (#6698) · 75bf1e09
  Alec authored Mar 02, 2026
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: ishandhanani <ishandhanani@gmail.com>
```
  75bf1e09
- fix: Fix E + PD Multimodal Flow in trtllm (#6726) · 47ed1227
  Indrajit Bhosale authored Mar 02, 2026
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  47ed1227
- chore: consolidate 3 docs skills into 1, add .claude codeowners (#6785) · 6243506b
  ishandhanani authored Mar 02, 2026
```
Signed-off-by: Ishan Dhanani <ishandhanani@gmail.com>
```
  6243506b
02 Mar, 2026 21 commits
- perf(kv-router): linear scan improvements [DYN-2164] (#6363) · d24cfbe1
  Yan Ru Pei authored Mar 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  d24cfbe1
- fix: update container image to standard vllm-runtime tag (#6781) · 1bc913ef
  Biswa Panda authored Mar 02, 2026
  
  1bc913ef
- fix: Fix vLLM KVBM integration test (#6768) · 9d10e050
  Kris Hung authored Mar 02, 2026
  
  9d10e050
- chore: update version and repo of chrek helm chart (#6738) · 93fa4d4d
  Harrison Saturley-Hall authored Mar 02, 2026
```
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
```
  93fa4d4d
- fix: Add weight: 1 to the EPP config plugins (#6756) · ee33acf3
  atchernych authored Mar 02, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  ee33acf3
- fix(test): fix vllm disaggregated cancellation tests (#6758) · 8ed69ea2
  Tzu-Ling Kan authored Mar 02, 2026
```
Signed-off-by: Tzu-Ling <tzulingk@nvidia.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
```
  8ed69ea2
- test: Enable TRT-LLM graceful shutdown migration tests (#6766) · aedfc0a3
  Jacky authored Mar 02, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  aedfc0a3
- fix: autogenerate helm chart readme (#6774) · 17693cf8
  Julien Mancuso authored Mar 02, 2026
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  17693cf8
- feat: Full Anthropic Messages API cache_control support (top-level, per-block,... · 4d3e1ae3
  MatejKosec authored Mar 02, 2026
```
feat: Full Anthropic Messages API cache_control support (top-level, per-block, system block arrays) (#6629)
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  4d3e1ae3
- fix: disagg_planner.yaml using new planner CLI (#6760) · a3cf35c3
  Hongkuan Zhou authored Mar 02, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  a3cf35c3
- fix(perf): add embedding transfer implementation with NIXL WRITE initiation (#6651) · 2cab0f7f
  GuanLuo authored Mar 02, 2026
```
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
```
  2cab0f7f
- chore: enable operator build and deploy tests in post-merge (#6761) · da98f6a0
  Dmitry Tokarev authored Mar 02, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  da98f6a0
- fix: decouple Helm chart from runtime cluster state for helm template and... · f83d9a53
  Julien Mancuso authored Mar 02, 2026
```
fix: decouple Helm chart from runtime cluster state for helm template and GitOps compatibility (#6754)
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  f83d9a53
- fix: handle missing `out_hidden_size` for LLaVA models in EPD encode worker (#6759) · 63070ddf
  KrishnanPrash authored Mar 02, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  63070ddf
- feat(perf): add BPF for frontend perf tracing (#6737) · 35a796a3
  Biswa Panda authored Mar 02, 2026
  
  35a796a3
- docs: update AIC disaggregated serving guide (#6553) · 63245237
  Simone Chen authored Mar 02, 2026
```
Signed-off-by: Simone Chen <simonec@nvidia.com>
```
  63245237
- feat: move standalone KV indexer into kv-router crate with HTTP integration tests (#6569) · 07742cc2
  Yan Ru Pei authored Mar 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  07742cc2
- fix: mypy type fixes (#6730) · e7f3361e
  Tzu-Ling Kan authored Mar 02, 2026
```
Signed-off-by: Tzu-Ling <tzulingk@nvidia.com>
```
  e7f3361e
- chore(style): Log with {var} style in lib/runtime (#6757) · 9e6a84af
  Ryan McCormick authored Mar 02, 2026
  
  9e6a84af
- fix: always emit pvc block in operator configmap when checkpoint storage type is pvc (#6752) · 72eabeae
  Julien Mancuso authored Mar 02, 2026
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  72eabeae
- docs: restructure docs directory and move fern config to fern/ (#6700) · ece08dc9
  Neal Vaidya authored Mar 01, 2026
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  ece08dc9
01 Mar, 2026 1 commit
- chore: fix post merge (#6704) · 1412e44b
  Dmitry Tokarev authored Mar 01, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  1412e44b