Commits · 12785247c24cfa75ac2464e589919993a76294aa · OpenDAS / dynamo · GitLab

13 Mar, 2026 2 commits
- fix: harden numa cpuset lookup (#7060) · 17db1b6a
  Ryan Olson authored Mar 12, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  17db1b6a
- fix: cancellation kv commit router (#7178) · d170d56a
  Michael Feil authored Mar 12, 2026
```
Signed-off-by: michaelfeil <63565275+michaelfeil@users.noreply.github.com>
```
  d170d56a
12 Mar, 2026 11 commits
- feat(kv-router): add worker_type to router selection log (#7258) · dcbccbcd
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  dcbccbcd
- feat(kv-router): package dynamo-kv-indexer binary via maturin [LLM-126] (#7194) · f80ad692
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f80ad692
- feat: ForwardPassMetrics dynamo event plane integration (#7250) · cd4773fb
  Hongkuan Zhou authored Mar 12, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  cd4773fb
- docs: update KVBM diagram from PNG to SVG (#7277) · 330f001d
  dagil-nvidia authored Mar 12, 2026
```
Signed-off-by: akshatha-k <akshutk@gmail.com>
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: akshatha-k <akshutk@gmail.com>
```
  330f001d
- chore: remove unused python dependencies (#7238) · 3f565053
  Anant Sharma authored Mar 12, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  3f565053
- test: Fix cancellation test (#7296) · 87ac404e
  Graham King authored Mar 12, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  87ac404e
- feat(kv-router): ZMQ gap detection + replay for standalone indexer [LLM-126] (#7209) · bb07b2f4
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  bb07b2f4
- feat: support multimodal (vision) inputs in Anthropic Messages API (#7256) · ba52c8ff
  MatejKosec authored Mar 12, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  ba52c8ff
- feat: vllm omni image to video support (#6530) · 1182e207
  Ayush Agarwal authored Mar 12, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  1182e207
- fix: respect per-request chat_template_kwargs for DeepSeek V3.2 thinking mode (#7286) · 745d7e4c
  brluo authored Mar 12, 2026
```
Co-authored-by: kangclzjc <kangz@nvidia.com>
```
  745d7e4c
- feat: replaces PersistentConnector monkey-patch with proper nixl_conn… (#6913) · 387100c8
  Daniel Socek authored Mar 11, 2026
```
Signed-off-by: Daniel Socek <daniel.socek@intel.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  387100c8
11 Mar, 2026 8 commits
- feat: follow up of optinal, batching-of-client-side-events (#6741) · fca0a801
  Michael Feil authored Mar 11, 2026
```
Signed-off-by: michaelfeil <63565275+michaelfeil@users.noreply.github.com>
Signed-off-by: Michael Feil <michaelfeil@users.noreply.github.com>
Signed-off-by: Michael Feil <63565275+michaelfeil@users.noreply.github.com>
```
  fca0a801
- feat: streaming tool call and reasoning dispatch SSE events (#7114) · 5178a4a4
  MatejKosec authored Mar 11, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  5178a4a4
- feat: GlobalPlanner --max-total-gpus for cluster-wide GPU budget (#7103) · 5d5fd243
  daiyaanarfeen authored Mar 11, 2026
```
Signed-off-by: Daiyaan <darfeen@nvidia.com>
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Signed-off-by: Anish <80174047+athreesh@users.noreply.github.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-authored-by: athreesh <anish.maddipoti@utexas.edu>
Co-authored-by: Anish <80174047+athreesh@users.noreply.github.com>
```
  5d5fd243
- fix: add force_nonempty_content for nemotron (#7225) · c95bfc2e
  Neal Vaidya authored Mar 11, 2026
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
```
  c95bfc2e
- fix: removing reference to async-ucx (#7213) · ddf50359
  Ryan Olson authored Mar 11, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  ddf50359
- chore: set kvbm subcrates to 0.1.0 (#7147) · eb99f293
  Ryan Olson authored Mar 11, 2026
  
  eb99f293
- fix: Fix mocker+router segfaults + reliability fixes (#7162) · 761e848b
  jthomson04 authored Mar 10, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  761e848b
- feat(anthropic): add thinking block support and preamble stripping to /v1/messages (#7137) · 012236ee
  MatejKosec authored Mar 10, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  012236ee
10 Mar, 2026 9 commits
- chore: set velo crates to initial v0.1.0 (#7156) · 72e849e7
  Ryan Olson authored Mar 10, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
```
  72e849e7
- feat: Add Loki log aggregation, and enable unified OTLP ingestion for both... · 734c0b8b
  jh-nv authored Mar 10, 2026
```
feat: Add Loki log aggregation, and enable unified OTLP ingestion for both traces and logs through a single endpoint (#6974)
```
  734c0b8b
- feat(perf): add frontend pipeline and tokio runtime perf metric definitions (#6731) · 3c44b88e
  Biswa Panda authored Mar 10, 2026
  
  3c44b88e
- feat: split monolithic requirements.txt and remove test deps from runtime image (#6656) · 3cebc864
  Anant Sharma authored Mar 10, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  3cebc864
- fix(perf): Skip duplicate image downloads and unnecessary image processing in... · 6634f33f
  zhongdaor-nv authored Mar 10, 2026
```
fix(perf): Skip duplicate image downloads and unnecessary image processing in MM Router (vLLM) (#7080)
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  6634f33f
- chore: Enable "multipart" feature of reqwest (#7084) · 5265787b
  Graham King authored Mar 10, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  5265787b
- fix: handle early arrivals (#7126) · b6852919
  Ryan Olson authored Mar 10, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  b6852919
- fix(mocker): align vLLM scheduler with v1 — drop watermark, LIFO preemption, retry loop (#7020) · 236cb17d
  Yan Ru Pei authored Mar 10, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  236cb17d
- fix: resolve HTTP port collisions when multiple workers share a process (#7063) · b407b419
  Biswa Panda authored Mar 09, 2026
  
  b407b419
09 Mar, 2026 4 commits
- feat(kv-router): P2P recovery for standalone KV indexer [DYN-2367] (#6934) · 48eb52e7
  Yan Ru Pei authored Mar 09, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  48eb52e7
- fix: reject guided_grammar with excessive nesting depth (#7091) · fab07d1c
  ishandhanani authored Mar 09, 2026
  
  fab07d1c
- feat: velo-backend (#6547) · 63d7c01c
  Ryan Olson authored Mar 09, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  63d7c01c
- fix(prefill-router): pass preselected_worker in sync prefill fallback path (#7055) · e96f71ba
  Yan Ru Pei authored Mar 09, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  e96f71ba
06 Mar, 2026 6 commits
- chore(kv-router): move benches to lib/bench to break circular dep [OPS-3752] (#7013) · 2e29620d
  Yan Ru Pei authored Mar 06, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  2e29620d
- feat(trtllm): add additional metrics for dynamo-trtllm (#6668) · 10081929
  Yifan Jiang authored Mar 06, 2026
```
Signed-off-by: Yifan Jiang <19356972+yifjiang@users.noreply.github.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  10081929
- chore: add mypy typing to vllm (#6858) · 2831bfec
  jh-nv authored Mar 06, 2026
  
  2831bfec
- fix: use checked arithmetic in TwoPartCodec to prevent integer overflow (#6959) · 64ae47fd
  Shounak Ray authored Mar 06, 2026
```
Signed-off-by: ShounakRay <shounak@stanford.edu>
```
  64ae47fd
- fix: hide inactive models from /v1/models (#6966) · a9064c51
  Schwinn Saereesitthipitak authored Mar 06, 2026
  
  a9064c51
- fix: Kimi K2.5 - tiktoken incomplete multi-byte sequence handling with regression tests (#6996) · d71c0c32
  Biswa Panda authored Mar 06, 2026
  
  d71c0c32