Commits · e811db503ae48beeb029cf73a2d5953b52bc8176 · OpenDAS / dynamo

"components/backends/vllm/vscode:/vscode.git/clone" did not exist on "ee3a8e42838108a92d813b1a21037ad69e4d1530"

17 Mar, 2026 6 commits
- feat(kv-router): plumb medium into worker-side placements (#7462) · e811db50
  Yan Ru Pei authored Mar 17, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  e811db50
- chore(kv-router): drop naive bench indexers (#7447) · a800515d
  Yan Ru Pei authored Mar 17, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  a800515d
- feat: Concurrent KV event consumer (#7293) · 7ff5e0be
  jthomson04 authored Mar 17, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  7ff5e0be
- fix(kv-router): recover initial standalone-indexer ZMQ gaps (#7463) · 0f8e1a9e
  Yan Ru Pei authored Mar 17, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  0f8e1a9e
- fix: Improve active sequences request expiration (#7340) · 1e261dbd
  blarson-b10 authored Mar 16, 2026
```
Signed-off-by: Brian Larson <brian.larson@baseten.co>
```
  1e261dbd
- feat: Enable EPP worker discovery mode (#6592) · a441aaf8
  atchernych authored Mar 16, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  a441aaf8
16 Mar, 2026 1 commit

feat: flock-based failover lock for engine leader election (#6817) · 9df692c1

mohammedabdulwahhab authored Mar 16, 2026


Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

9df692c1

15 Mar, 2026 4 commits
- feat: integrate fastokens BPE tokenizer backend (#7387) · da810a26
  Biswa Panda authored Mar 15, 2026
  
  da810a26
- feat(kv-indexer): add python launcher follow-up [DYN-2459] (#7395) · 56b448a6
  Yan Ru Pei authored Mar 15, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  56b448a6
- chore(kv-router): remove native kv-indexer binary, use maturin-built one (#7338) · b6596c52
  Yan Ru Pei authored Mar 15, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b6596c52
- feat(velo): add unix domain socket (#7197) · 9e9ca3e2
  Patrick authored Mar 15, 2026
```
Signed-off-by: Patrick Riel <priel@nvidia.com>
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  9e9ca3e2
14 Mar, 2026 3 commits
- feat: standalone KV indexer runtime integration (#7295) · bba70a41
  Thomas Montfort authored Mar 14, 2026
  
  bba70a41
- feat(perf): add request-plane, transport, and work-handler metric definitions (#6735) · cec19d4d
  Biswa Panda authored Mar 14, 2026
  
  cec19d4d
- feat: propagate OTEL trace context across E/P/D multimodal workers (#7239) · c263a99e
  jh-nv authored Mar 13, 2026
  
  c263a99e
13 Mar, 2026 8 commits
- fix: populate logprobs bytes and token fields in OpenAI-compatible responses (#6953) · 947939c7
  Biswa Panda authored Mar 13, 2026
  
  947939c7
- test(kv-router): use flush-and-settle helper in indexer tests (#7347) · cb9b1cd5
  Yan Ru Pei authored Mar 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  cb9b1cd5
- feat(mocker): add --decode-speedup-ratio for speculative decoding simulation (#7349) · 7e07495f
  Yan Ru Pei authored Mar 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7e07495f
- fix: Upgrade futures-util to 0.3.32 (#7346) · e6cb6847
  Graham King authored Mar 13, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  e6cb6847
- feat(kv-router): add Prometheus metrics to standalone indexer (#7339) · 5aa2f53f
  Yan Ru Pei authored Mar 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  5aa2f53f
- feat(kv-router): pluggable scheduling policy for router queue [DYN-2454] (#7260) · bddaaa26
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  bddaaa26
- fix: harden numa cpuset lookup (#7060) · 17db1b6a
  Ryan Olson authored Mar 12, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  17db1b6a
- fix: cancellation kv commit router (#7178) · d170d56a
  Michael Feil authored Mar 12, 2026
```
Signed-off-by: michaelfeil <63565275+michaelfeil@users.noreply.github.com>
```
  d170d56a
12 Mar, 2026 11 commits
- feat(kv-router): add worker_type to router selection log (#7258) · dcbccbcd
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  dcbccbcd
- feat(kv-router): package dynamo-kv-indexer binary via maturin [LLM-126] (#7194) · f80ad692
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f80ad692
- feat: ForwardPassMetrics dynamo event plane integration (#7250) · cd4773fb
  Hongkuan Zhou authored Mar 12, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  cd4773fb
- docs: update KVBM diagram from PNG to SVG (#7277) · 330f001d
  dagil-nvidia authored Mar 12, 2026
```
Signed-off-by: akshatha-k <akshutk@gmail.com>
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: akshatha-k <akshutk@gmail.com>
```
  330f001d
- chore: remove unused python dependencies (#7238) · 3f565053
  Anant Sharma authored Mar 12, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  3f565053
- test: Fix cancellation test (#7296) · 87ac404e
  Graham King authored Mar 12, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  87ac404e
- feat(kv-router): ZMQ gap detection + replay for standalone indexer [LLM-126] (#7209) · bb07b2f4
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  bb07b2f4
- feat: support multimodal (vision) inputs in Anthropic Messages API (#7256) · ba52c8ff
  MatejKosec authored Mar 12, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  ba52c8ff
- feat: vllm omni image to video support (#6530) · 1182e207
  Ayush Agarwal authored Mar 12, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  1182e207
- fix: respect per-request chat_template_kwargs for DeepSeek V3.2 thinking mode (#7286) · 745d7e4c
  brluo authored Mar 12, 2026
```
Co-authored-by: kangclzjc <kangz@nvidia.com>
```
  745d7e4c
- feat: replaces PersistentConnector monkey-patch with proper nixl_conn… (#6913) · 387100c8
  Daniel Socek authored Mar 11, 2026
```
Signed-off-by: Daniel Socek <daniel.socek@intel.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  387100c8
11 Mar, 2026 7 commits

feat: follow up of optinal, batching-of-client-side-events (#6741) · fca0a801

Michael Feil authored Mar 11, 2026

Signed-off-by: michaelfeil <63565275+michaelfeil@users.noreply.github.com>
Signed-off-by: Michael Feil <michaelfeil@users.noreply.github.com>
Signed-off-by: Michael Feil <63565275+michaelfeil@users.noreply.github.com>

fca0a801

feat: streaming tool call and reasoning dispatch SSE events (#7114) · 5178a4a4
MatejKosec authored Mar 11, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
5178a4a4

feat: GlobalPlanner --max-total-gpus for cluster-wide GPU budget (#7103) · 5d5fd243

daiyaanarfeen authored Mar 11, 2026


Signed-off-by: Daiyaan <darfeen@nvidia.com>
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Signed-off-by: Anish <80174047+athreesh@users.noreply.github.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-authored-by: athreesh <anish.maddipoti@utexas.edu>
Co-authored-by: Anish <80174047+athreesh@users.noreply.github.com>

5d5fd243

fix: add force_nonempty_content for nemotron (#7225) · c95bfc2e
Neal Vaidya authored Mar 11, 2026
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
```
c95bfc2e
fix: removing reference to async-ucx (#7213) · ddf50359
Ryan Olson authored Mar 11, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
ddf50359
chore: set kvbm subcrates to 0.1.0 (#7147) · eb99f293
Ryan Olson authored Mar 11, 2026

eb99f293
fix: Fix mocker+router segfaults + reliability fixes (#7162) · 761e848b
jthomson04 authored Mar 10, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
761e848b