Commits · 6e56bad647b666855bba67be6ec6f129da61eb29 · OpenDAS / dynamo

20 Mar, 2026 1 commit
- feat(llm): unify user-facing priority hints (#7492) · ebd06a1f
  Yan Ru Pei authored Mar 20, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ebd06a1f
19 Mar, 2026 5 commits
- feat: adding request and scheduled sequence (#6933) · 9ba5f828
  Ryan Olson authored Mar 19, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  9ba5f828
- feat: make the kvbm v1's MAX_CONCURRENT_TRANSFERS and MAX_TRANSFER_BATCH_SIZE... · e7bcf651
  Richard Huo authored Mar 19, 2026
```
feat: make the kvbm v1's MAX_CONCURRENT_TRANSFERS and MAX_TRANSFER_BATCH_SIZE configurable from env var (#7527)
```
  e7bcf651
- feat: enable mypy in pre-merge (#6732) · 2712426f
  jh-nv authored Mar 19, 2026
  
  2712426f
- fix: observability fixes for OTEL tracing and logging (#7240) · 9eee5354
  jh-nv authored Mar 19, 2026
```
Signed-off-by: Jie Hao <jihao@nvidia.com>
```
  9eee5354
- test: GAIE integration Unit and e2e tests (#7257) · 50af3435
  atchernych authored Mar 19, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  50af3435
17 Mar, 2026 9 commits
- feat(mocker): add SGLang engine simulation (#6977) · 930721c8
  Yongming Ding authored Mar 17, 2026
```
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  930721c8
- chore(kv-router): drop easy llm facade reexports (#7474) · 45be2fdc
  Yan Ru Pei authored Mar 17, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  45be2fdc
- feat: enable kvbm v1 to use the v2 ::new_with_device (#7151) · 5b6624bd
  Ryan Olson authored Mar 17, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  5b6624bd
- feat(kv-router): plumb medium into worker-side placements (#7462) · e811db50
  Yan Ru Pei authored Mar 17, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  e811db50
- chore(kv-router): drop naive bench indexers (#7447) · a800515d
  Yan Ru Pei authored Mar 17, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  a800515d
- feat: Concurrent KV event consumer (#7293) · 7ff5e0be
  jthomson04 authored Mar 17, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  7ff5e0be
- fix(kv-router): recover initial standalone-indexer ZMQ gaps (#7463) · 0f8e1a9e
  Yan Ru Pei authored Mar 17, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  0f8e1a9e
- fix: Improve active sequences request expiration (#7340) · 1e261dbd
  blarson-b10 authored Mar 16, 2026
```
Signed-off-by: Brian Larson <brian.larson@baseten.co>
```
  1e261dbd
- feat: Enable EPP worker discovery mode (#6592) · a441aaf8
  atchernych authored Mar 16, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  a441aaf8
16 Mar, 2026 1 commit

feat: flock-based failover lock for engine leader election (#6817) · 9df692c1

mohammedabdulwahhab authored Mar 16, 2026


Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

9df692c1

15 Mar, 2026 4 commits
- feat: integrate fastokens BPE tokenizer backend (#7387) · da810a26
  Biswa Panda authored Mar 15, 2026
  
  da810a26
- feat(kv-indexer): add python launcher follow-up [DYN-2459] (#7395) · 56b448a6
  Yan Ru Pei authored Mar 15, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  56b448a6
- chore(kv-router): remove native kv-indexer binary, use maturin-built one (#7338) · b6596c52
  Yan Ru Pei authored Mar 15, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b6596c52
- feat(velo): add unix domain socket (#7197) · 9e9ca3e2
  Patrick authored Mar 15, 2026
```
Signed-off-by: Patrick Riel <priel@nvidia.com>
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  9e9ca3e2
14 Mar, 2026 3 commits
- feat: standalone KV indexer runtime integration (#7295) · bba70a41
  Thomas Montfort authored Mar 14, 2026
  
  bba70a41
- feat(perf): add request-plane, transport, and work-handler metric definitions (#6735) · cec19d4d
  Biswa Panda authored Mar 14, 2026
  
  cec19d4d
- feat: propagate OTEL trace context across E/P/D multimodal workers (#7239) · c263a99e
  jh-nv authored Mar 13, 2026
  
  c263a99e
13 Mar, 2026 8 commits
- fix: populate logprobs bytes and token fields in OpenAI-compatible responses (#6953) · 947939c7
  Biswa Panda authored Mar 13, 2026
  
  947939c7
- test(kv-router): use flush-and-settle helper in indexer tests (#7347) · cb9b1cd5
  Yan Ru Pei authored Mar 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  cb9b1cd5
- feat(mocker): add --decode-speedup-ratio for speculative decoding simulation (#7349) · 7e07495f
  Yan Ru Pei authored Mar 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7e07495f
- fix: Upgrade futures-util to 0.3.32 (#7346) · e6cb6847
  Graham King authored Mar 13, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  e6cb6847
- feat(kv-router): add Prometheus metrics to standalone indexer (#7339) · 5aa2f53f
  Yan Ru Pei authored Mar 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  5aa2f53f
- feat(kv-router): pluggable scheduling policy for router queue [DYN-2454] (#7260) · bddaaa26
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  bddaaa26
- fix: harden numa cpuset lookup (#7060) · 17db1b6a
  Ryan Olson authored Mar 12, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  17db1b6a
- fix: cancellation kv commit router (#7178) · d170d56a
  Michael Feil authored Mar 12, 2026
```
Signed-off-by: michaelfeil <63565275+michaelfeil@users.noreply.github.com>
```
  d170d56a
12 Mar, 2026 9 commits
- feat(kv-router): add worker_type to router selection log (#7258) · dcbccbcd
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  dcbccbcd
- feat(kv-router): package dynamo-kv-indexer binary via maturin [LLM-126] (#7194) · f80ad692
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f80ad692
- feat: ForwardPassMetrics dynamo event plane integration (#7250) · cd4773fb
  Hongkuan Zhou authored Mar 12, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  cd4773fb
- docs: update KVBM diagram from PNG to SVG (#7277) · 330f001d
  dagil-nvidia authored Mar 12, 2026
```
Signed-off-by: akshatha-k <akshutk@gmail.com>
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: akshatha-k <akshutk@gmail.com>
```
  330f001d
- chore: remove unused python dependencies (#7238) · 3f565053
  Anant Sharma authored Mar 12, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  3f565053
- test: Fix cancellation test (#7296) · 87ac404e
  Graham King authored Mar 12, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  87ac404e
- feat(kv-router): ZMQ gap detection + replay for standalone indexer [LLM-126] (#7209) · bb07b2f4
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  bb07b2f4
- feat: support multimodal (vision) inputs in Anthropic Messages API (#7256) · ba52c8ff
  MatejKosec authored Mar 12, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  ba52c8ff
- feat: vllm omni image to video support (#6530) · 1182e207
  Ayush Agarwal authored Mar 12, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  1182e207