Commits · 9254e3d4d20a2b158faef4a8dede73ca941eff90 · OpenDAS / dynamo

03 Mar, 2026 5 commits
- chore: update nixl version to 0.10.1 (#6826) · 9254e3d4
  Anant Sharma authored Mar 03, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  9254e3d4
- fix(kv-router): plumb expected_osl through scheduler queue path (#6812) · 8055b7dd
  Yan Ru Pei authored Mar 03, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  8055b7dd
- feat: upgrade rust to v1.93.0 (#6802) · 57bdbdf1
  Ryan Olson authored Mar 03, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  57bdbdf1
- feat(kvbm): add testing utilities to kvbm-logical and kvbm-physical (#6691) · 76042959
  Ryan Olson authored Mar 02, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  76042959
- feat(kv-router): add router queue depth Prometheus metric and nvext field (#6786) · 073fb437
  Yan Ru Pei authored Mar 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  073fb437
02 Mar, 2026 2 commits
- feat: move standalone KV indexer into kv-router crate with HTTP integration tests (#6569) · 07742cc2
  Yan Ru Pei authored Mar 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  07742cc2
- docs: restructure docs directory and move fern config to fern/ (#6700) · ece08dc9
  Neal Vaidya authored Mar 01, 2026
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  ece08dc9
01 Mar, 2026 1 commit
- feat: kvbm-physical (#6490) · 9ab148dc
  Ryan Olson authored Mar 01, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  9ab148dc
28 Feb, 2026 2 commits
- feat: dynamic batching of client side events (#6733) · 713c96d2
  Michael Feil authored Feb 28, 2026
```
Signed-off-by: michaelfeil <63565275+michaelfeil@users.noreply.github.com>
```
  713c96d2
- feat(kv-router): add ActiveSequences benchmark and extract common bench utils (#6633) · e5850e23
  Yan Ru Pei authored Feb 27, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  e5850e23
27 Feb, 2026 3 commits
- feat: default router_event_threads to 4 (#6672) · 55c0a769
  Yan Ru Pei authored Feb 27, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  55c0a769
- chore: upgrade nixl to 0.10.0 (#6685) · 64082ccd
  Nate Mailhot authored Feb 27, 2026
  
  64082ccd
- feat: wire nvext.cache_control TTL-based pinning through Dynamo router (#6213) · f1d5c95a
  ishandhanani authored Feb 26, 2026
```
Co-authored-by: Claude <noreply@anthropic.com>
```
  f1d5c95a
26 Feb, 2026 4 commits
- chore(deps): bump vLLM to 0.16.0 (#6614) · 64574a3e
  Alec authored Feb 26, 2026
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  64574a3e
- chore: bump versions to 1.0.0 (#6613) · db88c953
  Harrison Saturley-Hall authored Feb 25, 2026
```
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
```
  db88c953
- chore: Decouple TLLM_LOG_LEVEL with DYN_LOG (#6606) · 4a71926d
  Tanmay Verma authored Feb 25, 2026
  
  4a71926d
- chore: move ActiveSequences to kv-router and add unit tests (#6600) · 3f99cf21
  Yan Ru Pei authored Feb 25, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  3f99cf21
25 Feb, 2026 7 commits
- fix: add periodic vLLM engine stats logging and fix log routing (#6566) · e1078789
  Alec authored Feb 25, 2026
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  e1078789
- feat: throughput-metrics-source for SLA planner + GlobalPlanner disagg scaling (#6500) · 651ef5b5
  daiyaanarfeen authored Feb 25, 2026
```
Signed-off-by: Daiyaan <darfeen@nvidia.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
```
  651ef5b5
- feat: Tiktoken support (#6460) · 21fce9ba
  Nikita authored Feb 25, 2026
```
Signed-off-by: Nikita Sukharev <kaonael@gmail.com>
```
  21fce9ba
- chore: plumb allowed_worker_ids through RoutingHints (#6580) · ebaf048d
  Yan Ru Pei authored Feb 25, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ebaf048d
- fix: guarantee RouterRequestMetrics availability & documentation updates (#6558) · ff06b17e
  Keiven C authored Feb 25, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
```
  ff06b17e
- ci: Accelerate dynamo frontend image build (#6479) · e5f97343
  Ran Rubin authored Feb 25, 2026
  
  e5f97343
- feat: Support epp's "pods" interface in Dynamo fixes [DEP-424] (#6302) · c916cd42
  atchernych authored Feb 24, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  c916cd42
24 Feb, 2026 6 commits
- feat: router metrics with dynamo_router_* {worker_id=...}. Update docs (#6227) · 1df620b4
  Keiven C authored Feb 24, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
```
  1df620b4
- chore: split JetStream subscriber into dedicated module and deprecate... · bc00ef38
  Yan Ru Pei authored Feb 24, 2026
```
chore: split JetStream subscriber into dedicated module and deprecate durable_kv_events [DYN-2203] (#6477)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  bc00ef38
- feat: make KV cache events and routing LoRA-aware (#6517) · 75fea787
  Biswa Panda authored Feb 24, 2026
  
  75fea787
- fix: prevent device_blocks double-add in TRT-LLM KVBM connector (#6406) · 6654a57d
  Yuewei Na authored Feb 24, 2026
```
Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>
```
  6654a57d
- chore: replace --enforce-disagg with --decode-fallback, default to enforcing disagg (#6515) · c9ff6235
  Yan Ru Pei authored Feb 24, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c9ff6235
- feat: Standardized Dynamo Error Type (#6303) · c8276cd2
  Jacky authored Feb 23, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  c8276cd2
23 Feb, 2026 5 commits
- feat: Remove Component from public (#6403) · 80cac7c1
  Tzu-Ling Kan authored Feb 23, 2026
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  80cac7c1
- feat(runtime): add hierarchical Model/WorkerSet architecture for multi-namespace support (#6054) · cb55766c
  Thomas Montfort authored Feb 23, 2026
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
```
  cb55766c
- fix: remove unused deps for kvbm bindings (#6496) · f391553e
  Anant Sharma authored Feb 23, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  f391553e
- feat: add standalone KV indexer with query endpoint [DYN-2164] (#6446) · 038b50d2
  Yan Ru Pei authored Feb 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  038b50d2
- feat: add kvbm-kernels crate and upgrade cudarc to 0.19 (#6309) · 61c67804
  Ryan Olson authored Feb 23, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  61c67804
21 Feb, 2026 1 commit
- feat: Remove public uses of CancellationToken (#6405) · 42d69805
  Tzu-Ling Kan authored Feb 20, 2026
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  42d69805
20 Feb, 2026 2 commits

chore: cargo machete - remove unused dependencies (#6453) · 7a6283e9
Ryan Olson authored Feb 20, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
7a6283e9

feat: e2e mm aware kv cache routing support for trtllm backend (#5480) · 23de4e86

zhongdaor-nv authored Feb 19, 2026


Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com>
Signed-off-by: Zhongdao Ren <zhongdaor@zhongdaor-mlt.client.nvidia.com>
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
Co-authored-by: Zhongdao Ren <zhongdaor@zhongdaor-mlt.client.nvidia.com>

23de4e86

19 Feb, 2026 2 commits
- feat: Add runtime.endpoint() method to eliminate namespace chaining (#6386) · 0ce3461a
  Tzu-Ling Kan authored Feb 19, 2026
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  0ce3461a
- feat: add NVTX annotation to KVBM (#6334) · 832bf80a
  Ziqi Fan authored Feb 19, 2026
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  832bf80a