Commits · 124ecd98045ada1ef22e5cd442dae642a25b83ac · OpenDAS / dynamo

".devcontainer/gen_devcontainer_json.py" did not exist on "c142eacf915b9324b52e15b22d4e0928f9c868db"

06 Mar, 2026 1 commit

fix: reject prompts exceeding max_seq_len with HTTP 400 (#6635) · 124ecd98

Yuewei Na authored Mar 05, 2026


Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>

124ecd98

05 Mar, 2026 2 commits
- fix: extend LoRA download S3 timeout and stream large LoRA downloads to disk (#6544) · 844000eb
  Ameen Patel authored Mar 05, 2026
```
Signed-off-by: AmeenP <ameenp360@gmail.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
```
  844000eb
- fix(llm): preserve reasoning content when tool-call starts mid-chunk (#6902) · 57e6a79f
  Graham King authored Mar 05, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  57e6a79f
04 Mar, 2026 2 commits
- chore(kv-router): split monolithic indexer.rs into indexer/ directory (#6870) · b94cb543
  Yan Ru Pei authored Mar 04, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  b94cb543
- feat(kv-indexer): multi-model and multi-tenant isolation (#6830) · 35f99f93
  Yan Ru Pei authored Mar 04, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  35f99f93
03 Mar, 2026 6 commits
- fix: properly setup and register vLLM worker for external / hybrid load... · 90d74637
  GuanLuo authored Mar 03, 2026
```
fix: properly setup and register vLLM worker for external / hybrid load balancing. Update launch script (#6695)
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
```
  90d74637
- chore: update nixl version to 0.10.1 (#6826) · 9254e3d4
  Anant Sharma authored Mar 03, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  9254e3d4
- fix: pass in device_id to KVBM PinnedAllocator instead of hard code to 0 (#6809) · 0da960f1
  Ziqi Fan authored Mar 03, 2026
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  0da960f1
- fix(kv-router): plumb expected_osl through scheduler queue path (#6812) · 8055b7dd
  Yan Ru Pei authored Mar 03, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  8055b7dd
- feat: upgrade rust to v1.93.0 (#6802) · 57bdbdf1
  Ryan Olson authored Mar 03, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  57bdbdf1
- feat(kv-router): add router queue depth Prometheus metric and nvext field (#6786) · 073fb437
  Yan Ru Pei authored Mar 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  073fb437
02 Mar, 2026 4 commits
- fix: Fix vLLM KVBM integration test (#6768) · 9d10e050
  Kris Hung authored Mar 02, 2026
  
  9d10e050
- feat: Full Anthropic Messages API cache_control support (top-level, per-block,... · 4d3e1ae3
  MatejKosec authored Mar 02, 2026
```
feat: Full Anthropic Messages API cache_control support (top-level, per-block, system block arrays) (#6629)
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  4d3e1ae3
- feat: move standalone KV indexer into kv-router crate with HTTP integration tests (#6569) · 07742cc2
  Yan Ru Pei authored Mar 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  07742cc2
- docs: restructure docs directory and move fern config to fern/ (#6700) · ece08dc9
  Neal Vaidya authored Mar 01, 2026
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  ece08dc9
28 Feb, 2026 2 commits
- feat: dynamic batching of client side events (#6733) · 713c96d2
  Michael Feil authored Feb 28, 2026
```
Signed-off-by: michaelfeil <63565275+michaelfeil@users.noreply.github.com>
```
  713c96d2
- feat(kv-router): add ActiveSequences benchmark and extract common bench utils (#6633) · e5850e23
  Yan Ru Pei authored Feb 27, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  e5850e23
27 Feb, 2026 3 commits
- feat: default router_event_threads to 4 (#6672) · 55c0a769
  Yan Ru Pei authored Feb 27, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  55c0a769
- chore: upgrade nixl to 0.10.0 (#6685) · 64082ccd
  Nate Mailhot authored Feb 27, 2026
  
  64082ccd
- feat: wire nvext.cache_control TTL-based pinning through Dynamo router (#6213) · f1d5c95a
  ishandhanani authored Feb 26, 2026
```
Co-authored-by: Claude <noreply@anthropic.com>
```
  f1d5c95a
26 Feb, 2026 4 commits
- feat: allow deepseek_v3 architecture to use Kimi's bpe pattern (#6653) · a9b6f95c
  Biswa Panda authored Feb 26, 2026
  
  a9b6f95c
- chore: move ActiveSequences to kv-router and add unit tests (#6600) · 3f99cf21
  Yan Ru Pei authored Feb 25, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  3f99cf21
- feat: enable returning routed experts info up through sglang (#6137) · 4960dbb3
  William Arnold authored Feb 25, 2026
```
Signed-off-by: William Arnold <7565007+Aphoh@users.noreply.github.com>
```
  4960dbb3
- fix: use force_reasoning parser for nemotron_nano (#6288) · a1766e4a
  Neal Vaidya authored Feb 25, 2026
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
```
  a1766e4a
25 Feb, 2026 8 commits
- feat: Tiktoken support (#6460) · 21fce9ba
  Nikita authored Feb 25, 2026
```
Signed-off-by: Nikita Sukharev <kaonael@gmail.com>
```
  21fce9ba
- chore: plumb allowed_worker_ids through RoutingHints (#6580) · ebaf048d
  Yan Ru Pei authored Feb 25, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ebaf048d
- feat: Kimi K2/K2.5 tool and reasoning parsers (#6407) · d1bd210f
  Nikita authored Feb 25, 2026
```
Signed-off-by: Nikita Sukharev <kaonael@gmail.com>
```
  d1bd210f
- fix: guarantee RouterRequestMetrics availability & documentation updates (#6558) · ff06b17e
  Keiven C authored Feb 25, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
```
  ff06b17e
- feat(mocker): add KV cache transfer latency for disagg serving (#6504) · 5d958623
  Yongming Ding authored Feb 24, 2026
```
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
```
  5d958623
- feat: MJPEG video streaming via /v1/videos/stream (experimental) (#6487) · 44d43d0c
  John Pohl authored Feb 25, 2026
```
Signed-off-by: Ryan McCormick <mccormick.codes@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
```
  44d43d0c
- feat: add ZMQ KV event publishing to mocker [DYN-2221] (#6528) · 65dc451d
  Yan Ru Pei authored Feb 24, 2026
```
Signed-off-by: Ru Pei <rupei@nvidia.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  65dc451d
- feat: Support epp's "pods" interface in Dynamo fixes [DEP-424] (#6302) · c916cd42
  atchernych authored Feb 24, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  c916cd42
24 Feb, 2026 8 commits
- feat: sglang to 0.5.9 + updated docs (#6518) · 6642e23e
  ishandhanani authored Feb 24, 2026
```
Co-authored-by: baihuitian <baihuitian.bht@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
```
  6642e23e
- feat: router metrics with dynamo_router_* {worker_id=...}. Update docs (#6227) · 1df620b4
  Keiven C authored Feb 24, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
```
  1df620b4
- chore: de-async scheduler read paths and unblock decode output tracking (#6510) · efa89448
  Yan Ru Pei authored Feb 24, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  efa89448
- test: add tests for lora aware kv cache events and routing (#6523) · 6fab12be
  Biswa Panda authored Feb 24, 2026
  
  6fab12be
- chore: split JetStream subscriber into dedicated module and deprecate... · bc00ef38
  Yan Ru Pei authored Feb 24, 2026
```
chore: split JetStream subscriber into dedicated module and deprecate durable_kv_events [DYN-2203] (#6477)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  bc00ef38
- feat: make KV cache events and routing LoRA-aware (#6517) · 75fea787
  Biswa Panda authored Feb 24, 2026
  
  75fea787
- feat: add error_type label to reqs metric for fine-grained error classification (#5568) · 432fae67
  Vladislav Nosivskoy authored Feb 24, 2026
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
```
  432fae67
- chore: replace --enforce-disagg with --decode-fallback, default to enforcing disagg (#6515) · c9ff6235
  Yan Ru Pei authored Feb 24, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c9ff6235