Commits · 2e29620df14e1ef3af01ea3402f913b4da3bff2f · OpenDAS / dynamo

"docs/runtime/README.md" did not exist on "08fcd7e93ba5df3093a8b54fe79e0895fe7a5f15"

06 Mar, 2026 13 commits
- chore(kv-router): move benches to lib/bench to break circular dep [OPS-3752] (#7013) · 2e29620d
  Yan Ru Pei authored Mar 06, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  2e29620d
- feat(trtllm): add additional metrics for dynamo-trtllm (#6668) · 10081929
  Yifan Jiang authored Mar 06, 2026
```
Signed-off-by: Yifan Jiang <19356972+yifjiang@users.noreply.github.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  10081929
- chore: add mypy typing to vllm (#6858) · 2831bfec
  jh-nv authored Mar 06, 2026
  
  2831bfec
- fix: use checked arithmetic in TwoPartCodec to prevent integer overflow (#6959) · 64ae47fd
  Shounak Ray authored Mar 06, 2026
```
Signed-off-by: ShounakRay <shounak@stanford.edu>
```
  64ae47fd
- fix: hide inactive models from /v1/models (#6966) · a9064c51
  Schwinn Saereesitthipitak authored Mar 06, 2026
  
  a9064c51
- fix: Kimi K2.5 - tiktoken incomplete multi-byte sequence handling with regression tests (#6996) · d71c0c32
  Biswa Panda authored Mar 06, 2026
  
  d71c0c32
- fix(responses): accept assistant output_text messages without id/status in input (#6599) · 9b2b44e3
  MatejKosec authored Mar 06, 2026
```
Signed-off-by: Marko Kosec <mkosec@nvidia.com>
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
Signed-off-by: Vasilis Vagias <vvagias@nvidia.com>
Co-authored-by: vvagias <vasilis.n.vagias@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
```
  9b2b44e3
- fix: llm/mocker: Remove the llm -> mocker crate dependency, move config (#6998) · abc02c68
  Graham King authored Mar 06, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  abc02c68
- chore(UX): Log full endpoint name when registering TCP endpoint (#6964) · 2f15f334
  Ryan McCormick authored Mar 06, 2026
  
  2f15f334
- fix: Move some router logs to DYN_LOG=debug (#6994) · ff6c3f7f
  jthomson04 authored Mar 06, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  ff6c3f7f
- fix: restore --enforce-disagg to reject requests before prefill router activates (#6957) · f934744f
  Yan Ru Pei authored Mar 05, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f934744f
- fix: TRT-LLM multimodal preprocessor - remove default_multimodal_input_loader... · e6ddf0ea
  Michal Guzek authored Mar 05, 2026
```
fix: TRT-LLM multimodal preprocessor - remove default_multimodal_input_loader from the embedding paths (#6924)
Signed-off-by: Michal Guzek <mguzek@nvidia.com>
```
  e6ddf0ea
- fix: reject prompts exceeding max_seq_len with HTTP 400 (#6635) · 124ecd98
  Yuewei Na authored Mar 05, 2026
```
Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>
```
  124ecd98
05 Mar, 2026 8 commits
- fix: validate initial uptime metric parsing in integration test (#6943) · c24882ff
  Keiven C authored Mar 05, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  c24882ff
- test(kv-router): add mid-chain removal, idempotency tests and flush_wait helpers (#6948) · dc14ce05
  Yan Ru Pei authored Mar 05, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  dc14ce05
- chore: add mypy typing to sglang (#6859) · 6398d453
  jh-nv authored Mar 05, 2026
  
  6398d453
- fix: extend LoRA download S3 timeout and stream large LoRA downloads to disk (#6544) · 844000eb
  Ameen Patel authored Mar 05, 2026
```
Signed-off-by: AmeenP <ameenp360@gmail.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
```
  844000eb
- fix: make KVBM respect CUDA_VISIBLE_DEVICES for NUMA binding (#6931) · 0853129a
  Ziqi Fan authored Mar 05, 2026
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  0853129a
- chore: mypy typing for python bindings (#6857) · f6b4da08
  jh-nv authored Mar 05, 2026
  
  f6b4da08
- fix(llm): preserve reasoning content when tool-call starts mid-chunk (#6902) · 57e6a79f
  Graham King authored Mar 05, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  57e6a79f
- chore: add mypy typing for components/src/dynamo/common (#6721) · 869e7336
  jh-nv authored Mar 04, 2026
  
  869e7336
04 Mar, 2026 6 commits
- fix(gms): resolve socket UUIDs via CUDA driver API (#6891) · 96237ba1
  Schwinn Saereesitthipitak authored Mar 04, 2026
  
  96237ba1
- chore: add mypy typing to frontend (#6861) · 2128d48a
  jh-nv authored Mar 04, 2026
  
  2128d48a
- chore: add mypy for router (#6864) · a96f5d73
  jh-nv authored Mar 04, 2026
  
  a96f5d73
- chore(kv-router): split monolithic indexer.rs into indexer/ directory (#6870) · b94cb543
  Yan Ru Pei authored Mar 04, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  b94cb543
- docs: fix invalid link for veto-events (#6867) · 3c0a0d75
  Ryan Olson authored Mar 04, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  3c0a0d75
- feat(kv-indexer): multi-model and multi-tenant isolation (#6830) · 35f99f93
  Yan Ru Pei authored Mar 04, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  35f99f93
03 Mar, 2026 8 commits
- fix: properly setup and register vLLM worker for external / hybrid load... · 90d74637
  GuanLuo authored Mar 03, 2026
```
fix: properly setup and register vLLM worker for external / hybrid load balancing. Update launch script (#6695)
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
```
  90d74637
- chore: update nixl version to 0.10.1 (#6826) · 9254e3d4
  Anant Sharma authored Mar 03, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  9254e3d4
- chore(kv-router): deduplicate KvRouterConfig args into shared ArgGroup (#6805) · 9f3b7b33
  Yan Ru Pei authored Mar 03, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  9f3b7b33
- fix: pass in device_id to KVBM PinnedAllocator instead of hard code to 0 (#6809) · 0da960f1
  Ziqi Fan authored Mar 03, 2026
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  0da960f1
- fix(kv-router): plumb expected_osl through scheduler queue path (#6812) · 8055b7dd
  Yan Ru Pei authored Mar 03, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  8055b7dd
- feat: upgrade rust to v1.93.0 (#6802) · 57bdbdf1
  Ryan Olson authored Mar 03, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  57bdbdf1
- feat(kvbm): add testing utilities to kvbm-logical and kvbm-physical (#6691) · 76042959
  Ryan Olson authored Mar 02, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  76042959
- feat(kv-router): add router queue depth Prometheus metric and nvext field (#6786) · 073fb437
  Yan Ru Pei authored Mar 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  073fb437
02 Mar, 2026 5 commits
- perf(kv-router): linear scan improvements [DYN-2164] (#6363) · d24cfbe1
  Yan Ru Pei authored Mar 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  d24cfbe1
- fix: Fix vLLM KVBM integration test (#6768) · 9d10e050
  Kris Hung authored Mar 02, 2026
  
  9d10e050
- feat: Full Anthropic Messages API cache_control support (top-level, per-block,... · 4d3e1ae3
  MatejKosec authored Mar 02, 2026
```
feat: Full Anthropic Messages API cache_control support (top-level, per-block, system block arrays) (#6629)
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  4d3e1ae3
- feat: move standalone KV indexer into kv-router crate with HTTP integration tests (#6569) · 07742cc2
  Yan Ru Pei authored Mar 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  07742cc2
- chore(style): Log with {var} style in lib/runtime (#6757) · 9e6a84af
  Ryan McCormick authored Mar 02, 2026
  
  9e6a84af