Commits · b441e26a6a288ff0fee65ce13b21a1b75268dd5a · OpenDAS / dynamo · GitLab

22 Apr, 2026 2 commits

feat: Interface for shared kv cache handling in kv routing (#7536) · b441e26a

jthomson04 authored Apr 22, 2026

Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

b441e26a

docs: update docs for 1.1.0 DGDR (#8511) · cf92be04

hhzhang16 authored Apr 22, 2026

Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

cf92be04

20 Apr, 2026 2 commits
- feat: (Router) Guard threshold-based rejection logic when CLI thresholds are unset (#8333) · adfc02d5
  Karen Chung authored Apr 20, 2026
  
  adfc02d5
- feat(frontend): gate nvext response metadata behind extra_fields (#8252) · f437c8cf
  Biswa Panda authored Apr 20, 2026
```
Co-authored-by: AmeenP <ameenp360@gmail.com>
```
  f437c8cf
17 Apr, 2026 1 commit
- docs: improve KVBM guide by adding NGC and --platform (#8313) · 595ff0fa
  Ziqi Fan authored Apr 17, 2026
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  595ff0fa
14 Apr, 2026 3 commits
- feat(planner): add live diagnostics dashboard HTTP endpoint (#8168) · 091cdb51
  Hongkuan Zhou authored Apr 14, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  091cdb51
- feat: add fasttokens benchmarks and tokenizer backend docs (#7388) · 8f4bd3b4
  Biswa Panda authored Apr 13, 2026
  
  8f4bd3b4
- feat(planner): add optimization_target for easy-mode scaling (#8137) · 9cf9ef18
  Hongkuan Zhou authored Apr 13, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  9cf9ef18
13 Apr, 2026 3 commits
- feat(sglang): add ephemeral KV session routing (#7665) · 9498f016
  ishandhanani authored Apr 13, 2026
```
Signed-off-by: Ishan Dhanani <ishandhanani@gmail.com>
```
  9498f016
- docs(router): split router docs into focused pages (#8122) · 49087845
  Yan Ru Pei authored Apr 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  49087845
- feat: route requests by device type and load for sglang epd (#7215) · a7d51b39
  Wang, Yi authored Apr 14, 2026
```
Signed-off-by: Wang, Yi <yi.a.wang@intel.com>
```
  a7d51b39
11 Apr, 2026 1 commit
- feat(planner): add diagnostics metrics, rename to dynamo_planner_*, and add HTML report (#8078) · f8920708
  Hongkuan Zhou authored Apr 10, 2026
  
  f8920708
08 Apr, 2026 2 commits
- feat(planner): unify throughput and load scaling on FPM regression (#7961) · 66f7832a
  Hongkuan Zhou authored Apr 08, 2026
  
  66f7832a
- feat(kv-router): split Dynamo-native remote indexer [DYN-2593] (#7973) · 49eb397a
  Yan Ru Pei authored Apr 07, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  49eb397a
07 Apr, 2026 1 commit
- feat: deprecated namespace-restricted mode (#7934) · ad3a46a6
  Julien Mancuso authored Apr 07, 2026
  
  ad3a46a6
06 Apr, 2026 2 commits
- chore(replay): refactor offline components into cleaner lanes (#7866) · 95a750f4
  Yan Ru Pei authored Apr 06, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  95a750f4
- feat(kvbm): KVBM MLA support optimization (#7015) · 1caf6659
  Aniket Kulkarni authored Apr 06, 2026
```
Signed-off-by: aknvda <anikkulkarni@nvidia.com>
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: jthomson04 <jwillthomson19@gmail.com>
```
  1caf6659
02 Apr, 2026 2 commits
- feat: enable KVBM Disk allocation support different storage types (#7839) · 234a89c0
  Ziqi Fan authored Apr 02, 2026
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  234a89c0
- refactor(protocols): deprecate cache control (#7790) · c09ac697
  ishandhanani authored Apr 01, 2026
  
  c09ac697
01 Apr, 2026 2 commits
- test(planner): isolate planner-family suites [DYN-2534] (#7723) · ab5a31b5
  Alec authored Mar 31, 2026
  
  ab5a31b5
- feat: add least-loaded router (#6314) · cc22114d
  kornelcsernai-harmonic authored Mar 31, 2026
```
Signed-off-by: Kornel Csernai <239206175+kornelcsernai-harmonic@users.noreply.github.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>
```
  cc22114d
28 Mar, 2026 1 commit
- chore: remove stale example assets (#7059) · 7dfbe4fd
  Alec authored Mar 27, 2026
  
  7dfbe4fd
27 Mar, 2026 1 commit
- chore(mocker): batch live output signal sends (#7647) · a2154ba5
  Yan Ru Pei authored Mar 26, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  a2154ba5
26 Mar, 2026 1 commit
- refactor: load planner using new forwardpass metric and many improvements (#7351) · a58bcc31
  Hongkuan Zhou authored Mar 25, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  a58bcc31
25 Mar, 2026 1 commit
- feat(mocker): add offline disagg replay (#7617) · 02b1c58a
  Yan Ru Pei authored Mar 25, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  02b1c58a
24 Mar, 2026 1 commit
- feat(router): add best_worker indexer update flag (#7603) · 149bf5a2
  Yan Ru Pei authored Mar 24, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  149bf5a2
23 Mar, 2026 1 commit
- feat(mocker): add multi-worker replay and router startup fixes (#7553) · b7fe46b1
  Yan Ru Pei authored Mar 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b7fe46b1
20 Mar, 2026 1 commit
- feat(llm): unify user-facing priority hints (#7492) · ebd06a1f
  Yan Ru Pei authored Mar 20, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ebd06a1f
15 Mar, 2026 2 commits
- feat(kv-indexer): add python launcher follow-up [DYN-2459] (#7395) · 56b448a6
  Yan Ru Pei authored Mar 15, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  56b448a6
- chore(kv-router): remove native kv-indexer binary, use maturin-built one (#7338) · b6596c52
  Yan Ru Pei authored Mar 15, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b6596c52
14 Mar, 2026 2 commits
- docs: fix broken links, typo, blog nav, and CUDA version (#7380) · 4ef8b8e6
  dagil-nvidia authored Mar 14, 2026
```
Signed-off-by: Dan Gil <dagil@nvidia.com>
```
  4ef8b8e6
- feat: standalone KV indexer runtime integration (#7295) · bba70a41
  Thomas Montfort authored Mar 14, 2026
  
  bba70a41
13 Mar, 2026 4 commits
- docs: update KVBM diagram and bump container image tags to 1.0.0 (#7365) · 46dad85b
  dagil-nvidia authored Mar 13, 2026
```
Signed-off-by: Dan Gil <dagil@nvidia.com>
```
  46dad85b
- test: generalize router test infrastructure and expand documentations (#7327) · 33604afa
  Keiven C authored Mar 13, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  33604afa
- feat(kv-router): add Prometheus metrics to standalone indexer (#7339) · 5aa2f53f
  Yan Ru Pei authored Mar 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  5aa2f53f
- feat(kv-router): pluggable scheduling policy for router queue [DYN-2454] (#7260) · bddaaa26
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  bddaaa26
12 Mar, 2026 4 commits
- docs: improve Planner documentation clarity and fix incorrect defaults (#7303) · 197f6595
  Anish authored Mar 12, 2026
```
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  197f6595
- docs: update KVBM diagram from PNG to SVG (#7277) · 330f001d
  dagil-nvidia authored Mar 12, 2026
```
Signed-off-by: akshatha-k <akshutk@gmail.com>
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: akshatha-k <akshutk@gmail.com>
```
  330f001d
- chore: remove outdated router_standalone_trtllm example and add standalone router docs (#7278) · bb43fada
  dagil-nvidia authored Mar 12, 2026
```
Signed-off-by: akshatha-k <akshutk@gmail.com>
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: akshatha-k <akshutk@gmail.com>
```
  bb43fada
- feat(kv-router): ZMQ gap detection + replay for standalone indexer [LLM-126] (#7209) · bb07b2f4
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  bb07b2f4