Commits · 989e246eb4669594ccd19a8dbf02f2a363b18c82 · OpenDAS / dynamo · GitLab

20 Nov, 2025 1 commit
- chore: Use general engine source for KVBM KV events (#4515) · 2f18b23e
  Kris Hung authored Nov 20, 2025
  
  2f18b23e
14 Nov, 2025 1 commit
- fix(router): change prune channel to be mpsc instead of watch, increase max size (#4351) · 2cf427ed
  Waël Boukhobza authored Nov 14, 2025
```
Signed-off-by: Wael Boukhobza <wawa_wael@live.fr>
```
  2cf427ed
13 Nov, 2025 2 commits
- chore: better error handling in prefill router (#4286) · ce833983
  Yan Ru Pei authored Nov 13, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ce833983
- feat: kv router should route to available instances (#4225) · 8379b0cd
  Yan Ru Pei authored Nov 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  8379b0cd
12 Nov, 2025 1 commit
- feat(router): max tree size based pruning (#4057) · 3ea22fcf
  Waël Boukhobza authored Nov 12, 2025
```
Signed-off-by: Wael Boukhobza <wawa_wael@live.fr>
```
  3ea22fcf
11 Nov, 2025 1 commit
- chore: Remove static mode (#4235) · e1af3af6
  Graham King authored Nov 11, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  e1af3af6
08 Nov, 2025 1 commit
- feat: Media decoder and fetcher options in the MDC (#4094) · 14af074e
  milesial authored Nov 07, 2025
```
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
```
  14af074e
07 Nov, 2025 1 commit
- feat(keyvalue): Filesystem backed KeyValueStore (#4138) · 794c0a44
  Graham King authored Nov 07, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  794c0a44
05 Nov, 2025 2 commits
- chore: no need for explicit Python::with_gil (#4075) · 427ca9ab
  Yan Ru Pei authored Nov 04, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  427ca9ab
- feat: release gil for publisher (#3747) · defe5de7
  Michael Feil authored Nov 04, 2025
```
Signed-off-by: michaelfeil <me@michaelfeil.eu>
```
  defe5de7
03 Nov, 2025 1 commit
- chore: Remove old DisaggregatedRouter, making etcd presence optional (#4011) · dadf0e22
  Graham King authored Nov 03, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  dadf0e22
31 Oct, 2025 1 commit

chore: KVBM pip wheel (#3826) · 6afa679c

Richard Huo authored Oct 31, 2025


Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>

6afa679c

30 Oct, 2025 1 commit
- feat: Add KV event consolidator for KVBM (vllm) and router integration (#3725) · 18986010
  Kris Hung authored Oct 30, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  18986010
28 Oct, 2025 2 commits
- feat: mocker disagg (#3833) · cc4c3516
  Yan Ru Pei authored Oct 28, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  cc4c3516
- chore(runtime): Do not expose etcd lease ID (#3915) · c78b5901
  Graham King authored Oct 28, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  c78b5901
27 Oct, 2025 1 commit

feat: Use ForwardPassCallback api from TRTLLM to register end of forward pass... · 0028cdf4

Kyle McGill authored Oct 27, 2025


feat: Use ForwardPassCallback api from TRTLLM to register end of forward pass callback to enable cuda graphs (#3297)
Signed-off-by: Kyle McGill <kmcgill@nvidia.com>

0028cdf4

23 Oct, 2025 3 commits
- chore: Use KeyValueStoreManager instead of etcd::Client (#3822) · 7731b024
  Graham King authored Oct 23, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  7731b024
- chore: restructure mocker cli args handling, to include prefill/decode (#3847) · 41ff394f
  Yan Ru Pei authored Oct 23, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  41ff394f
- refactor: kvbm modularity DIS-657 Eliminate ETCD from the leader-worker initialization (#3202) · 94aa2a7b
  Richard Huo authored Oct 23, 2025
```
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  94aa2a7b
22 Oct, 2025 1 commit
- feat: python gil release for radix tree + dump_tree_as_events in python (#3748) · 681951d4
  Michael Feil authored Oct 21, 2025
```
Signed-off-by: michaelfeil <me@michaelfeil.eu>
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
```
  681951d4
21 Oct, 2025 2 commits
- feat: bake prefill router into frontend, supporting vllm for now (#3762) · e01c6e99
  Yan Ru Pei authored Oct 21, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  e01c6e99
- feat: enable KVBM GPU offload to Disk bypassing CPU (#3510) · d5840cda
  Ziqi Fan authored Oct 21, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  d5840cda
17 Oct, 2025 1 commit
- chore: remove kv metrics scraping and aggregation (#3701) · 4c207e0c
  Yan Ru Pei authored Oct 17, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  4c207e0c
16 Oct, 2025 2 commits
- fix: mocker engines should ignore downloading weights from hf (again) (#3664) · ae4e96a2
  Yan Ru Pei authored Oct 15, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ae4e96a2
- feat: dp rank routing (#3597) · f978f4d1
  Yan Ru Pei authored Oct 15, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f978f4d1
15 Oct, 2025 2 commits
- fix: avoid offload redundant prefill blocks | fix cuda graph hanging (#3632) · f5854e17
  Ziqi Fan authored Oct 15, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  f5854e17
- feat: Python binding to download a model. (#3593) · ab0da582
  Graham King authored Oct 15, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  ab0da582
13 Oct, 2025 1 commit
- feat: remove stale workers on snapshot + some refactoring (#3589) · b5e762b2
  Yan Ru Pei authored Oct 13, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b5e762b2
11 Oct, 2025 3 commits
- chore: consolidations of KvPushRouter bindings and usage examples (#3543) · c3fcfdd6
  Yan Ru Pei authored Oct 10, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  c3fcfdd6
- feat: implement custom backend metrics for NIM (#3266) · 65cc5337
  Keiven C authored Oct 10, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  65cc5337
- feat: rm the old KVBM metrics | update G2 to G3 metrics collection (#3561) · 4224e57d
  Ziqi Fan authored Oct 10, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  4224e57d
10 Oct, 2025 3 commits
- chore: Remove model_config from LocalModel (#3558) · 0e0218ff
  Graham King authored Oct 10, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  0e0218ff
- feat: add KVBM host to disk metrics | clean up dashboard (#3534) · ca674098
  Ziqi Fan authored Oct 10, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  ca674098
- feat: add disk offloading filtering in KVBM (#3532) · b94ecd16
  Ziqi Fan authored Oct 10, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  b94ecd16
08 Oct, 2025 2 commits
- feat: enable KVBM to support PD disagg in Dynamo vLLM (#3352) · 9975cb9f
  Ziqi Fan authored Oct 08, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  9975cb9f
- feat: DIS-678 kvbm modularity: standalone metrics endpoint (#3433) · cf83794a
  Richard Huo authored Oct 08, 2025
```
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  cf83794a
04 Oct, 2025 1 commit
- feat: use KvPushRouter for prefill router (#3401) · 30610e73
  Yan Ru Pei authored Oct 03, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  30610e73
01 Oct, 2025 3 commits
- feat: Transition to FullyContiguous Host and Disk layouts (#3090) · d2e3b66e
  Olga Andreeva authored Oct 01, 2025
```
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
Signed-off-by: Olga Andreeva <124622579+oandreeva-nv@users.noreply.github.com>
Co-authored-by: oandreeva-nv <oandreeva-nv@nvidia.com>
```
  d2e3b66e
- fix: DIS-706 skip offloading the G1 matched blocks during offloading (#3299) · 713e9e48
  Richard Huo authored Oct 01, 2025
```
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  713e9e48
- feat: make prefill router general (#3329) · 9b9536d0
  Yan Ru Pei authored Sep 30, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  9b9536d0