Commits · cd7b149249f801ceeec0da0edd9d02f32b26bc15 · OpenDAS / dynamo · GitLab

18 Dec, 2025 2 commits
- feat: unify per-request metric tracking (#5004) · 85b5c808
  Yan Ru Pei authored Dec 18, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  85b5c808
- feat(frontend): First part of Python request handling (#4999) · da0f2fb8
  Graham King authored Dec 17, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  da0f2fb8
17 Dec, 2025 1 commit

feat: add frontend based prefill request routing for sglang (#4635) · 1c39e483

Sean SH Choi authored Dec 17, 2025


Signed-off-by: Sean Choi <sechoi@nvidia.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

1c39e483

16 Dec, 2025 1 commit
- feat: video decoder in the frontend (#4719) · 74fcd4a9
  milesial authored Dec 16, 2025
```
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
```
  74fcd4a9
12 Dec, 2025 1 commit
- chore: enable local indexers for sglang and trtllm (#4932) · c2a29f80
  Yan Ru Pei authored Dec 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c2a29f80
11 Dec, 2025 2 commits
- feat: worker-local KvIndexer in KvEventPublisher (#4519) · 33249945
  Karen Chung authored Dec 11, 2025
```
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
```
  33249945
- feat: early rejection based on active prefill tokens (#4837) · 10b01b45
  Yan Ru Pei authored Dec 11, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  10b01b45
02 Dec, 2025 1 commit
- feat: lora - centralize lora cache key, restructure folders, s3 resiliency (#4644) · 71f94eda
  Biswa Panda authored Dec 02, 2025
  
  71f94eda
26 Nov, 2025 1 commit
- feat: add LoRA common APIs and implementation for lora management (#4464) · 6a0e67ed
  Biswa Panda authored Nov 26, 2025
  
  6a0e67ed
25 Nov, 2025 1 commit
- refactor(llm): Rename EngineConfig::Static to InProcess (#4585) · 0fc5273c
  Graham King authored Nov 25, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  0fc5273c
21 Nov, 2025 1 commit
- chore: merge KvIndexer and ApproxKvIndexer (#4500) · c61e0dd3
  Yan Ru Pei authored Nov 21, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c61e0dd3
20 Nov, 2025 1 commit
- chore: Use general engine source for KVBM KV events (#4515) · 2f18b23e
  Kris Hung authored Nov 20, 2025
  
  2f18b23e
14 Nov, 2025 1 commit
- fix(router): change prune channel to be mpsc instead of watch, increase max size (#4351) · 2cf427ed
  Waël Boukhobza authored Nov 14, 2025
```
Signed-off-by: Wael Boukhobza <wawa_wael@live.fr>
```
  2cf427ed
13 Nov, 2025 2 commits
- chore: better error handling in prefill router (#4286) · ce833983
  Yan Ru Pei authored Nov 13, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ce833983
- feat: kv router should route to available instances (#4225) · 8379b0cd
  Yan Ru Pei authored Nov 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  8379b0cd
12 Nov, 2025 1 commit
- feat(router): max tree size based pruning (#4057) · 3ea22fcf
  Waël Boukhobza authored Nov 12, 2025
```
Signed-off-by: Wael Boukhobza <wawa_wael@live.fr>
```
  3ea22fcf
11 Nov, 2025 1 commit
- chore: Remove static mode (#4235) · e1af3af6
  Graham King authored Nov 11, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  e1af3af6
08 Nov, 2025 1 commit
- feat: Media decoder and fetcher options in the MDC (#4094) · 14af074e
  milesial authored Nov 07, 2025
```
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
```
  14af074e
07 Nov, 2025 1 commit
- feat(keyvalue): Filesystem backed KeyValueStore (#4138) · 794c0a44
  Graham King authored Nov 07, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  794c0a44
05 Nov, 2025 2 commits
- chore: no need for explicit Python::with_gil (#4075) · 427ca9ab
  Yan Ru Pei authored Nov 04, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  427ca9ab
- feat: release gil for publisher (#3747) · defe5de7
  Michael Feil authored Nov 04, 2025
```
Signed-off-by: michaelfeil <me@michaelfeil.eu>
```
  defe5de7
03 Nov, 2025 1 commit
- chore: Remove old DisaggregatedRouter, making etcd presence optional (#4011) · dadf0e22
  Graham King authored Nov 03, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  dadf0e22
31 Oct, 2025 1 commit

chore: KVBM pip wheel (#3826) · 6afa679c

Richard Huo authored Oct 31, 2025


Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>

6afa679c

30 Oct, 2025 1 commit
- feat: Add KV event consolidator for KVBM (vllm) and router integration (#3725) · 18986010
  Kris Hung authored Oct 30, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  18986010
28 Oct, 2025 2 commits
- feat: mocker disagg (#3833) · cc4c3516
  Yan Ru Pei authored Oct 28, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  cc4c3516
- chore(runtime): Do not expose etcd lease ID (#3915) · c78b5901
  Graham King authored Oct 28, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  c78b5901
27 Oct, 2025 1 commit

feat: Use ForwardPassCallback api from TRTLLM to register end of forward pass... · 0028cdf4

Kyle McGill authored Oct 27, 2025


feat: Use ForwardPassCallback api from TRTLLM to register end of forward pass callback to enable cuda graphs (#3297)
Signed-off-by: Kyle McGill <kmcgill@nvidia.com>

0028cdf4

23 Oct, 2025 3 commits
- chore: Use KeyValueStoreManager instead of etcd::Client (#3822) · 7731b024
  Graham King authored Oct 23, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  7731b024
- chore: restructure mocker cli args handling, to include prefill/decode (#3847) · 41ff394f
  Yan Ru Pei authored Oct 23, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  41ff394f
- refactor: kvbm modularity DIS-657 Eliminate ETCD from the leader-worker initialization (#3202) · 94aa2a7b
  Richard Huo authored Oct 23, 2025
```
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  94aa2a7b
22 Oct, 2025 1 commit
- feat: python gil release for radix tree + dump_tree_as_events in python (#3748) · 681951d4
  Michael Feil authored Oct 21, 2025
```
Signed-off-by: michaelfeil <me@michaelfeil.eu>
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
```
  681951d4
21 Oct, 2025 2 commits
- feat: bake prefill router into frontend, supporting vllm for now (#3762) · e01c6e99
  Yan Ru Pei authored Oct 21, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  e01c6e99
- feat: enable KVBM GPU offload to Disk bypassing CPU (#3510) · d5840cda
  Ziqi Fan authored Oct 21, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  d5840cda
17 Oct, 2025 1 commit
- chore: remove kv metrics scraping and aggregation (#3701) · 4c207e0c
  Yan Ru Pei authored Oct 17, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  4c207e0c
16 Oct, 2025 2 commits
- fix: mocker engines should ignore downloading weights from hf (again) (#3664) · ae4e96a2
  Yan Ru Pei authored Oct 15, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ae4e96a2
- feat: dp rank routing (#3597) · f978f4d1
  Yan Ru Pei authored Oct 15, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f978f4d1
15 Oct, 2025 2 commits
- fix: avoid offload redundant prefill blocks | fix cuda graph hanging (#3632) · f5854e17
  Ziqi Fan authored Oct 15, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  f5854e17
- feat: Python binding to download a model. (#3593) · ab0da582
  Graham King authored Oct 15, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  ab0da582
13 Oct, 2025 1 commit
- feat: remove stale workers on snapshot + some refactoring (#3589) · b5e762b2
  Yan Ru Pei authored Oct 13, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b5e762b2
11 Oct, 2025 1 commit

chore: consolidations of KvPushRouter bindings and usage examples (#3543) · c3fcfdd6

Yan Ru Pei authored Oct 10, 2025


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

c3fcfdd6