Commits · 0b33c1dfa0c1c88b4c728e600aa62a1be594b0c6 · OpenDAS / dynamo

31 Dec, 2025 1 commit

fix: sglang disagg routing fixes and optimizations [DYN-1692] (#5106) · 0b33c1df

Yan Ru Pei authored Dec 31, 2025


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
Co-authored-by: Sean SH Choi <sechoi@nvidia.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

0b33c1df

25 Dec, 2025 1 commit
- feat: Book-keeping bindings [DEP-689] (#5036) · 01f77f2c
  atchernych authored Dec 25, 2025
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  01f77f2c
19 Dec, 2025 2 commits
- chore: clean up PreprocessedRequest (#5040) · f4245c99
  Yan Ru Pei authored Dec 19, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f4245c99
- feat: add multimodal support to KV router with standalone trtllm example (#4577) · 481dc636
  zhongdaor-nv authored Dec 18, 2025
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com>
```
  481dc636
18 Dec, 2025 2 commits
- feat: unify per-request metric tracking (#5004) · 85b5c808
  Yan Ru Pei authored Dec 18, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  85b5c808
- feat: support disag serving in GAIE [DEP-659] (#4756) · 15b49818
  atchernych authored Dec 18, 2025
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  15b49818
17 Dec, 2025 2 commits

feat: add frontend based prefill request routing for sglang (#4635) · 1c39e483

Sean SH Choi authored Dec 17, 2025


Signed-off-by: Sean Choi <sechoi@nvidia.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

1c39e483

fix: make gap detection work e2e (#4993) · 0fba01c2
Yan Ru Pei authored Dec 16, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
0fba01c2

12 Dec, 2025 1 commit
- feat: support decentralized router with NATs core (#4921) · ef3027bd
  Yan Ru Pei authored Dec 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ef3027bd
11 Dec, 2025 1 commit
- feat: worker-local KvIndexer in KvEventPublisher (#4519) · 33249945
  Karen Chung authored Dec 11, 2025
```
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
```
  33249945
09 Dec, 2025 1 commit
- chore: cleanups of passing around prefill and decode worker ids (#4829) · 1e5b20b2
  Yan Ru Pei authored Dec 09, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1e5b20b2
25 Nov, 2025 2 commits
- chore: make router use the discovery pattern instead of manual kv watch (#4597) · 9c5018e5
  Yan Ru Pei authored Nov 25, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  9c5018e5
- fix: expose prefill worker id in disagg (#4563) · 57c701fb
  Yan Ru Pei authored Nov 24, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  57c701fb
21 Nov, 2025 2 commits
- chore: merge KvIndexer and ApproxKvIndexer (#4500) · c61e0dd3
  Yan Ru Pei authored Nov 21, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c61e0dd3
- fix: worker_id updates not applied (#4518) · 989e246e
  Zhongxuan (Daniel) Wang authored Nov 21, 2025
```
Signed-off-by: Zhongxuan (Daniel) Wang <daniewang@nvidia.com>
```
  989e246e
20 Nov, 2025 1 commit
- chore: better error handling in Router slot manager (#4496) · c0c664a9
  Yan Ru Pei authored Nov 19, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c0c664a9
19 Nov, 2025 1 commit
- feat: nvext field to OpenAI APIs and add worker_id reporting (vLLM) (#4372) · 263f99dc
  Zhongxuan (Daniel) Wang authored Nov 18, 2025
```
Signed-off-by: Zhongxuan Wang <daniewang@nvidia.com>
```
  263f99dc
14 Nov, 2025 1 commit
- fix(router): change prune channel to be mpsc instead of watch, increase max size (#4351) · 2cf427ed
  Waël Boukhobza authored Nov 14, 2025
```
Signed-off-by: Wael Boukhobza <wawa_wael@live.fr>
```
  2cf427ed
13 Nov, 2025 1 commit
- feat: kv router should route to available instances (#4225) · 8379b0cd
  Yan Ru Pei authored Nov 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  8379b0cd
12 Nov, 2025 2 commits
- feat: tie break on tree size when routing (#4257) · 7d604dd3
  Yan Ru Pei authored Nov 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7d604dd3
- feat(router): max tree size based pruning (#4057) · 3ea22fcf
  Waël Boukhobza authored Nov 12, 2025
```
Signed-off-by: Wael Boukhobza <wawa_wael@live.fr>
```
  3ea22fcf
11 Nov, 2025 1 commit
- chore: Remove static mode (#4235) · e1af3af6
  Graham King authored Nov 11, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  e1af3af6
08 Nov, 2025 1 commit
- fix: refactor to use service discovery (#4092) · 09b26bf6
  mohammedabdulwahhab authored Nov 08, 2025
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  09b26bf6
05 Nov, 2025 1 commit
- feat: remove distributed locks dependency from Router (#4113) · 1ab2fe1b
  Yan Ru Pei authored Nov 05, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1ab2fe1b
28 Oct, 2025 1 commit
- chore(runtime): Do not expose etcd lease ID (#3915) · c78b5901
  Graham King authored Oct 28, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  c78b5901
21 Oct, 2025 1 commit
- feat: bake prefill router into frontend, supporting vllm for now (#3762) · e01c6e99
  Yan Ru Pei authored Oct 21, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  e01c6e99
17 Oct, 2025 1 commit
- chore: remove kv metrics scraping and aggregation (#3701) · 4c207e0c
  Yan Ru Pei authored Oct 17, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  4c207e0c
16 Oct, 2025 1 commit
- feat: dp rank routing (#3597) · f978f4d1
  Yan Ru Pei authored Oct 15, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f978f4d1
15 Oct, 2025 1 commit
- feat: router frees request from slot manager on stopped requests (#3623) · 6a1391eb
  Yan Ru Pei authored Oct 14, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  6a1391eb
13 Oct, 2025 1 commit
- feat: remove stale workers on snapshot + some refactoring (#3589) · b5e762b2
  Yan Ru Pei authored Oct 13, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b5e762b2
11 Oct, 2025 1 commit

chore: consolidations of KvPushRouter bindings and usage examples (#3543) · c3fcfdd6

Yan Ru Pei authored Oct 10, 2025


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

c3fcfdd6

07 Oct, 2025 1 commit
- chore(discovery): Watch/publish ModelDeploymentCard instead of ModelEntry (#3350) · 81162dfe
  Graham King authored Oct 07, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  81162dfe
29 Sep, 2025 1 commit
- fix: more fixes for stable router benchmarking (#3264) · 3aa30778
  Yan Ru Pei authored Sep 29, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  3aa30778
22 Sep, 2025 1 commit
- feat: vllm prefill router (#3155) · 031590fc
  Yan Ru Pei authored Sep 22, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  031590fc
19 Sep, 2025 1 commit

feat: allow router to not track active blocks (prefill), and to not track... · 5b19a39b

Yan Ru Pei authored Sep 19, 2025


feat: allow router to not track active blocks (prefill), and to not track cached blocks (decode) (#3135)
Signed-off-by: PeaBrane <yanrpei@gmail.com>

5b19a39b

17 Sep, 2025 1 commit
- fix: hook up worker removals for indexer (#3095) · 78a3feda
  Yan Ru Pei authored Sep 17, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  78a3feda
16 Sep, 2025 1 commit
- feat: kv commit router (#3024) · 0373b897
  Michael Feil authored Sep 16, 2025
```
Signed-off-by: michaelfeil <me@michaelfeil.eu>
```
  0373b897
10 Sep, 2025 1 commit
- feat: adds kv indexer metrics (#2905) · 40000976
  blarson-b10 authored Sep 10, 2025
```
Signed-off-by: Brian Larson <brian.larson@baseten.co>
```
  40000976
03 Sep, 2025 1 commit
- feat: don't modify kv scheduler states on query + more python binding (#2798) · 383e3b3a
  Yan Ru Pei authored Sep 02, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  383e3b3a
01 Sep, 2025 1 commit
- fix: do not delete KV events jetstream (#2800) · 7fabe7bf
  Yan Ru Pei authored Sep 01, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7fabe7bf