Commits · b441e26a6a288ff0fee65ce13b21a1b75268dd5a · OpenDAS / dynamo · GitLab

22 Apr, 2026 1 commit

feat: Interface for shared kv cache handling in kv routing (#7536) · b441e26a

jthomson04 authored Apr 22, 2026

Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

b441e26a

16 Apr, 2026 1 commit
- fix(discovery): add missing Audios model type to is_model_type_list_empty (#8241) · 67bc6a1f
  MatejKosec authored Apr 16, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  67bc6a1f
14 Apr, 2026 1 commit
- fix(runtime): graceful removal of disagg model from /v1/models when prefill engine dies (#7131) · d2aad651
  Biswa Panda authored Apr 14, 2026
  
  d2aad651
13 Apr, 2026 1 commit
- feat: route requests by device type and load for sglang epd (#7215) · a7d51b39
  Wang, Yi authored Apr 14, 2026
```
Signed-off-by: Wang, Yi <yi.a.wang@intel.com>
```
  a7d51b39
06 Apr, 2026 1 commit
- chore(replay): refactor offline components into cleaner lanes (#7866) · 95a750f4
  Yan Ru Pei authored Apr 06, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  95a750f4
31 Mar, 2026 1 commit
- feat: add initial audio/TTS pipeline support for vLLM-omni backend (#7495) · cbbde3d0
  Zhongdongming Dai authored Mar 31, 2026
```
Signed-off-by: Zhongdongming Dai <zhongdongmin@nvidia.com>
```
  cbbde3d0
30 Mar, 2026 1 commit
- feat(runtime): scope MDC checksum validation to per-WorkerSet (#7368) · d6136f4a
  Thomas Montfort authored Mar 30, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  d6136f4a
27 Mar, 2026 1 commit
- chore(mocker): batch live output signal sends (#7647) · a2154ba5
  Yan Ru Pei authored Mar 26, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  a2154ba5
25 Mar, 2026 1 commit

fix: sglang eagle bigram tokens kv event report. (#6872) · 2fe37a51

huitian bai authored Mar 25, 2026


Signed-off-by: baihuitian <baihuitian.bht@gmail.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>

2fe37a51

23 Mar, 2026 1 commit
- feat(mocker): add multi-worker replay and router startup fixes (#7553) · b7fe46b1
  Yan Ru Pei authored Mar 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b7fe46b1
17 Mar, 2026 1 commit
- chore(kv-router): drop easy llm facade reexports (#7474) · 45be2fdc
  Yan Ru Pei authored Mar 17, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  45be2fdc
14 Mar, 2026 1 commit
- feat: standalone KV indexer runtime integration (#7295) · bba70a41
  Thomas Montfort authored Mar 14, 2026
  
  bba70a41
12 Mar, 2026 1 commit
- feat(kv-router): add worker_type to router selection log (#7258) · dcbccbcd
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  dcbccbcd
06 Mar, 2026 1 commit
- fix: hide inactive models from /v1/models (#6966) · a9064c51
  Schwinn Saereesitthipitak authored Mar 06, 2026
  
  a9064c51
23 Feb, 2026 2 commits
- feat(runtime): add hierarchical Model/WorkerSet architecture for multi-namespace support (#6054) · cb55766c
  Thomas Montfort authored Feb 23, 2026
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
```
  cb55766c
- fix: derive kv-router discovery name from target worker component (#6475) · e66f3267
  Yan Ru Pei authored Feb 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  e66f3267
19 Feb, 2026 1 commit
- chore: derive router_id and cancellation_token from component instead of plumbing (#6419) · 1549c338
  Yan Ru Pei authored Feb 19, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  1549c338
18 Feb, 2026 1 commit
- fix: wire reasoning parser from worker runtime config into frontend (#6300) · b8c7015f
  MatejKosec authored Feb 17, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  b8c7015f
13 Feb, 2026 1 commit
- feat: add video generation support (T2V) (#5793) · 2be83be2
  ishandhanani authored Feb 13, 2026
  
  2be83be2
09 Feb, 2026 1 commit
- feat: text to image vLLM Omni (#5912) · 9f76d060
  Ayush Agarwal authored Feb 09, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  9f76d060
08 Feb, 2026 1 commit

chore: enable local indexers by default, and use normal event plane by default... · 6783bdca

Yan Ru Pei authored Feb 08, 2026


chore: enable local indexers by default, and use normal event plane by default (not jetstream) (#5941)
Signed-off-by: PeaBrane <yanrpei@gmail.com>

6783bdca

04 Feb, 2026 1 commit
- feat: Add per-worker Prometheus metrics for router load monitoring (#5842) · 0c0336e6
  Hongkuan Zhou authored Feb 04, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  0c0336e6
03 Feb, 2026 2 commits
- feat: image diffusion with SGLang diffusion (#5609) · 7e970d44
  Konrad Nowicki authored Feb 03, 2026
```
Signed-off-by: Konrad Nowicki <knowicki@nvidia.com>
Co-authored-by: dagil-nvidia <dagil@nvidia.com>
```
  7e970d44
- feat: prefill tokens threshold based on max num batched tokens frac (#5867) · a337113a
  Yan Ru Pei authored Feb 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  a337113a
02 Feb, 2026 1 commit
- chore: in discovery, use dashmap in place of mutex hashmap (#5868) · 8dd1fc07
  Yan Ru Pei authored Feb 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  8dd1fc07
29 Jan, 2026 1 commit
- chore: consistently used the arc shared workers configs + CI flake fixes (#5707) · 584020f4
  Yan Ru Pei authored Jan 29, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  584020f4
18 Jan, 2026 1 commit
- chore: use u64 as router consumer id instead of uuid (#5478) · 602ce0ed
  Yan Ru Pei authored Jan 18, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  602ce0ed
10 Jan, 2026 1 commit
- fix: fix bug in diffing logic in list_and_watch (#5318) · 2f9812aa
  mohammedabdulwahhab authored Jan 10, 2026
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  2f9812aa
06 Jan, 2026 1 commit
- fix: block on notification of at least one runtime config (#5191) · cdeda221
  Yan Ru Pei authored Jan 05, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  cdeda221
02 Jan, 2026 1 commit
- chore: update all copyright headers in repo to 2026 (#5130) · cf433e68
  Tushar Sharma authored Jan 02, 2026
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  cf433e68
31 Dec, 2025 1 commit

fix: sglang disagg routing fixes and optimizations [DYN-1692] (#5106) · 0b33c1df

Yan Ru Pei authored Dec 31, 2025


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
Co-authored-by: Sean SH Choi <sechoi@nvidia.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

0b33c1df

12 Dec, 2025 2 commits
- fix: cleaner prefill + decode discovery (#4927) · feb49914
  Yan Ru Pei authored Dec 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  feb49914
- fix: prefill discovery (#4911) · f790e921
  Yan Ru Pei authored Dec 11, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f790e921
11 Dec, 2025 2 commits
- feat: use os assigned free port for tcp rpc (#4891) · 64a30d3d
  Biswa Panda authored Dec 11, 2025
  
  64a30d3d
- feat: early rejection based on active prefill tokens (#4837) · 10b01b45
  Yan Ru Pei authored Dec 11, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  10b01b45
04 Dec, 2025 1 commit
- chore: no need to arc wrap client (#4741) · 5b24b429
  Yan Ru Pei authored Dec 03, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  5b24b429
02 Dec, 2025 1 commit
- feat: dynamic setting of thresholds for rejection (#4673) · 4c1bc4ee
  Yan Ru Pei authored Dec 02, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  4c1bc4ee
26 Nov, 2025 1 commit
- fix: allow router to be registered as general transport type (#4633) · ea9d00e7
  Yan Ru Pei authored Nov 26, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ea9d00e7
25 Nov, 2025 2 commits
- chore: make router use the discovery pattern instead of manual kv watch (#4597) · 9c5018e5
  Yan Ru Pei authored Nov 25, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  9c5018e5
- chore(runtime): Tidy up component paths (#4560) · 51c1b9f1
  Graham King authored Nov 25, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  51c1b9f1