Commits · db49dfd216f7adf5d46d8fc69575a15388142228 · OpenDAS / dynamo

25 Mar, 2026 2 commits
- feat: add power-of-two-choices router mode (#7614) · db49dfd2
  Aaron Batilo authored Mar 24, 2026
```
Signed-off-by: Aaron Batilo <abatilo@coreweave.com>
```
  db49dfd2
- fix: Request Rejection busy signal passage (#7615) · db79f324
  Jacky authored Mar 24, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  db79f324
23 Mar, 2026 1 commit
- feat(mocker): add multi-worker replay and router startup fixes (#7553) · b7fe46b1
  Yan Ru Pei authored Mar 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b7fe46b1
19 Mar, 2026 1 commit
- test: GAIE integration Unit and e2e tests (#7257) · 50af3435
  atchernych authored Mar 19, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  50af3435
15 Mar, 2026 1 commit
- feat(kv-indexer): add python launcher follow-up [DYN-2459] (#7395) · 56b448a6
  Yan Ru Pei authored Mar 15, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  56b448a6
13 Mar, 2026 1 commit
- test: generalize router test infrastructure and expand documentations (#7327) · 33604afa
  Keiven C authored Mar 13, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  33604afa
12 Mar, 2026 1 commit
- feat(kv-router): ZMQ gap detection + replay for standalone indexer [LLM-126] (#7209) · bb07b2f4
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  bb07b2f4
11 Mar, 2026 1 commit
- chore(test): declutter router common.py into helper and router_process modules (#7210) · 96a55928
  Yan Ru Pei authored Mar 11, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  96a55928
09 Mar, 2026 1 commit
- feat(kv-router): P2P recovery for standalone KV indexer [DYN-2367] (#6934) · 48eb52e7
  Yan Ru Pei authored Mar 09, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  48eb52e7
06 Mar, 2026 1 commit
- fix: restore --enforce-disagg to reject requests before prefill router activates (#6957) · f934744f
  Yan Ru Pei authored Mar 05, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f934744f
04 Mar, 2026 1 commit
- feat(kv-indexer): multi-model and multi-tenant isolation (#6830) · 35f99f93
  Yan Ru Pei authored Mar 04, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  35f99f93
02 Mar, 2026 1 commit
- feat: move standalone KV indexer into kv-router crate with HTTP integration tests (#6569) · 07742cc2
  Yan Ru Pei authored Mar 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  07742cc2
27 Feb, 2026 2 commits
- fix(test): poll for snapshot before starting Router 2 in indexers_sync (#6707) · c68052ff
  Yan Ru Pei authored Feb 27, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  c68052ff
- feat: default router_event_threads to 4 (#6672) · 55c0a769
  Yan Ru Pei authored Feb 27, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  55c0a769
24 Feb, 2026 2 commits
- test: more stringent test for routing decisions (#6531) · 08db2844
  Yan Ru Pei authored Feb 24, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  08db2844
- chore: replace --enforce-disagg with --decode-fallback, default to enforcing disagg (#6515) · c9ff6235
  Yan Ru Pei authored Feb 24, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c9ff6235
23 Feb, 2026 1 commit
- feat: add standalone KV indexer with query endpoint [DYN-2164] (#6446) · 038b50d2
  Yan Ru Pei authored Feb 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  038b50d2
19 Feb, 2026 2 commits
- feat: Add runtime.endpoint() method to eliminate namespace chaining (#6386) · 0ce3461a
  Tzu-Ling Kan authored Feb 19, 2026
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  0ce3461a
- refactor: update frontend kv-router flags to be consistent with router (#6361) · 44a76f96
  jh-nv authored Feb 18, 2026
  
  44a76f96
13 Feb, 2026 2 commits
- fix: consolidate dyn_discovery_backend and dyn_kv_store (#6167) · a289695c
  mohammedabdulwahhab authored Feb 13, 2026
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  a289695c
- chore: rename KvPushRouter to KvRouter in python + more bindings removal (#6238) · 14eceb43
  Yan Ru Pei authored Feb 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  14eceb43
12 Feb, 2026 1 commit

Yan Ru Pei authored Feb 11, 2026


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: jthomson04 <jothomson@nvidia.com>
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Signed-off-by: Janelle Cai <jcai18@mit.edu>
Co-authored-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Janelle Cai <jcai18@mit.edu>

937398cf

11 Feb, 2026 1 commit
- test: refactor router e2e tests to use context managers for process lifecycle (#6088) · 6fe2152b
  Karen Chung authored Feb 10, 2026
  
  6fe2152b
08 Feb, 2026 1 commit

chore: enable local indexers by default, and use normal event plane by default... · 6783bdca

Yan Ru Pei authored Feb 08, 2026


chore: enable local indexers by default, and use normal event plane by default (not jetstream) (#5941)
Signed-off-by: PeaBrane <yanrpei@gmail.com>

6783bdca

04 Feb, 2026 1 commit

chore: rename terminate_existing to terminate_all_matching_processes (#5923) · e55ebec5

Keiven C authored Feb 04, 2026


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

e55ebec5

03 Feb, 2026 2 commits
- feat: prefill tokens threshold based on max num batched tokens frac (#5867) · a337113a
  Yan Ru Pei authored Feb 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  a337113a
- feat: per dp rank gap detection (#5873) · 902eabd9
  Yan Ru Pei authored Feb 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  902eabd9
29 Jan, 2026 2 commits
- chore: Upgrade to Tensorrt-LLM 1.3.0rc1 (#5700) · ba711cc1
  Tanmay Verma authored Jan 29, 2026
```
Co-authored-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
```
  ba711cc1
- chore: consistently used the arc shared workers configs + CI flake fixes (#5707) · 584020f4
  Yan Ru Pei authored Jan 29, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  584020f4
02 Jan, 2026 1 commit
- chore: update all copyright headers in repo to 2026 (#5130) · cf433e68
  Tushar Sharma authored Jan 02, 2026
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  cf433e68
31 Dec, 2025 1 commit

fix: sglang disagg routing fixes and optimizations [DYN-1692] (#5106) · 0b33c1df

Yan Ru Pei authored Dec 31, 2025


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
Co-authored-by: Sean SH Choi <sechoi@nvidia.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

0b33c1df

18 Dec, 2025 3 commits
- feat: switch to tcp as default request plane (#4845) · 18b64e90
  Biswa Panda authored Dec 18, 2025
  
  18b64e90
- feat: support disag serving in GAIE [DEP-659] (#4756) · 15b49818
  atchernych authored Dec 18, 2025
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  15b49818
- refactor: router tests to be pytest-xdist parallel safe (#5005) · 1b8869f5
  Keiven C authored Dec 17, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  1b8869f5
17 Dec, 2025 1 commit
- fix: make gap detection work e2e (#4993) · 0fba01c2
  Yan Ru Pei authored Dec 16, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  0fba01c2
16 Dec, 2025 1 commit
- chore: add test for diverging prefixes (#4919) · 29ec4969
  Neal Vaidya authored Dec 15, 2025
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
```
  29ec4969
11 Dec, 2025 4 commits
- feat: early rejection based on active prefill tokens (#4837) · 10b01b45
  Yan Ru Pei authored Dec 11, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  10b01b45
- feat: include ttft and total request time in nvext (engine-agnostic) (#4880) · 2845aa1f
  Yan Ru Pei authored Dec 10, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Keiven C <213854356+keivenchang@users.noreply.github.com>
```
  2845aa1f
- test: Ensure Request Cancellation, Migration, Rejection Work with TCP transport (#4875) · 00f8615e
  Jacky authored Dec 10, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  00f8615e
- test: router + trtllm CI tests (#4805) · ac8d36c6
  Karen Chung authored Dec 10, 2025
  
  ac8d36c6